filearchiv.html

一本完整的描述Unix Shell 编程的工具书的所有范例

> command shows the size,
	    in bytes, of its target, whether file or
	    <TT
CLASS="FILENAME"
>stdout</TT
>.</P
><P
>The <B
CLASS="COMMAND"
>md5sum</B
> and
	    <B
CLASS="COMMAND"
>sha1sum</B
> commands display a
	    <A
HREF="special-chars.html#DASHREF2"
>dash</A
> when they receive their input from
	    <TT
CLASS="FILENAME"
>stdout</TT
>.</P
></TD
></TR
></TABLE
></DIV
><DIV
CLASS="EXAMPLE"
><HR><A
NAME="FILEINTEGRITY"
></A
><P
><B
>Example 12-34. Checking file integrity</B
></P
><TABLE
BORDER="0"
BGCOLOR="#E0E0E0"
WIDTH="90%"
><TR
><TD
><PRE
CLASS="PROGRAMLISTING"
>   1&nbsp;#!/bin/bash
   2&nbsp;# file-integrity.sh: Checking whether files in a given directory
   3&nbsp;#                    have been tampered with.
   4&nbsp;
   5&nbsp;E_DIR_NOMATCH=70
   6&nbsp;E_BAD_DBFILE=71
   7&nbsp;
   8&nbsp;dbfile=File_record.md5
   9&nbsp;# Filename for storing records (database file).
  10&nbsp;
  11&nbsp;
  12&nbsp;set_up_database ()
  13&nbsp;{
  14&nbsp;  echo ""$directory"" &#62; "$dbfile"
  15&nbsp;  # Write directory name to first line of file.
  16&nbsp;  md5sum "$directory"/* &#62;&#62; "$dbfile"
  17&nbsp;  # Append md5 checksums and filenames.
  18&nbsp;}
  19&nbsp;
  20&nbsp;check_database ()
  21&nbsp;{
  22&nbsp;  local n=0
  23&nbsp;  local filename
  24&nbsp;  local checksum
  25&nbsp;
  26&nbsp;  # ------------------------------------------- #
  27&nbsp;  #  This file check should be unnecessary,
  28&nbsp;  #+ but better safe than sorry.
  29&nbsp;
  30&nbsp;  if [ ! -r "$dbfile" ]
  31&nbsp;  then
  32&nbsp;    echo "Unable to read checksum database file!"
  33&nbsp;    exit $E_BAD_DBFILE
  34&nbsp;  fi
  35&nbsp;  # ------------------------------------------- #
  36&nbsp;
  37&nbsp;  while read record[n]
  38&nbsp;  do
  39&nbsp;
  40&nbsp;    directory_checked="${record[0]}"
  41&nbsp;    if [ "$directory_checked" != "$directory" ]
  42&nbsp;    then
  43&nbsp;      echo "Directories do not match up!"
  44&nbsp;      # Tried to use file for a different directory.
  45&nbsp;      exit $E_DIR_NOMATCH
  46&nbsp;    fi
  47&nbsp;
  48&nbsp;    if [ "$n" -gt 0 ]   # Not directory name.
  49&nbsp;    then
  50&nbsp;      filename[n]=$( echo ${record[$n]} | awk '{ print $2 }' )
  51&nbsp;      #  md5sum writes records backwards,
  52&nbsp;      #+ checksum first, then filename.
  53&nbsp;      checksum[n]=$( md5sum "${filename[n]}" )
  54&nbsp;
  55&nbsp;
  56&nbsp;      if [ "${record[n]}" = "${checksum[n]}" ]
  57&nbsp;      then
  58&nbsp;        echo "${filename[n]} unchanged."
  59&nbsp;
  60&nbsp;      elif [ "`basename ${filename[n]}`" != "$dbfile" ]
  61&nbsp;             #  Skip over checksum database file,
  62&nbsp;             #+ as it will change with each invocation of script.
  63&nbsp;	     #  ---
  64&nbsp;	     #  This unfortunately means that when running
  65&nbsp;	     #+ this script on $PWD, tampering with the
  66&nbsp;	     #+ checksum database file will not be detected.
  67&nbsp;	     #  Exercise: Fix this.
  68&nbsp;	then
  69&nbsp;          echo "${filename[n]} : CHECKSUM ERROR!"
  70&nbsp;        # File has been changed since last checked.
  71&nbsp;      fi
  72&nbsp;
  73&nbsp;      fi
  74&nbsp;
  75&nbsp;
  76&nbsp;
  77&nbsp;    let "n+=1"
  78&nbsp;  done &#60;"$dbfile"       # Read from checksum database file. 
  79&nbsp;
  80&nbsp;}  
  81&nbsp;
  82&nbsp;# =================================================== #
  83&nbsp;# main ()
  84&nbsp;
  85&nbsp;if [ -z  "$1" ]
  86&nbsp;then
  87&nbsp;  directory="$PWD"      #  If not specified,
  88&nbsp;else                    #+ use current working directory.
  89&nbsp;  directory="$1"
  90&nbsp;fi  
  91&nbsp;
  92&nbsp;clear                   # Clear screen.
  93&nbsp;echo " Running file integrity check on $directory"
  94&nbsp;echo
  95&nbsp;
  96&nbsp;# ------------------------------------------------------------------ #
  97&nbsp;  if [ ! -r "$dbfile" ] # Need to create database file?
  98&nbsp;  then
  99&nbsp;    echo "Setting up database file, \""$directory"/"$dbfile"\"."; echo
 100&nbsp;    set_up_database
 101&nbsp;  fi  
 102&nbsp;# ------------------------------------------------------------------ #
 103&nbsp;
 104&nbsp;check_database          # Do the actual work.
 105&nbsp;
 106&nbsp;echo 
 107&nbsp;
 108&nbsp;#  You may wish to redirect the stdout of this script to a file,
 109&nbsp;#+ especially if the directory checked has many files in it.
 110&nbsp;
 111&nbsp;exit 0
 112&nbsp;
 113&nbsp;#  For a much more thorough file integrity check,
 114&nbsp;#+ consider the "Tripwire" package,
 115&nbsp;#+ http://sourceforge.net/projects/tripwire/.
 116&nbsp;</PRE
></TD
></TR
></TABLE
><HR></DIV
><P
>Also see <A
HREF="contributed-scripts.html#DIRECTORYINFO"
>Example A-19</A
> and <A
HREF="colorizing.html#HORSERACE"
>Example 33-14</A
> for creative uses of
	    the <B
CLASS="COMMAND"
>md5sum</B
> command.</P
><DIV
CLASS="NOTE"
><TABLE
CLASS="NOTE"
WIDTH="90%"
BORDER="0"
><TR
><TD
WIDTH="25"
ALIGN="CENTER"
VALIGN="TOP"
><IMG
SRC="common/note.png"
HSPACE="5"
ALT="Note"></TD
><TD
ALIGN="LEFT"
VALIGN="TOP"
><P
>	    There have been reports that the 128-bit
	    <B
CLASS="COMMAND"
>md5sum</B
> can be cracked, so the more secure
	    160-bit <B
CLASS="COMMAND"
>sha1sum</B
> is a welcome new addition
	    to the checksum toolkit.
          </P
><P
>Some security consultants think that even
	      <B
CLASS="COMMAND"
>sha1sum</B
> can be compromised. So, what's
	      next -- a 512-bit checksum utility?</P
><TABLE
BORDER="0"
BGCOLOR="#E0E0E0"
WIDTH="90%"
><TR
><TD
><PRE
CLASS="SCREEN"
> <TT
CLASS="PROMPT"
>bash$ </TT
><TT
CLASS="USERINPUT"
><B
>md5sum testfile</B
></TT
>
 <TT
CLASS="COMPUTEROUTPUT"
>e181e2c8720c60522c4c4c981108e367  testfile</TT
>
 
 
 <TT
CLASS="PROMPT"
>bash$ </TT
><TT
CLASS="USERINPUT"
><B
>sha1sum testfile</B
></TT
>
 <TT
CLASS="COMPUTEROUTPUT"
>5d7425a9c08a66c3177f1e31286fa40986ffc996  testfile</TT
>
 	      </PRE
></TD
></TR
></TABLE
></TD
></TR
></TABLE
></DIV
></DD
><DT
><A
NAME="SHREDREF"
></A
><B
CLASS="COMMAND"
>shred</B
></DT
><DD
><P
>Securely erase a file by overwriting it multiple times with
	      random bit patterns before deleting it. This command has
	      the same effect as <A
HREF="extmisc.html#BLOTOUT"
>Example 12-55</A
>, but does it
	      in a more thorough and elegant manner.</P
><P
>This is one of the GNU <I
CLASS="EMPHASIS"
>fileutils</I
>.</P
><DIV
CLASS="CAUTION"
><TABLE
CLASS="CAUTION"
WIDTH="90%"
BORDER="0"
><TR
><TD
WIDTH="25"
ALIGN="CENTER"
VALIGN="TOP"
><IMG
SRC="common/caution.png"
HSPACE="5"
ALT="Caution"></TD
><TD
ALIGN="LEFT"
VALIGN="TOP"
><P
>Advanced forensic technology may still be able to
	      recover the contents of a file, even after application of
	      <B
CLASS="COMMAND"
>shred</B
>.</P
></TD
></TR
></TABLE
></DIV
></DD
></DL
></DIV
><DIV
CLASS="VARIABLELIST"
><P
><B
><A
NAME="FAENCENCR1"
></A
>Encoding and Encryption</B
></P
><DL
><DT
><B
CLASS="COMMAND"
>uuencode</B
></DT
><DD
><P
>This utility encodes binary files into ASCII characters, making them
	      suitable for transmission in the body of an e-mail message or in a
	      newsgroup posting.</P
></DD
><DT
><B
CLASS="COMMAND"
>uudecode</B
></DT
><DD
><P
>This reverses the encoding, decoding uuencoded files back into the
	      original binaries.</P
><DIV
CLASS="EXAMPLE"
><HR><A
NAME="EX52"
></A
><P
><B
>Example 12-35. Uudecoding encoded files</B
></P
><TABLE
BORDER="0"
BGCOLOR="#E0E0E0"
WIDTH="90%"
><TR
><TD
><PRE
CLASS="PROGRAMLISTING"
>   1&nbsp;#!/bin/bash
   2&nbsp;# Uudecodes all uuencoded files in current working directory.
   3&nbsp;
   4&nbsp;lines=35        # Allow 35 lines for the header (very generous).
   5&nbsp;
   6&nbsp;for File in *   # Test all the files in $PWD.
   7&nbsp;do
   8&nbsp;  search1=`head -$lines $File | grep begin | wc -w`
   9&nbsp;  search2=`tail -$lines $File | grep end | wc -w`
  10&nbsp;  #  Uuencoded files have a "begin" near the beginning,
  11&nbsp;  #+ and an "end" near the end.
  12&nbsp;  if [ "$search1" -gt 0 ]
  13&nbsp;  then
  14&nbsp;    if [ "$search2" -gt 0 ]
  15&nbsp;    then
  16&nbsp;      echo "uudecoding - $File -"
  17&nbsp;      uudecode $File
  18&nbsp;    fi  
  19&nbsp;  fi
  20&nbsp;done  
  21&nbsp;
  22&nbsp;#  Note that running this script upon itself fools it
  23&nbsp;#+ into thinking it is a uuencoded file,
  24&nbsp;#+ because it contains both "begin" and "end".
  25&nbsp;
  26&nbsp;#  Exercise:
  27&nbsp;#  --------
  28&nbsp;#  Modify this script to check each file for a newsgroup header,
  29&nbsp;#+ and skip to next if not found.
  30&nbsp;
  31&nbsp;exit 0</PRE
></TD
></TR
></TABLE
><HR></DIV
><DIV
CLASS="TIP"
><TABLE
CLASS="TIP"
WIDTH="90%"
BORDER="0"
><TR
><TD
WIDTH="25"
ALIGN="CENTER"
VALIGN="TOP"
><IMG
SRC="common/tip.png"
HSPACE="5"
ALT="Tip"></TD
><TD
ALIGN="LEFT"
VALIGN="TOP"
><P
>The <A
HREF="textproc.html#FOLDREF"
>fold -s</A
> command
	    may be useful (possibly in a pipe) to process long uudecoded
	    text messages downloaded from Usenet newsgroups.</P
></TD
></TR
></TABLE
></DIV
></DD
><DT
><B
CLASS="COMMAND"
>mimencode</B
>, <B
CLASS="COMMAND"
>mmencode</B
></DT
><DD
><P
>The <B
CLASS="COMMAND"
>mimencode</B
> and
	      <B
CLASS="COMMAND"
>mmencode</B
> commands process
	      multimedia-encoded e-mail attachments. Although
	      <I
CLASS="EMPHASIS"
>mail user agents</I
> (such as
	      <B
CLASS="COMMAND"
>pine</B
> or <B
CLASS="COMMAND"
>kmail</B
>)
	      normally handle this automatically, these particular
	      utilities permit manipulating such attachments manually
	      from the command line or in a batch by means of a shell
	      script.</P
></DD
><DT
><B
CLASS="COMMAND"
>crypt</B
></DT
><DD
><P
>At one time, this was the standard UNIX file encryption
	      utility.

              <A
NAME="AEN9457"
HREF="#FTN.AEN9457"
>[3]</A
>

	      Politically motivated government regulations
	      prohibiting the export of encryption software resulted
	      in the disappearance of <B
CLASS="COMMAND"
>crypt</B
>
	      from much of the UNIX world, and it is still
	      missing from most Linux distributions. Fortunately,
	      programmers have come up with a number of decent
	      alternatives to it, among them the author's very own <A
HREF="ftp://metalab.unc.edu/pub/Linux/utils/file/cruft-0.2.tar.gz"
TARGET="_top"
>cruft</A
>
	      (see <A
HREF="contributed-scripts.html#ENCRYPTEDPW"
>Example A-4</A
>).  </P
></DD
></DL
></DIV
><DIV
CLASS="VARIABLELIST"
><P
><B
><A
NAME="FAMISC1"
></A
>Miscellaneous</B
></P
><DL
><DT
><A
NAME="MKTEMPREF"
></A
><B
CLASS="COMMAND"
>mktemp</B
></DT
><DD
><P
>Create a <I
CLASS="FIRSTTERM"
>temporary file</I
>

	       <A
NAME="AEN9479"
HREF="#FTN.AEN9479"
>[4]</A
>

	      with a <SPAN
CLASS="QUOTE"
>"unique"</SPAN
> filename. When invoked
	      from the command line without additional arguments,
	      it creates a zero-length file in the <TT
CLASS="FILENAME"
>/tmp</TT
> directory.</P
><P
>	      <TABLE
BORDER="0"
BGCOLOR="#E0E0E0"
WIDTH="90%"
><TR
><TD
><PRE
CLASS="SCREEN"
> <TT
CLASS="PROMPT"
>bash$ </TT
><TT
CLASS="USERINPUT"
><B
>mktemp</B
></TT
>
 <TT
CLASS="COMPUTEROUTPUT"
>/tmp/tmp.zzsvql3154</TT
>
 	      </PRE
></TD
></TR
></TABLE
>
	    </P
><P
><TABLE
BORDER="0"
BGCOLOR="#E0E0E0"
WIDTH="90%"
><TR
><TD
><PRE
CLASS="PROGRAMLISTING"
>   1&nbsp;PREFIX=filename
   2&nbsp;tempfile=`mktemp $PREFIX.XXXXXX`
   3&nbsp;#                        ^^^^^^ Need at least 6 placeholders
   4&nbsp;#+                              in the filename template.
   5&nbsp;#   If no filename template supplied,
   6&nbsp;#+ "tmp.XXXXXXXXXX" is the default.
   7&nbsp;
   8&nbsp;echo "tempfile name = $tempfile"
   9&nbsp;# tempfile name = filename.QA2ZpY
  10&nbsp;#                 or something similar...
  11&nbsp;
  12&nbsp;#  Creates a file of that name in the current working directory
  13&nbsp;#+ with 600 file permissions.
  14&nbsp;#  A "umask 177" is therefore unnecessary,
  15&nbsp;#  but it's good programming practice anyhow.</PRE
></TD
></TR
></TABLE
></P
></DD
><DT
><B
CLASS="COMMAND"
>make</B
></DT
><DD
><P
>Utility for building and compiling binary packages. 
	      This can also be used for any set of operations that is
	      triggered by incremental changes in source files.</P
><P
><A
NAME="MAKEFILEREF"
></A
></P
><P
>The <B
CLASS="COMMAND"
>make</B
> command checks a
	    <TT
CLASS="FILENAME"
>Makefile</TT
>, a list of file dependencies and
	      operations to be carried out.</P
></DD
><DT
><B
CLASS="COMMAND"
>install</B
></DT
><DD
><P
>Special purpose file copying command, similar to
	      <B
CLASS="COMMAND"
>cp</B
>, but capable of setting permissions
	      and attributes of the copied files. This command seems
	      tailormade for installing software packages, and as such it
	      shows up frequently in <TT
CLASS="FILENAME"
>Makefiles</TT
>
	      (in the <TT
CLASS="REPLACEABLE"
><I
>make install :</I
></TT
>
	      section). It could likewise find use in installation
	      scripts.</P
></DD
><DT
><B
CLASS="COMMAND"
>dos2unix</B
></DT
><DD
><P
>This utility, written by Benjamin Lin and collaborators,
	      converts DOS-formatted text files (lines terminated by
	      CR-LF) to UNIX format (lines terminated by LF only),
	      and vice-versa.</P
></DD
><DT
><B
CLASS="COMMAND"
>ptx</B
></DT
><DD
><P
>The <B
CLASS="COMMAND"
>ptx [targetfile]</B
> command
	      outputs a permuted index (cross-reference list) of the
	      targetfile. This may be further filtered and formatted in a
	      pipe, if necessary.</P
></DD
><DT
><B
CLASS="COMMAND"
>more</B
>, <B
CLASS="COMMAND"
>less</B
></DT
><DD
><P
>Pagers that display a text file or stream to
	      <TT
CLASS="FILENAME"
>stdout</TT
>, one screenful at a time.
	      These may be used to filter the output of
	      <TT
CLASS="FILENAME"
>stdout</TT
> . . . or of a script.</P
><P
>	       An interesting application of <B
CLASS="COMMAND"
>more</B
>
	       is to <SPAN
CLASS="QUOTE"
>"test drive"</SPAN
> a command sequence,
	       to forestall potentially unpleasant consequences.
                 <TABLE
BORDER="0"
BGCOLOR="#E0E0E0"
WIDTH="90%"
><TR
><TD
><PRE
CLASS="PROGRAMLISTING"
>   1&nbsp;ls /home/bozo | awk '{print "rm -rf " $1}' | more
   2&nbsp;#                                            ^^^^
   3&nbsp;		 
   4&nbsp;# Testing the effect of the following (disastrous) command line:
   5&nbsp;#      ls /home/bozo | awk '{print "rm -rf " $1}' | sh
   6&nbsp;#      Hand off to the shell to execute . . .       ^^</PRE
></TD
></TR
></TABLE
>
            </P
></DD
></DL
></DIV
></DIV
><H3
CLASS="FOOTNOTES"
>Notes</H3
><TABLE
BORDER="0"
CLASS="FOOTNOTES"
WIDTH="100%"
><TR
><TD
ALIGN="LEFT"
VALIGN="TOP"
WIDTH="5%"
><A
NAME="FTN.AEN8586"
HREF="filearchiv.html#AEN8586"
>[1]</A
></TD
><TD
ALIGN="LEFT"
VALIGN="TOP"
WIDTH="95%"
><P
>An <I
CLASS="FIRSTTERM"
>archive</I
>,
	        in the sense discussed here, is simply a set of related
	        files stored in a single location.</P
></TD
></TR
><TR
><TD
ALIGN="LEFT"
VALIGN="TOP"
WIDTH="5%"
><A
NAME="FTN.AEN8596"
HREF="filearchiv.html#AEN8596"
>[2]</A
></TD
><TD
ALIGN="LEFT"
VALIGN="TOP"
WIDTH="95%"
><P
>		    A <B
CLASS="COMMAND"
>tar czvf archive_name.tar.gz *</B
>
		    <I
CLASS="EMPHASIS"
>will</I
> include dotfiles in
		    directories <I
CLASS="EMPHASIS"
>below</I
> the current
		    working directory. This is an undocumented GNU
		    <B
CLASS="COMMAND"
>tar</B
> <SPAN
CLASS="QUOTE"
>"feature"</SPAN
>.
		  </P
></TD
></TR
><TR
><TD
ALIGN="LEFT"
VALIGN="TOP"
WIDTH="5%"
><A
NAME="FTN.AEN9457"
HREF="filearchiv.html#AEN9457"
>[3]</A
></TD
><TD
ALIGN="LEFT"
VALIGN="TOP"
WIDTH="95%"
><P
>This is a symmetric block cipher, used to
	        encrypt files on a single system or local network, as opposed
		to the <SPAN
CLASS="QUOTE"
>"public key"</SPAN
> cipher class, of which
		<B
CLASS="COMMAND"
>pgp</B
> is a well-known
		example.</P
></TD
></TR
><TR
><TD
ALIGN="LEFT"
VALIGN="TOP"
WIDTH="5%"
><A
NAME="FTN.AEN9479"
HREF="filearchiv.html#AEN9479"
>[4]</A
></TD
><TD
ALIGN="LEFT"
VALIGN="TOP"
WIDTH="95%"
><P
>Creates a temporary
	       <I
CLASS="EMPHASIS"
>directory</I
> when invoked with the
	       <TT
CLASS="OPTION"
>-d</TT
> option.</P
></TD
></TR
></TABLE
><DIV
CLASS="NAVFOOTER"
><HR
ALIGN="LEFT"
WIDTH="100%"><TABLE
WIDTH="100%"
BORDER="0"
CELLPADDING="0"
CELLSPACING="0"
><TR
><TD
WIDTH="33%"
ALIGN="left"
VALIGN="top"
><A
HREF="textproc.html"
>Prev</A
></TD
><TD
WIDTH="34%"
ALIGN="center"
VALIGN="top"
><A
HREF="index.html"
>Home</A
></TD
><TD
WIDTH="33%"
ALIGN="right"
VALIGN="top"
><A
HREF="communications.html"
>Next</A
></TD
></TR
><TR
><TD
WIDTH="33%"
ALIGN="left"
VALIGN="top"
>Text Processing Commands</TD
><TD
WIDTH="34%"
ALIGN="center"
VALIGN="top"
><A
HREF="external.html"
>Up</A
></TD
><TD
WIDTH="33%"
ALIGN="right"
VALIGN="top"
>Communications Commands</TD
></TR
></TABLE
></DIV
></BODY
></HTML
>