stoplist.cf

harvest是一个下载html网页得机器人

#
#  stoplist.cf - Removes candidate objects by their type.
#
#  Format: 	Type
#
#  $Id: stoplist.cf,v 2.1 1997/03/21 19:21:48 sxw Exp $
#

#
#  Remove all listed types of data.
#
ApacheFancyIndex
Assembly
Audio
Awk
BZIP2CompressedTar
Backup
Batch
BitmapImage
C++
CommonLisp
CompressedTar
Data
DitroffImage
DotFile
EmacsLisp
Empty
Font
Fortran
GDBM
GNUCompressedTar
GNUInfo
GifImage
HTTP-Query
Image
Index
InternetDraft
JPEGImage
Java
LSM
Lex
MIF
MPEGImage
Modula2
Object
OtherCode
OutputFile
PCCompressed
PCZipped
PNGImage
Pascal
PixrectImage
PostScriptFont
Socket
Spreadsheet
SymbolicLink
TeXInfo
TiffImage
Unknown
Video
WaisIndex
WaisSource