hackersguide

harvest是一个下载html网页得机器人

  A Guide to making changes to WP2X.


  Source files:

	charsets.c 	- contains a table of equivalents to WP Corp/IBM 
			character sets. Currently only ISO-Latin1 is supported,
			and there is no way to pick another character set.
		
	charsets.h	- structure definitions for above.

	dopen.c		- some file utility functions (mostly historical)

	getopt.c	- an implementation of the getopt(3) routines, use them
			if you don't have getopt in your libc.
	getopt.h	- header for above.
	patchlevel.h	- records the version of the source
	tokens.c	- helper routines for token reader.
	tokens.h	- header for above
	wp2x.c		- main code


  Notes:  The code in wp2x.c should be split up into smaller pieces.

  Routines of importance:

	process_token:	
		Tokens come in five types: reserved, literal,
			singleByte, fixedLength, varLength 
		The table of tokens is defined tokens.c. The codes are
		taken from the WP technical reference manual.

		Several support routines include:
			ignoreByte, ignoreFixed, ignoreVar
		These functions simple skip over an untranslateable
		(or undefined) code.

	outputToken:
		Takes the output type from the third column and calls process0. 

	process0:
		looks up configuration element types, and output the
		right string defined in the configuration. 
		
		The attributeOn/attributeOff routines can call
		generate calls to process0 as well.


  More to be added.