changelog

Wget很好的处理了http和ftp的下载,很值得学习的经典代码

	working directory when retrying after a failed FTP attempt.
	Originally reported by Nate Eldredge.

2006-10-12  Mauro Tortonesi  <[e-mail]>

	* convert.c (downloaded_file): Fixed bug which used to break -E -k -K 
	mode.

2006-08-28  Mauro Tortonesi  <[e-mail]>

	* http.c: #include'd spider.h to get rid of compiler warnings.

	* main.c: Ditto.

	* recur.c: Ditto.

2006-08-24  Mauro Tortonesi  <[e-mail]>

	* Makefile.in: Added spider.c to the list of files to compile and
	spider.h to the list of header files. Updated copyright information.

	* http.c: Major changes to recursive spider mode. Now for every
	resource we are supposed to check, we send a HEAD request to find out
	if it exists. If the resource is a HTML file, we retrieve it and parse
	it to discover links to other resources.

	* recur.c: Ditto.

	* res.c (res_retrieve_file): Disable opt.timestamping and opt.spider
	when retrieving robots.txt. Updated copyright information.

	* convert.c: Moved code tracking broken links to spider.c.

	* convert.h: Ditto.

	* spider.c: Created new file to keep track of visited URLs in spider
	mode.

	* spider.h: Ditto.

2006-08-21  Mauro Tortonesi  <[e-mail]>

	* http.c: Fixed timestamping-related bug.

2006-08-16  Mauro Tortonesi  <[e-mail]>

	* http.c: Fixed bug which broke --continue feature. Now if -c is
	given, http_loop sends a HEAD request to find out the destination
	filename before resuming download.

2006-08-08  Hrvoje Niksic  <[e-mail]>

	* utils.c (datetime_str): Avoid code repetition with time_str.

2006-07-21  Hrvoje Niksic  <[e-mail]>

	* init.c (commands): Correctly place "contentdisposition".

2006-07-14  Mauro Tortonesi  <[e-mail]>
	
	* sysdep.h: If intptr_t isn't defined, simply typedef it to long.

	* http.c: Added explicit cast to int in logprintf call to remove
	compiler warnings on 64-bit platforms.

	* connect.c: Added a few casts to intptr_t to remove compiler warnings
	on 64-bit platforms.
	
	* main.c: Disable -r, -p and -N when -O is used. Disable -k when -O is
	used and multiple URLs are given. Update maintainer information.
	
	* all: Update copyright information.
	
2006-07-10  KJKHyperion  <[e-mail]>

	* url.c (filechr_table): Mark DEL (0x7f) as a control character
	and | as a character Windows can't handle.

2006-06-28  Mauro Tortonesi  <[e-mail]>

	* res.c: Implemented is_robots_txt_url function for detection of
	robots.txt URLs and related test routine.

	* res.h: Ditto.

	* url.c: Implemented are_urls_equal function for URL comparison and
	related testing routine.

	* url.h: Ditto.

	* convert.c: Fixes for recursive spider mode: don't consider
	non-existing robots.txt as a broken link, and use are_urls_equal
	instead of strcasecmp for referrer URLs comparison.

	* test.c: Call tests routines for are_urls_equal and 
	is_robots_txt_url.

2006-06-26  Hrvoje Niksic  <[e-mail]>

	* wget.h (wgint): Typedef to any 64-bit (or larger) type we can
	find, not necessarily off_t or long.

2006-06-26  Hrvoje Niksic  <[e-mail]>

	* cmpt.c (strtoll): Check for overflow and underflow without
	relying on (technically) undefined behavior.  Don't assume that
	strtoll_type is 64 bits wide.

2006-06-21  Hrvoje Niksic  <[e-mail]>

	* utils.c (base64_encode): Cast void pointer to char * before
	doing arithmetic.

2006-06-20  Hrvoje Niksic  <[e-mail]>

	* utils.c (base64_encode): Made TBL const.
	(base64_decode): Made the base64_char_to_value table const.

2006-06-19  Hrvoje Niksic  <[e-mail]>

	* utils.c (base64_encode): Made the DATA pointer void * so the
	callers can pass it any kind of pointer (including both signed and
	unsigned char pointers).
	(base64_decode): Ditto for DEST.

2006-06-19  Hrvoje Niksic  <[e-mail]>

	* utils.c (base64_encode): Would read past end of STR.
	Reported by [e-mail].

2006-06-13  Mauro Tortonesi  <[e-mail]>

	* options.h (struct options): Introduced member restrict_files_case to
	keep track of preferences on character case restrictions for
	filenames.

	* init.c: Modified defaults and cmd_spec_restrict_file_names to
	support character case restrictions for filenames. Added
	test_cmd_spec_restrict_file_names unit test.

	* url.c: Modified append_uri_pathel to support character case
	restrictions for filenames. Added test_append_uri_pathel unit test.

	* test.c: Added test_cmd_spec_restrict_file_names and
	test_append_uri_pathel to the list of unit tests to run.

2006-06-12  Mauro Tortonesi  <[e-mail]>

	* retr.c (retrieve_from_file): Use retrieve_tree and automatically
	turn on opt.follow_ftp in case of recursive FTP retrieval through HTTP
	proxy.

	* main.c: Automatically turn on opt.follow_ftp in case of recursive
	FTP retrieval through HTTP proxy.

2006-06-12  Tony Lewis  <[e-mail]>

	* main.c: Improved CHEN Peng's patch by proposing a simpler logic.

2006-06-12  CHEN Peng  <[e-mail]>

	* main.c: Use retrieve_tree in case of recursive FTP retrieval through
	HTTP proxy.

2006-05-25  Mauro Tortonesi  <[e-mail]>

	* convert.c: Added mechanisms to keep track broken links.

	* convert.h: Ditto.

	* wget.h: Reordered and enumerated uerr_t constants.

	* recur.c: Fixes to support recursive spider mode.

	* http.c: Ditto.

	* main.c: Print broken links in case of recursive spider mode.

	* retr.c: Changed interface of retrieve_url.

	* retr.h: Ditto.

	* ftp.c: Changed interface of ftp_loop.

	* ftp.h: Ditto.

	* res.c: Minor change to reflect changes in interface of retrieve_url.

2006-05-18  Lawrence Jones  <[e-mail]>

	* ftp-ls.c (ftp_parse_unix_ls): Correct size parsing, add size
	and filename debugging output.

2006-04-28  Mauro Tortonesi  <[e-mail]>

	* http.c: If Content-Disposition header is present, allow unique
	filename generation unless -nc is given. Permit to disable parsing of
	Content-Disposition header.

	* options.h: Added option --no-content-disposition to disable parsing
	of HTTP Content-Disposition header.

	* init.c: Ditto.
	
	* main.c: Ditto.

2006-04-11  Hrvoje Niksic  <[e-mail]>

	* hash.c (TOLOWER): Wrap macro arg in parentheses.

2006-04-08  Hrvoje Niksic  <[e-mail]>

	* http.c (parse_content_disposition): Doc fix.

2006-03-15  Mauro Tortonesi  <[e-mail]>

	* utils.c: Restricted operational semantics of frontcmp and proclist
	from generic strings to directory names and them to subdir_p and
	dir_matches_p respectively.  Applied George Ogata's one line patch to
	restrict algorithm of subdir_p to full directory name matching.  Added
	testcases for subdir_p and dir_matches_p.

	* utils.h: Changed all frontcmp occurrences to subdir_p.
	
	* recur.c: Ditto.
	
	* test.c: Changed type returned by test functions from char * to const
	char *.  Added test_subdir_p and test_dir_matches_p to the list of
	tests to run.

	* http.c (test_parse_content_disposition): Changed return type from
	char * to const char *. 

2006-03-14  Mauro Tortonesi  <[e-mail]>

	* recur.c (struct queue_element): Changed type of html_allowed member
	to bool.
	
2006-03-09  Mauro Tortonesi  <[e-mail]>

	* ftp.c (ftp_list): Try `LIST -a' command first and revert to `LIST'
	in case of failure.

2006-03-06  Hrvoje Niksic  <[e-mail]>

	* hash.c (TOLOWER): Fix definition when STANDALONE.
	Reported by Beni Serfaty.

2006-03-02  Mauro Tortonesi  <[e-mail]>

	* http.c (http_loop): Fixed recursive HTTP retrieval.

2006-02-28  Hrvoje Niksic  <[e-mail]>

	* http.c (extract_param): Declare extern so it can be used from
	other files.
	(extract_param): Return error for empty name.

2006-02-28  Hrvoje Niksic  <[e-mail]>

	* url.c (find_last_char): Define in terms of memrchr.

	* cmpt.c (memrchr): Define it on systems that don't have it.

	* http.c (extract_param): New function for parsing header values
	with parameters.
	(parse_content_disposition): Use it.  Don't allow slashes and
	backslashes in the file name.

2006-02-27  Hrvoje Niksic  <[e-mail]>

	* url.c (path_simplify): Don't preserve ".." at beginning of path.
	Suggested by Frank McCown.

2006-02-25  Hrvoje Niksic  <[e-mail]>

	* http.c (gethttp): Only use FILE.N.html if FILE.html exists.

2006-02-09  Hrvoje Niksic  <[e-mail]>

	* mswindows.c (run_with_timeout): Made thread_hnd non-static.

2006-02-05  Hrvoje Niksic  <[e-mail]>

	* retr.c (sleep_between_retrievals): Sleep at a minimum of 1/2 of
	the specified wait period.

2006-02-03  Hrvoje Niksic  <[e-mail]>

	* utils.c (number_to_string): Don't use sprintf for printing
	WGINT_MIN; simply divide n by 10 and defer printing the last
	digit.
	(number_to_string): Removed the SPRINTF_WGINT macro.

2006-02-03  Mauro Tortonesi  <[e-mail]>

	* http.c: Fixed support for Content-Disposition header.

	* test.c: Added test_parse_content_disposition to the list of unit
	tests to run.

2006-02-02  Hrvoje Niksic  <[e-mail]>

	* hash.c: Don't define countof if it's already defined.

	* hash.c: Obtain the definition of uintptr_t when standalone.

2006-01-30  Mauro Tortonesi  <[e-mail]>

	* http.c: Changed output format. Removed excessively verbose debugging
	output.

2005-12-07  Mauro Tortonesi  <[e-mail]>

	* http.c: Fixed pre-download verbose output which was broken by 
	HTTP code refactoring.

2005-11-23  Mauro Tortonesi  <[e-mail]>

	* http.c: Refactored HTTP code.  If -O is not used, the new code
	delays the choice of the file name where the downloaded resource
	will be saved until the HTTP headers have been retrieved.
	Added support for Content-Disposition header. 

2005-11-19  Hrvoje Niksic  <[e-mail]>

	* hash.c (INVALID_PTR): Use uintptr_t instead of unsigned long.
	(hash_pointer): Don't assume a pointer fits in `unsigned long'.

2005-11-02  Mauro Tortonesi  <[e-mail]>

	* Makefile.in: Removed support for unit testing (now it is in
	tests/Makefile.in).

2005-10-27  Mauro Tortonesi  <[e-mail]>

	* Makefile.in: Added basic support for unit testing.

	* test.c: Ditto.
	
	* test.h: Ditto.
	
2005-10-13  Daniel Stenberg  <[e-mail]>

	* http-ntlm.c (ntlm_output): Fixed buffer overflow vulnerability.

2005-10-09  Russ Allbery  <[e-mail]>

	* snprintf.c: Remove round to round_int and pow10 to pow10_int, to
	avoid warnings from GCC 4.0.

2005-10-05  Mauro Tortonesi  <[e-mail]>

	* retr.c: Changed semantics of no_proxy_match.

2005-09-17  Hrvoje Niksic  <[e-mail]>

	* main.c (main): Don't print the summary if nothing has been downloaded.

2005-09-17  Hrvoje Niksic  <[e-mail]>

	* retr.c (retr_rate): Rename parameter from MSECS to SECS since it
	no longer holds milliseconds.

2005-09-01  Hrvoje Niksic  <[e-mail]>

	* progress.c: Introduce symbolic constants for "magic" values of
	0.2 and 0.9, REFRESH_INTERVAL and ETA_REFRESH_INTERVAL.

2005-08-27  Hrvoje Niksic  <[e-mail]>

	* cmpt.c (strtoll): Correctly handle strtoll("0x", ptr, 0) and
	strtoll("0x<nonhexchar>", ptr, 0) -- in both cases *ptr must be
	set to the position of 'x', not after it.

2005-08-27  Hrvoje Niksic  <[e-mail]>

	* hash.c (hash_table_map): Rename to hash_table_for_each and
	update callers.
	Document the meaning of the callback's return value.
	(hash_table_iterate): New function.
	(hash_table_iter_next): Likewise.
	Update most places that used hash_table_for_each to use the
	iteration, which doesn't require a temporary function with
	explicit state management.

2005-08-26  Albert Chin  <[e-mail]>

	* Makefile.in: Use @datadir@.  Define localedir as $(datadir)/locale.

2005-08-26  Jeremy Shapiro  <[e-mail]>

	* openssl.c (ssl_init): Set SSL_MODE_AUTO_RETRY.

2005-08-23  Hrvoje Niksic  <[e-mail]>

	* host.c (address_list_from_ipv4_addresses): Use IP_INADDR_DATA.

2005-08-12  Hrvoje Niksic  <[e-mail]>

	* wget.h: Renamed strtoll_return to strtoll_type.

2005-08-11  Hrvoje Niksic  <[e-mail]>

	* progress.c (eta_to_human_short): Switch to days when printing
	more than 48h rather than 100h.  (It's not immediately apparent
	how many days there are in 83h.)

2005-08-11  Hrvoje Niksic  <[e-mail]>

	* cmpt.c (strtoll): Define it if missing on the system and if Wget
	needs it.

	* mswindows.c (str_to_int64): Move to cmpt.c and rename to strtoll.