changelog

很好的命令行下载工具.开发环境为unix/linux

	* ftp.c (getftp): Ditto for FTP "REST" command.

	* http.c (gethttp): When the server doesn't respect range, skip
	the first RESTVAL bytes of the read body.  Never truncate the
	output file.

	* retr.c (fd_read_body): Support skipping initial STARTPOS octets.

2003-11-30  Hrvoje Niksic  <[e-mail]>

	* http.c (skip_short_body): Renamed skip_body to skip_short_body;
	don't bother calling fd_read_body.

2003-11-30  Hrvoje Niksic  <[e-mail]>

	* retr.c (fd_read_body): Sanitize arguments and document them
	better.  Make sure the timer is created and updated only if
	necessary.  Updated callers.

2003-11-30  Hrvoje Niksic  <[e-mail]>

	* http.c (skip_body): New function.
	(gethttp): Use it to skip the body of the responses we don't care
	to download.  That allows us to reuse the connection.
	(gethttp): Trust that the HEAD requests will not generate body
	data.

	* retr.c (fd_read_body): Don't write to OUT if it's NULL.

2003-11-29  Hrvoje Niksic  <[e-mail]>

	* http.c (gethttp): Initialize SSL only the first time when SSL
	URL is downloaded.

2003-11-29  Hrvoje Niksic  <[e-mail]>

	* cookies.c (cookie_header): Only generate the contents of the
	header, not the leading "Cookie: " or the trailing "\r\n".

	* http.c (gethttp): When adding headers specified with `--header',
	allow them to override the headers generated by Wget.

	* init.c (cmd_spec_header): Made opt.user_headers a vector.

	* http.c (request_new): New function.  Returns a request structure
	which can be modified in various ways, most notably by adding HTTP
	headers to the request.
	(request_set_header): New function for adding the header to the
	request.  If the header is already available, it gets replaced.
	(request_send): Construct and send the request.
	(gethttp): Use the request_* functions to generate the request.

2003-11-28  Hrvoje Niksic  <[e-mail]>

	* http.c (gethttp): Don't include the Proxy-Authorization header
	in the request tunneled through proxy.

2003-11-28  Hrvoje Niksic  <[e-mail]>

	* http.c (gethttp): Use the CONNECT handle to establish SSL
	passthrough through non-SSL proxies.

2003-11-28  Hrvoje Niksic  <[e-mail]>

	* init.c: Don't #include netinet/Winsock stuff.

2003-11-28  Hrvoje Niksic  <[e-mail]>

	* http.c: Deleted the old functions header_process,
	header_extract_number, header_exists, header_strdup,
	http_process_range, http_process_none, http_process_type, and
	http_process_connection.

	* http.c (response_new): New function.
	(response_header_bounds): Ditto.
	(response_header_copy): Ditto.
	(response_header_strdup): Ditto.
	(response_status): Ditto.
	(gethttp): Use the new response_* functions to parse the response.
	Support HTTP/0.9 responses.

2003-11-27  Hrvoje Niksic  <[e-mail]>

	* progress.c (create_image): Don't calculate ETA if nothing has
	been downloaded yet, because it causes division by zero.

2003-11-27  Hrvoje Niksic  <[e-mail]>

	* connect.c (bind_local): Rename sa_len to addrlen because IRIX
	headers define sa_len as a macro.

2003-11-26  Hrvoje Niksic  <[e-mail]>

	* html-parse.c (convert_and_copy): Remove embedded newlines when
	AP_TRIM_BLANKS is specified.

2003-11-26  Hrvoje Niksic  <[e-mail]>

	* ftp.c: Set con->csock to -1 where rbuf_uninitialize was
	previously used.

2003-11-26  Hrvoje Niksic  <[e-mail]>

	* Makefile.in (http$o): Added the trailing backslash that was
	missing.

2003-11-21  Hrvoje Niksic  <[e-mail]>

	* headers.c: Removed.  The file is no longer relevant, now that no
	special handling of headers is done by the rbuf code.  Moved
	portions to http.c.

2003-11-21  Hrvoje Niksic  <[e-mail]>

	* rbuf.c: Removed.

	* ftp-basic.c (ftp_response): Use fd_read_line.  No longer use
	struct rbuf.  Updated all callers.

	* http.c (gethttp): Use fd_read_head to read all the headers in
	one go.
	(next_header): New function.

	* retr.c (fd_read_line): New function: reads a line from FD,
	leaving the rest of the data unread.
	(fd_read_head): New function.

	* connect.c (fd_peek): New function, implements peeking.
	(poll_internal): New function.
	(fd_read): Use it.
	(fd_write): Ditto.
	(fd_peek): Ditto.
	(fd_register_transport): Allow registering a "peeker" callback.

2003-11-20  Hrvoje Niksic  <[e-mail]>

	* connect.c: Renamed xread/xwrite/xclose to
	fd_read/fd_write/fd_close.  The "x" prefix is not appropriate
	because the semantics have diverged from read/write/close too
	significantly.  Updated all callers.

2003-11-20  Hrvoje Niksic  <[e-mail]>

	* connect.c (sock_write): It's not necessary to initialize RES.

2003-11-19  Hrvoje Niksic  <[e-mail]>

	* main.c (main): Don't reference opt.ipv4_only and opt.ipv6_only
	if IPv6 is disabled.

2003-11-19  Hrvoje Niksic  <[e-mail]>

	* connect.c (socket_has_inet6): Only compile it if IPv6 is enabled
	and AI_ADDRCONFIG is missing.

2003-11-18  Hrvoje Niksic  <[e-mail]>

	* gen_sslfunc.c (ssl_init_prng): Warn the user when using a weak
	random seed.

2003-11-18  Hrvoje Niksic  <[e-mail]>

	* host.c (address_list_contains): Renamed address_list_find to
	address_list_contains because its result is boolean.

2003-11-18  Hrvoje Niksic  <[e-mail]>

	* connect.c (select_fd): Return 1 if select is not available.

2003-11-17  Hrvoje Niksic  <[e-mail]>

	* connect.c (connect_to_host): Don't reference address list after
	releasing it.

2003-11-17  Hrvoje Niksic  <[e-mail]>

	* main.c (print_help): Fix alignment of FTP options output.

2003-11-17  Hrvoje Niksic  <[e-mail]>

	* host.c (lookup_host): Check for the ability to create IPv6
	sockets here.

	* init.c (defaults): Don't auto-set --inet4-only on IPv6-less
	systems.

2003-11-16  Hrvoje Niksic  <[e-mail]>

	* main.c (print_help): Fix typo in `-O' help message.  Fix docs of
	-Y/--proxy.  Fix docs of `--cookies' and `--glob'.  Improve docs
	of --convert-links.  Fix docs of SSL options.

2003-11-16  Hrvoje Niksic  <[e-mail]>

	* ftp-basic.c: Don't include <arpa/inet.h> and others because
	they're no longer needed.

2003-11-16  Hrvoje Niksic  <[e-mail]>

	* main.c (main): Don't allow setting of both opt.ipv4_only and
	opt.ipv6_only.

	* init.c (defaults): Mark opt.ipv4_only specially when set
	automatically.

2003-11-15  Hrvoje Niksic  <[e-mail]>

	* host.c (lookup_host): Use AI_ADDRCONFIG only if the family is
	unspecified.  This ensures that specifying `--no-inet4' on systems
	where IPv6 resolves, but doesn't work behaves the same regardless
	of the availability of AI_ADDRCONFIG.

2003-11-15  Hrvoje Niksic  <[e-mail]>

	* host.c: Don't refer to the now-removed function
	forget_host_lookup in the documentation of lookup_host.

2003-11-15  Hrvoje Niksic  <[e-mail]>

	* http.c (persistent_available_p): Correctly specify the endpoint
	argument to socket_ip_address.
	(gethttp): When printing the "reusing connection to..." message,
	specify the host name of the reused connection, not the current
	host name.  That makes more sense because it provides a useful
	piece of information -- we know to which host we're supposed to
	connect anyway!

2003-11-15  Hrvoje Niksic  <[e-mail]>

	* init.c: Make sure the options are in alphabetic order!

	* host.c (lookup_host): Merge lookup_host_passive and lookup_host
	after all -- having both would result in some code duplication.
	(lookup_host): Set hints.ai_family to AF_INET if ipv4_only is
	requested.  Likewise, set it to AF_INET6 for ipv6_only.  Specify
	AI_ADDRCONFIG where available.
	(lookup_host): New flag LH_REFRESH that specifies that a cached
	entry for HOST should be refreshed.
	(cache_query): New function.
	(cache_store): Ditto.
	(cache_remove): Ditto.
	(forget_host_lookup): No longer necessary, replaced with static
	function cache_remove.

2003-11-14  Hrvoje Niksic  <[e-mail]>

	* main.c: Enable -4 and -6 only if IPv6 is enabled.

2003-11-14  Hrvoje Niksic  <[e-mail]>

	* connect.c (register_transport): Renamed from register_extended.
	Explain the intended usage.

2003-11-14  Hrvoje Niksic  <[e-mail]>

	* url.c (uri_merge): Merging "foo" and "bar" should result in
	"bar", not in "foo/bar".
	(path_simplify): Don't remove empty path elements; don't
	special-case leading slash.
	(path_simplify): Don't swallow ".."'s at the beginning of string.
	E.g. simplify "foo/../../bar" as "../bar", not as "bar".
	(append_uri_pathel): Defang ".." path element upon encountering
	it.

2003-11-13  Hrvoje Niksic  <[e-mail]>

	* http.c (persistent_available_p): Don't attempt to talk to two
	different SSL sites over the same secure connection.

2003-11-13  Hrvoje Niksic  <[e-mail]>

	* http.c (gethttp): Ditto.

	* ftp.c (getftp): Use retryable_socket_connect_error instead of
	CONNECT_ERROR.

	* wget.h (CONNECT_ERROR): Removed.

	* connect.c (retryable_socket_connect_error): New function instead
	of unsupported_socket_family_error.

2003-11-13  Hrvoje Niksic  <[e-mail]>

	* wget.h (CONNECT_ERROR): Use it.

	* connect.c (unsupported_socket_family_error): New function.

2003-11-13  Hrvoje Niksic  <[e-mail]>

	* connect.c (bind_local): Renamed bindport to bind_local; return
	the socket directly.  Updated callers.
	(accept_connection): Renamed acceptport to accept_connection;
	return the created socket directly.  Updated callers.

2003-11-13  Hrvoje Niksic  <[e-mail]>

	* init.c (defaults): Turn on opt.ipv4_only if we're compiling with
	IPv6, and AI_ADDRINFO is not available, and AF_INET6 sockets can't
	be created.

2003-11-13  Hrvoje Niksic  <[e-mail]>

	* host.c (lookup_host): Document the fact that the addresses are
	returned in order.

2003-11-12  Hrvoje Niksic  <[e-mail]>

	* utils.c: Use limits.h only where available.

	* hash.c: Use INVALID_PTR and INVALID_PTR_BYTE.  Include limits.h.

2003-11-11  Hrvoje Niksic  <[e-mail]>

	* main.c: Added options --inet4-only and --inet6-only.

2003-11-11  Hrvoje Niksic  <[e-mail]>

	* host.c (host_errstr): Use the more standard message "Unknown
	host".

2003-11-10  Hrvoje Niksic  <[e-mail]>

	* connect.c (connect_to_host): Use that flag to decide whether to
	re-resolve the host name.

	* host.c (struct address_list): Added a flag that maintains
	whether the connection worked at some point.

2003-11-10  Hrvoje Niksic  <[e-mail]>

	* host.c (lookup_host): Special-case the numeric addresses only in
	the non-IPv6 case.

2003-11-10  Hrvoje Niksic  <[e-mail]>

	* connect.c (resolve_bind_address): Call lookup_host_passive.
	Make sure that opt.bind_address is resolved only once.

	* host.c (lookup_host_passive): New function, handles "passive"
	lookups.
	(lookup_host): Remove the passive flags.  Remove the
	family-related flags -- use ip_default_family instead.

2003-11-09  Hrvoje Niksic  <[e-mail]>

	* html-url.c: Get URLs from <object data="...">.

2003-11-09  Hrvoje Niksic  <[e-mail]>

	* main.c (option_data): Specify the command to use for --mirror.

2003-11-08  Hrvoje Niksic  <[e-mail]>

	* cookies.c (cookie_handle_set_cookie): Specify exact match for
	unspecified domains.

2003-11-08  Hrvoje Niksic  <[e-mail]>

	* main.c (main): Removed one-letter options `-C', `-g', `-G', and
	`-s'.

2003-11-08  Hrvoje Niksic  <[e-mail]>

	* main.c (main): Add --dont-remove-listing for backward
	compatibility with previous versions.
	(print_help): Fix typo, spotted by Dennis Smit.

2003-11-08  Gisle Vanem  <[e-mail]>

	* ftp-basic.c: Support Windows-2000 ftp servers. Win-2000 *is*
	Win-NT 5.0 so calling it ST_WINNT is okay I guess.

2003-11-08  Hrvoje Niksic  <[e-mail]>

	* progress.c (update_speed_ring): Clear the speed ring when the
	download stalls.

	* retr.c (get_contents): Specify 0.95s read timeout, so that the
	progress gauge can be updated even when data arrives very slowly
	or stalls.

2003-11-08  Hrvoje Niksic  <[e-mail]>

	* utils.c (wtimer_allocate): Bless the use of wtimer_read on a
	timer that has merely been allocated because get_contents() does
	that.
	(wtimer_update): Abort if the timer is not initialized.

2003-11-08  Hrvoje Niksic  <[e-mail]>

	* retr.c (get_contents): Pass the timer to limit_bandwidth().

	* utils.c (wtimer_update): New function instead of wget_elapsed;
	just update the timer, but don't return anything.
	(wtimer_read): Read and return the last known value of the timer.

2003-11-08  Hrvoje Niksic  <[e-mail]>

	* http.c (persistent_available_p): Instead of matching all the
	addresses of HOST and last host, determine the peer's IP address
	with socket_ip_address and see if that address is one of those
	HOST resolves to.

	* host.c (address_list_match_all): Removed.
	(address_list_find): New function, finds an IP address in the
	address list.

	* ftp.c (ftp_do_pasv): Get the peer's address here, and pass it to
	ftp_epsv so it doesn't need to call getpeername.

	* ftp-basic.c (ftp_port): Use socket_ip_address instead of
	getpeername.
	(ftp_lprt): Ditto.

	* connect.c (socket_ip_address): Replaces conaddr, generalized to
	eith