changelog

wget (command line browser) source code

	* init.c: Ditto.

	* main.c: Ditto.

	* http.c: Use the new interface.

	* cookies.c: Provide an OO-style "cookie jar" interface to enable
	separate cookie jars.

	* http.c (http_atotm): Declare argument as const.

2002-04-20  Hrvoje Niksic  <[e-mail]>

	* cookies.c (cookie_new): Default to PORT_ANY.
	(find_cookie_chain_exact): Only search by DOMAIN.
	(find_matching_cookie): Also check that PORT matches.
	(store_cookie): Only match the domain.
	(set_cookie_header_cb): When a cookie "fakes" a domain, assume it
	is valid for that host rather than discarding it completely.
	(find_matching_chains): Don't search by PORT.
	(matching_cookie): Also match PORT.
	(load_cookies): Set the port if specified, otherwise leave it as
	ANY.
	(save_cookies_mapper): Save the port if specified, otherwise leave
	it empty.

2002-04-19  Thomas Lussnig  <[e-mail]>

	* init.c: The option `egdfile' was not in sort order.

2002-04-16  Hrvoje Niksic  <[e-mail]>

	* ftp.c (getftp): Treat directories that begin with <letter>: as
	absolute.
	(getftp): Strip trailing slashes from con->id before merging it
	with TARGET.

2002-04-16  Hrvoje Niksic  <[e-mail]>

	* http.c (gethttp): If Content-Type is not given, assume
	text/html.

2002-04-15  Hrvoje Niksic  <[e-mail]>

	* recur.c (download_child_p): Don't ignore rejection of HTML
	documents that are themselves leaves of recursion.

2002-04-15  Ian Abbott  <[e-mail]>

	Makefile.in: Updated several dependencies for object files to take
	account of nested include files.

2002-04-15  Ian Abbott  <[e-mail]>

	Makefile.in: The target `connect$o' (connect.o) now depends on
	`utils.h'

2002-04-15  Ian Abbott  <[e-mail]>

	* host.c (SET_H_ERRNO): New function-like macro to set `h_errno'.
	(gethostbyname_with_timeout): Use it.

	* utils.c: Don't define `SETJMP()', `run_with_timeout_env' or
	`abort_run_with_timeout()' when `USE_SIGNAL_TIMEOUT' is undefined.

2002-04-15  Hrvoje Niksic  <[e-mail]>

	* host.c (getaddrinfo_with_timeout): New function.
	(gethostbyname_with_timeout): Ditto.
	(lookup_host): Use them.

2002-04-14  Hrvoje Niksic  <[e-mail]>

	* utils.c (number_to_string): Handle the case when n < -INT_MAX.

2002-04-14  Hrvoje Niksic  <[e-mail]>

	* init.c (comind): Use a marginally faster implementation of
	binary search.  To quote Martin Buchholz, "a nanosecond saved is a
	nanosecond earned."

2002-04-14  Hrvoje Niksic  <[e-mail]>

	* main.c (print_help): Document `--post-data' and `--post-file'.

2002-04-14  Hrvoje Niksic  <[e-mail]>

	* http.c (gethttp): Ditto.

	* retr.c (retrieve_url): Initialize variables to appease the
	compiler.

	* gen_sslfunc.c (ssl_iread): Don't handle EINTR when calling
	select_fd.
	(ssl_iwrite): Ditto.

	* connect.c (select_fd): Rewrite to handle EINTR.  Set errno to
	ETIMEDOUT in case of timeout.
	(iread): No need to handle EINTR when calling select_fd.
	(iwrite): Ditto.

2002-04-14  Hrvoje Niksic  <[e-mail]>

	* retr.c (retrieve_url): Make sure that POST is not honored for
	redirections.

	* http.c (gethttp): Send the POST data when requested.
	(post_file): New function.
	(gethttp): Use it.

	* main.c (main): Ditto.

	* init.c: Add new options.

	* options.h (struct options): New options post_data and
	post_file_name.

2002-04-14  Hrvoje Niksic  <[e-mail]>

	* connect.c (connect_with_timeout): Firing SIGALRM can result in
	connect() exiting with EINTR.  Treat EINTR the same as ETIMEDOUT.

2002-04-13  Hrvoje Niksic  <[e-mail]>

	* connect.c (connect_with_timeout): Use it.

	* utils.c (run_with_timeout): New function.

2002-04-13  Hrvoje Niksic  <[e-mail]>

	* url.c (getproxy): Accept a struct url argument.  This obviates
	the need for USE_PROXY_P.

	* retr.c (retrieve_url): Allow proxy to be a non-FTP URL.

	* ftp.c (getftp): Recognize FWTK-style proxy.

2002-04-12  Hrvoje Niksic  <[e-mail]>

	* config.h.in: Only define _VA_LIST when compiled with gcc.

2002-04012  Ian Abbott  <[e-mail]>

	* http.c (http_loop): Compensate for MS Windows two-second
	granularity of file modification time when comparing timestamps.

	* ftp.c (ftp_retrieve_list): Ditto.

2002-04-12  Ian Abbott  <[e-mail]>

	* utils.c (has_html_suffix_p): New function to test filename for
	common html extensions.

	* utils.h: Declare it.

	* http.c (http_loop): Use it instead of previous test.

	* retr.c (retrieve_url): Ditto.

	* recur.c (download_child_p): Ditto.

2002-04-12  Hrvoje Niksic  <[e-mail]>

	* config.h.in: Define _VA_LIST on Solaris to prevent stdio.h from
	declaring va_list.
	From Kevin Rodgers <[e-mail]>.

2002-04-12  Ian Abbott  <[e-mail]>

	* Makefile.in: Specify libtool mode explicitly when linking.

2002-04-12  Hrvoje Niksic  <[e-mail]>

	* connect.c (connect_with_timeout): New function.
	(connect_to_one): Use it.

	* config.h.in: Add stubs for HAVE_SIGSETJMP, HAVE_SIGBLOCK, and
	HAVE_SETJMP_H.

2002-04-11  Hrvoje Niksic  <[e-mail]>

	* log.c: Set WGET_USE_STDARG if __STDC__ is defined and stdarg.h
	is present.

2002-04-11  Hrvoje Niksic  <[e-mail]>

	* progress.c (bar_create): If INITIAL is larger than TOTAL, fix
	TOTAL.
	(bar_finish): Likewise.

2002-04-11  Hrvoje Niksic  <[e-mail]>

	* html-url.c (tag_handle_form): New function.  Pick up form
	actions and mark them for conversion only.

2002-04-11  Hrvoje Niksic  <[e-mail]>

	* progress.c (struct progress_implementation): Use PARAMS when
	declaring the parameters of *create, *update, *finish, and
	*set_params.

	* netrc.c: Ditto.

	* http.c: Reformat some function definitions so that ansi2knr can
	read them.

	* hash.c (struct hash_table): Use the PARAMS macro around
	parameters in the declaration of hash_function and test_function.
	(prime_size): Spell 2580823717UL and 3355070839UL as (unsigned
	long)0x99d43ea5 and (unsigned long)0xc7fa5177 respectively, so
	that pre-ANSI compilers can read them.
	(find_mapping): Use PARAMS when declaring EQUALS.
	(hash_table_put): Ditto.

	* ftp.h: Wrap the parameters of ftp_index declaration in PARAMS.

	* cookies.c (cookie_new): Use (unsigned long)0 instead of 0UL,
	which was unsupported by pre-ANSI compilers.

	From Nelson H. F. Beebe <[e-mail]>, for the most part.

2002-04-11  Hrvoje Niksic  <[e-mail]>

	* url.c (url_filename): Use compose_file_name regardless of
	whether opt.dirstruct is set.
	(mkstruct): Don't handle the query and the reencoding of DIR; that
	is done in compose_file_name.

2002-04-10  Hrvoje Niksic  <[e-mail]>

	* wget.h: Ditto for extern char *exec_name.

	* options.h: Don't guard against OPTIONS_DEFINED_HERE -- it is
	perfectly legal to follow an `extern' with a non-`extern' ones,
	provided the types match.

	* main.c: Don't define OPTIONS_DEFINED_HERE.

2002-04-10  Hrvoje Niksic  <[e-mail]>

	* progress.c (create_image): Revert to calculating ETA based on
	average download speed.
	(create_image): Don't print ETA until the download has been active
	for at least 3 seconds.
	(create_image): When ETA is not available, don't print anything.
	The previous version would print --:--.

2002-04-10  Hrvoje Niksic  <[e-mail]>

	* progress.c (bar_update): Keep updating a subinterval until it
	reaches or exceeds a watermark.  That way the measurement will be
	guaranteed to span a configurable minimum of time.  The current
	default is 3s in 30 100ms intervals.

2002-04-09  Hrvoje Niksic  <[e-mail]>

	* progress.c (bar_update): Maintain an array of the time it took
	to perform previous 30 network reads.
	(create_image): Calculate the download speed and ETA based on the
	last 30 reads, not the entire download.
	(create_image): Make sure that the ETA is not changed more than
	once per second.

2002-04-09  Ian Abbott  <[e-mail]>

	* mswindows.c (borland_utime): New function conditionally defined
	when `HACK_BCC_UTIME_BUG' is defined.  A reimplementation of
	`utime()' as Borland's `utime()' function is broken on Windows 9x
	systems.  (Original patch by Chin-yuan Kuo <[e-mail]>.)

2002-04-08  Hrvoje Niksic  <[e-mail]>

	* ftp.c (ftp_loop): Propagate the result of ftp_retrieve_glob.

2002-03-26  Ian Abbott  <[e-mail]>

	* Makefile.in: Updated several dependencies for object files.

2002-03-20  Ian Abbott  <[e-mail]>

	* mswindows.c: Include "utils.h".

2002-03-18  Ian Abbott  <[e-mail]>

	* host.h: Don't include netdb.h on windows.

2002-02-19  Hrvoje Niksic  <[e-mail]>

	* recur.c (retrieve_tree): Handle the case when start_url doesn't
	parse.

2002-02-19  Andreas Damm  <[e-mail]>

	* wget.h (DO_REALLOC_FROM_ALLOCA): Multiply with sizeof(type) when
	calling xmalloc and memcpy.

2002-02-19  Hrvoje Niksic  <[e-mail]>

	* host.h: Include Unix-specific includes #ifndef WINDOWS.
	Patch originally provided by Christian Lackas.

2002-02-11  Christian Lackas  <[e-mail]>

	* recur.c: recurive downloading for https fixed.

2002-02-19  Alan Eldridge  <[e-mail]>

	* host.h: Also include <netinet/in.h> and <sys/socket.h>.

	* ftp-basic.c: Also include <netinet/in.h>.

2002-02-05  Ian Abbott  <[e-mail]>

	* http.c (gethttp): when -c used, mark already fully retrieved
	file as successfully retrieved.

2002-02-19  Hrvoje Niksic  <[e-mail]>

	* url.c (url_parse): Don't treat '?' as query string separator
	when parsing FTP URLs.

2002-02-01  Hrvoje Niksic  <[e-mail]>

	* html-url.c (tag_handle_meta): Don't crash on <meta
	http-equiv=refresh> where content is missing.

2002-01-31  Herold Heiko  <[e-mail]>

	* ftp-basic.c, host.c: don't include sys/socket.h, arpa/inet.h,
	netdb.h on windows.

2002-01-30  Hrvoje Niksic  <[e-mail]>

	* retr.c (retrieve_url): Remove redirection cycle detection.  This
	is because some sites legitimately redirect the user back to the
	same location, e.g. after an authorization check performed by
	another page.  MAX_REDIRECTIONS is still used to prevent infinite
	redirection loops.

2002-01-26  Hrvoje Niksic  <[e-mail]>

	* http.c (gethttp): Wrap host name in square brackets if it
	contains a colon.

2002-01-26  Hrvoje Niksic  <[e-mail]>

	* url.c (url_parse): Allow all hex digits, not only decimal ones,
	to form an IP address.

2002-01-26  Hrvoje Niksic  <[e-mail]>

	* url.c (urlchr_table): Make square braces reserved, so we can
	parse http://[::1]/.
	(url_parse): Handle host in braces.
	(url_string): If url->host contains colons, wrap it in braces.

2002-01-24  Hrvoje Niksic  <[e-mail]>

	* connect.c (resolve_bind_address): New function.
	(connect_to_one): Use it.
	(bindport): Ditto.

	* init.c: Don't resolve bind-address here.

	* host.c (wget_sockaddr_set_address): Would bug out with ADDR == NULL.

2002-01-24  Hrvoje Niksic  <[e-mail]>

	* host.c (lookup_host): Use sizeof(ip4_address) to calculate the
	offset.
	(address_list_new): Use map_ipv4_to_ip.
	(wget_sockaddr_set_address): Convert ADDR to IPv4 before using it
	in IPv4 context.

2002-01-24  Hrvoje Niksic  <[e-mail]>

	* source: Integrated IPv6 support.
	Written by Thomas Lussnig <[e-mail]>.

2002-01-15  Ian Abbott  <[e-mail]>

	* init.c (cmd_file): Change `\' to `/' for Windows (yes, really!)
	(cmd_directory): New function. Like cmd_file(), but strips
	trailing directory separators.
	(commands): Change action for "dirprefix" from `cmd_file' to
	`cmd_directory'.

	* utils.c (make_directory): Allow intermediate `mkdir' calls to
	fail, as not all path components that do not exist should be
	directory components, especially under Windows.

2002-01-17  Hrvoje Niksic  <[e-mail]>

	* netrc.c (parse_netrc): Skip leading whitespace before testing
	whether the line is empty.  Empty lines still contain the line
	terminator.

2002-01-15  Hrvoje Niksic  <[e-mail]>

	* gen_sslfunc.c (ssl_iread): Call select on the file descriptor
	only if no data is pending in SSL buffers.
	From [e-mail].

2002-01-14  Hrvoje Niksic  <[e-mail]>

	* headers.c (header_get): Strip trailing whitespace from the
	header.

2002-01-14  Hrvoje Niksic  <[e-mail]>

	* url.c (parse_uname): URL-decode *USER and *PASSWD.

2002-01-07  Ian Abbott <[e-mail]>

	* url.c (uri_merge_1): Deal with "net path" relative URL (one that
	starts with "//").

2002-01-14  Hrvoje Niksic  <[e-mail]>

	* http.c (gethttp): Invalidate SOCK if get_contents encountered an
	error.