Date: Mon, 24 Feb 1997 19:19:47 +0200 (IST) From: Eli Zaretskii To: Ian Miller cc: djgpp AT delorie DOT com Subject: Re: Win32 development question In-Reply-To: Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII On 24 Feb 1997, Ian Miller wrote: > Hmmm. Both wsftp and servu are for Windows and I run UNIX at work. Why didn't you say so in the first place? For Unix, check out the GNU wget program, I think it's exactly what you are looking for, see below. It is available from the GNU FTP site: ftp://ftp.gnu.ai.mit.edu/pub/gnu/wget-1.4.3.tar.gz The contents of (most of) the wget README file follows: -*- text -*- GNU Wget README GNU Wget is a freely available network utility to retrieve files from the World Wide Web using HTTP and FTP, the two most widely used Internet protocols. It works non-interactively, thus enabling work in the background, after having logged off. The recursive retrieval of HTML pages, as well as FTP sites is supported -- you can use Wget to make mirrors of archives and home pages, or traverse the web like a WWW robot (Wget understands /robots.txt). Wget works exceedingly well on slow or unstable connections, keeping getting the document until it is fully retrieved. Re-getting files from where it left off works on servers (both HTTP and FTP) that support it. Matching of wildcards and recursive mirroring of directories are available when retrieving via FTP. Both HTTP and FTP retrievals can be time-stamped, thus Wget can see if the remote file has changed since last retrieval and automatically retrieve the new version if it has. By default, Wget supports proxy servers, which can lighten the network load, speed up retrieval and provide access behind firewalls. However, if you are behind a firewall that requires that you use a socks style gateway, you can get the socks library and compile wget with support for socks. Most of the features are configurable, either through command-line options, or via initialization file .wgetrc. Wget allows you to install a global startup file (/usr/local/lib/wgetrc by default) for site settings. Wget works under almost all modern Unix variants and, unlike many other similar utilities, is written entirely in C, thus requiring no additional software (like perl). As Wget uses the GNU Autoconf, it is easily built on and ported to other Unix's. Installation procedure is described in the INSTALL file. Like all GNU utilities, the latest version of Wget can be found at the master GNU archive site prep.ai.mit.edu, and its mirrors. For example, Wget 1.4.3 is at: . The latest version is also available via FTP from the maintainer's machine, at: . This location is mirrored at: and . Wget has its own mailing list at . To subscribe, Mail to with the word `subscribe' in the subject. Wget is free; no payment is required. If you still wish to donate money to the author of Wget, write to my address . AUTHOR: Hrvoje Niksic The program is being regularly tested on Solaris 2.5, Linux, Ultrix, OSF, SunOS 4.x, but also on other U*x-es from time to time by other people.