Mail Archives: djgpp/1997/02/24/12:31:27
On 24 Feb 1997, Ian Miller wrote:
> Hmmm. Both wsftp and servu are for Windows and I run UNIX at work.
Why didn't you say so in the first place? For Unix, check out the GNU
wget program, I think it's exactly what you are looking for, see below.
It is available from the GNU FTP site:
ftp://ftp.gnu.ai.mit.edu/pub/gnu/wget-1.4.3.tar.gz
The contents of (most of) the wget README file follows:
-*- text -*-
GNU Wget README
GNU Wget is a freely available network utility to retrieve files from
the World Wide Web using HTTP and FTP, the two most widely used
Internet protocols. It works non-interactively, thus enabling work in
the background, after having logged off.
The recursive retrieval of HTML pages, as well as FTP sites is
supported -- you can use Wget to make mirrors of archives and home
pages, or traverse the web like a WWW robot (Wget understands
/robots.txt).
Wget works exceedingly well on slow or unstable connections, keeping
getting the document until it is fully retrieved. Re-getting files
from where it left off works on servers (both HTTP and FTP) that
support it. Matching of wildcards and recursive mirroring of
directories are available when retrieving via FTP. Both HTTP and FTP
retrievals can be time-stamped, thus Wget can see if the remote file
has changed since last retrieval and automatically retrieve the new
version if it has.
By default, Wget supports proxy servers, which can lighten the network
load, speed up retrieval and provide access behind firewalls. However,
if you are behind a firewall that requires that you use a socks style
gateway, you can get the socks library and compile wget with support
for socks.
Most of the features are configurable, either through command-line
options, or via initialization file .wgetrc. Wget allows you to
install a global startup file (/usr/local/lib/wgetrc by default) for
site settings.
Wget works under almost all modern Unix variants and, unlike many
other similar utilities, is written entirely in C, thus requiring no
additional software (like perl). As Wget uses the GNU Autoconf, it is
easily built on and ported to other Unix's. Installation procedure is
described in the INSTALL file.
Like all GNU utilities, the latest version of Wget can be found at the
master GNU archive site prep.ai.mit.edu, and its mirrors. For
example, Wget 1.4.3 is at:
<URL:ftp://prep.ai.mit.edu/pub/gnu/wget-1.4.3.tar.gz>.
The latest version is also available via FTP from the maintainer's
machine, at:
<URL:ftp://gnjilux.cc.fer.hr/pub/unix/util/wget/wget.tar.gz>.
This location is mirrored at:
<URL:ftp://sunsite.auc.dk/pub/infosystems/wget/> and
<URL:http://sunsite.auc.dk/ftp/pub/infosystems/wget/>.
Wget has its own mailing list at <wget AT sunsite DOT auc DOT dk>. To subscribe,
Mail to <wget-request AT sunsite DOT auc DOT dk> with the word `subscribe' in the
subject.
Wget is free; no payment is required. If you still wish to donate
money to the author of Wget, write to my address <hniksic AT srce DOT hr>.
AUTHOR: Hrvoje Niksic <URL:mailto:hniksic AT srce DOT hr>
The program is being regularly tested on Solaris 2.5, Linux, Ultrix,
OSF, SunOS 4.x, but also on other U*x-es from time to time by other
people.
- Raw text -