delorie.com/archives/browse.cgi   search  
Mail Archives: cygwin/2004/01/01/14:39:01

Mailing-List: contact cygwin-help AT cygwin DOT com; run by ezmlm
List-Subscribe: <mailto:cygwin-subscribe AT cygwin DOT com>
List-Archive: <http://sources.redhat.com/ml/cygwin/>
List-Post: <mailto:cygwin AT cygwin DOT com>
List-Help: <mailto:cygwin-help AT cygwin DOT com>, <http://sources.redhat.com/ml/#faqs>
Sender: cygwin-owner AT cygwin DOT com
Mail-Followup-To: cygwin AT cygwin DOT com
Delivered-To: mailing list cygwin AT cygwin DOT com
Message-ID: <3FF47733.9040807@hack.kampbjorn.com>
Date: Thu, 01 Jan 2004 20:38:27 +0100
From: Hack Kampbjorn <cygwin AT hack DOT kampbjorn DOT com>
Reply-To: cygwin AT cygwin DOT com
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.5) Gecko/20031007
MIME-Version: 1.0
To: cygwin AT cygwin DOT com
Subject: Re: wget, continued download
References: <004901c3cfc6$ede09ae0$62a804d5 AT d5o2l2>
In-Reply-To: <004901c3cfc6$ede09ae0$62a804d5@d5o2l2>
X-IsSubscribed: yes

doblejota wrote:
> Hi,
> 
> I'm trying to get a section of a web page using wget. I edit a previous page
> source just leaving an initial section. Then, I execute

wget is a good tool for downloading full websites. A good enough tool for 
download one URL (but there are better ones for this, e.g. curl). But it has no 
  support for download only a part of a URL. It is possible if you know wget and 
HTTP.
> 
>   wget -c url
> 
> I obtain
> 
>   Continued download failed on this file, which conflicts with `-c'.
>   Refusing to truncate existing file 'name.ext'. (Name of file I've edited).
> 
> The program obtains the page size before crash, bigger than modified file,
> so why does it try to truncate the file?

When reporting problems with wget please use the --debug option and include the
full output. If the webserver does not support resuming donwload wget would start
over. wget did not crash, it stopped when the options you had given it 
conflicted: truncate the file don't truncate the file.
> 
> I've tried to apply -N option, no change. Also I've used -O option; the file
> is whole downloaded, I just want the last section.

Then throw the first part away. If that's too wastefull you'll need to find a 
better tool.
> 
> Do you know a command-line application witch uses HTTP Range request in that
> way?
> 
> By the way, if I want to stop download after the application receives an
> specific word from server, how can I do it? I expected it is posible using a
> pipe that analize wget output, but how?

No, wget will try to download the full HTTP response unless you kill it.

I would use perl and Net::HTTP for this. But then I'm familiar with both.

> Note Cygwin pipes (DOS) features.

DOS features? What DOS features?
> 
> Thanks to everybody.


-- 
Med venlig hilsen / Kind regards

Hack Kampbjørn


--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

- Raw text -


  webmaster     delorie software   privacy  
  Copyright © 2019   by DJ Delorie     Updated Jul 2019