X-Recipient:	archive-cygwin AT delorie DOT com
X-Spam-Check-By:	sourceware.org
Message-ID:	<BLU113-W110F1E9140C8D8C384E6AEBE6D0@phx.gbl>
From:	Mike Marchywka <marchywka AT hotmail DOT com>
To:	<cygwin AT cygwin DOT com>
Subject:	RE: Can't find how to fetch from the web
Date:	Fri, 15 Aug 2008 15:58:52 -0400
In-Reply-To:	<19003069.post@talk.nabble.com>
References:	<195047 DOT 70045 DOT qm AT web28316 DOT mail DOT ukl DOT yahoo DOT com> <19001016 DOT post AT talk DOT nabble DOT com> <BLU113-W53371437F645339068C0ABE6D0 AT phx DOT gbl> <19003069 DOT post AT talk DOT nabble DOT com>
MIME-Version:	1.0
X-IsSubscribed:	yes
Mailing-List:	contact cygwin-help AT cygwin DOT com; run by ezmlm
List-Id:	<cygwin.cygwin.com>
List-Unsubscribe:	<mailto:cygwin-unsubscribe-archive-cygwin=delorie DOT com AT cygwin DOT com>
List-Subscribe:	<mailto:cygwin-subscribe AT cygwin DOT com>
List-Archive:	<http://sourceware.org/ml/cygwin/>
List-Post:	<mailto:cygwin AT cygwin DOT com>
List-Help:	<mailto:cygwin-help AT cygwin DOT com>, <http://sourceware.org/ml/#faqs>
Sender:	cygwin-owner AT cygwin DOT com
Mail-Followup-To:	cygwin AT cygwin DOT com
Delivered-To:	mailing list cygwin AT cygwin DOT com
X-MIME-Autoconverted:	from quoted-printable to 8bit by delorie.com id m7FJxwSt001053

> Date: Fri, 15 Aug 2008 11:02:38 -0700
> From: garretlewis AT gmail DOT com
> To: cygwin AT cygwin DOT com
> Subject: RE: Can't find how to fetch from the web
>
>
> In my experience, I have never run into a URL that was too long. the only
> thing that I have had problems with in the past are, links timing out, or if
> it is ftp you sometimes must specify a username and password. You know now
> that I think about it some websites block the use of file retrievers, could
> that be the problem?


I'm not at my normal computer but IIRC this occurs when retrieving patents.
I have a bunch of scripts that need to extract stuff from html from document servers
that don't have an API. The patent script generates long URL's and bombs every few
hundred-to-thousand fetches IIRC. The few times I looked I thought the URL length was
suspect but I suppose it could be something related to my install ( previously noted to
have problems) or I'm not remembering it correctly. 

Since you were discussing it, I only brought it up to determine if there was a known problem
with any versions. I used to use lynx all the time then switched to wget if I don't need
parsing and now mostly use curl in new code.



>
>
> Mike Marchywka-2 wrote:
>>
>>
>> btw, is there a known problem with lynx that causes it to die when the url
>> is too long?
>> I don't have an example right now but I've noticed several times, and it
>> appears to be
>> with long urls, that lynx dies for no obvious reason. I use something like
>> lynx -dump -width 1200 url. I don't think this normally violates the
>> command line length constraint which I thought was
>> many k. Is there a server response that can provoke an abnormal
>> termination ( want to say
>> seg fault or access violation but can't remember)?
>>
>> Thanks.
>>
>>
>>
>>> Date: Fri, 15 Aug 2008 08:50:21 -0700
>>> From: garretlewis AT gmail DOT com
>>> To: cygwin AT cygwin DOT com
>>> Subject: Re: Can't find how to fetch from the web
>>>
>>>
>>> are you talking about using wget to download files or webpages?
>>>
>>> all you have to do is open the setup.exe and the new package you want is
>>> under WEB>>(select)wget
>>>
>>> then google wget to see how to use it... it pretty simple and a good way
>>> to
>>> get data or other things from the web.
>>>
>>> I hope this what you were going for.
>>>
>>> Garret
>>>
>>>
>>>
>>> defn noob wrote:
>>>>
>>>> Believe me I have googled and read the faqs but I can't find how to
>>>> download from the web.
>>>>
>>>> I have installed cygwin and it works but I think I need a package
>>>> although
>>>> web was default in my download.
>>>>
>>>> 1. how do I install packages once I already have installed cygwin?
>>>>
>>>> 2. what do I write do download from a specific internetadress.
>>>>
>>>> best regards cirfu
>>>>
>>>>
>>>>
>>>> __________________________________________________________
>>>> Ta semester! - sök efter resor hos Kelkoo.
>>>> Jämför pris på flygbiljetter och hotellrum här:
>>>> http://www.kelkoo.se/c-169901-resor-biljetter.html?partnerId=96914052
>>>>
>>>>
>>>> --
>>>> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
>>>> Problem reports: http://cygwin.com/problems.html
>>>> Documentation: http://cygwin.com/docs.html
>>>> FAQ: http://cygwin.com/faq/
>>>>
>>>>
>>>>
>>>
>>> --
>>> View this message in context:
>>> http://www.nabble.com/Can%27t-find-how-to-fetch-from-the-web-tp18920885p19001016.html
>>> Sent from the Cygwin list mailing list archive at Nabble.com.
>>>
>>>
>>> --
>>> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
>>> Problem reports: http://cygwin.com/problems.html
>>> Documentation: http://cygwin.com/docs.html
>>> FAQ: http://cygwin.com/faq/
>>>
>>
>> _________________________________________________________________
>> Get ideas on sharing photos from people like you. Find new ways to share.
>> http://www.windowslive.com/explore/photogallery/posts?ocid=TXT_TAGLM_WL_Photo_Gallery_082008
>>
>> --
>> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
>> Problem reports: http://cygwin.com/problems.html
>> Documentation: http://cygwin.com/docs.html
>> FAQ: http://cygwin.com/faq/
>>
>>
>>
>
> --
> View this message in context: http://www.nabble.com/Can%27t-find-how-to-fetch-from-the-web-tp18920885p19003069.html
> Sent from the Cygwin list mailing list archive at Nabble.com.
>
>
> --
> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
> Problem reports: http://cygwin.com/problems.html
> Documentation: http://cygwin.com/docs.html
> FAQ: http://cygwin.com/faq/
>

_________________________________________________________________
Be the filmmaker you always wanted to be—learn how to burn a DVD with Windows®.
http://clk.atdmt.com/MRT/go/108588797/direct/01/

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

- Raw text -