X-Recipient: archive-cygwin AT delorie DOT com X-Spam-Check-By: sourceware.org Message-ID: From: Mike Marchywka To: Subject: RE: Can't find how to fetch from the web Date: Fri, 15 Aug 2008 15:58:52 -0400 In-Reply-To: <19003069.post@talk.nabble.com> References: <195047 DOT 70045 DOT qm AT web28316 DOT mail DOT ukl DOT yahoo DOT com> <19001016 DOT post AT talk DOT nabble DOT com> <19003069 DOT post AT talk DOT nabble DOT com> Content-Type: text/plain; charset="Windows-1252" MIME-Version: 1.0 X-IsSubscribed: yes Mailing-List: contact cygwin-help AT cygwin DOT com; run by ezmlm Precedence: bulk List-Id: List-Unsubscribe: List-Subscribe: List-Archive: List-Post: List-Help: , Sender: cygwin-owner AT cygwin DOT com Mail-Followup-To: cygwin AT cygwin DOT com Delivered-To: mailing list cygwin AT cygwin DOT com Content-Transfer-Encoding: 8bit X-MIME-Autoconverted: from quoted-printable to 8bit by delorie.com id m7FJxwSt001053 > Date: Fri, 15 Aug 2008 11:02:38 -0700 > From: garretlewis AT gmail DOT com > To: cygwin AT cygwin DOT com > Subject: RE: Can't find how to fetch from the web > > > In my experience, I have never run into a URL that was too long. the only > thing that I have had problems with in the past are, links timing out, or if > it is ftp you sometimes must specify a username and password. You know now > that I think about it some websites block the use of file retrievers, could > that be the problem? I'm not at my normal computer but IIRC this occurs when retrieving patents. I have a bunch of scripts that need to extract stuff from html from document servers that don't have an API. The patent script generates long URL's and bombs every few hundred-to-thousand fetches IIRC. The few times I looked I thought the URL length was suspect but I suppose it could be something related to my install ( previously noted to have problems) or I'm not remembering it correctly. Since you were discussing it, I only brought it up to determine if there was a known problem with any versions. I used to use lynx all the time then switched to wget if I don't need parsing and now mostly use curl in new code. > > > Mike Marchywka-2 wrote: >> >> >> btw, is there a known problem with lynx that causes it to die when the url >> is too long? >> I don't have an example right now but I've noticed several times, and it >> appears to be >> with long urls, that lynx dies for no obvious reason. I use something like >> lynx -dump -width 1200 url. I don't think this normally violates the >> command line length constraint which I thought was >> many k. Is there a server response that can provoke an abnormal >> termination ( want to say >> seg fault or access violation but can't remember)? >> >> Thanks. >> >> >> >>> Date: Fri, 15 Aug 2008 08:50:21 -0700 >>> From: garretlewis AT gmail DOT com >>> To: cygwin AT cygwin DOT com >>> Subject: Re: Can't find how to fetch from the web >>> >>> >>> are you talking about using wget to download files or webpages? >>> >>> all you have to do is open the setup.exe and the new package you want is >>> under WEB>>(select)wget >>> >>> then google wget to see how to use it... it pretty simple and a good way >>> to >>> get data or other things from the web. >>> >>> I hope this what you were going for. >>> >>> Garret >>> >>> >>> >>> defn noob wrote: >>>> >>>> Believe me I have googled and read the faqs but I can't find how to >>>> download from the web. >>>> >>>> I have installed cygwin and it works but I think I need a package >>>> although >>>> web was default in my download. >>>> >>>> 1. how do I install packages once I already have installed cygwin? >>>> >>>> 2. what do I write do download from a specific internetadress. >>>> >>>> best regards cirfu >>>> >>>> >>>> >>>> __________________________________________________________ >>>> Ta semester! - sök efter resor hos Kelkoo. >>>> Jämför pris på flygbiljetter och hotellrum här: >>>> http://www.kelkoo.se/c-169901-resor-biljetter.html?partnerId=96914052 >>>> >>>> >>>> -- >>>> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple >>>> Problem reports: http://cygwin.com/problems.html >>>> Documentation: http://cygwin.com/docs.html >>>> FAQ: http://cygwin.com/faq/ >>>> >>>> >>>> >>> >>> -- >>> View this message in context: >>> http://www.nabble.com/Can%27t-find-how-to-fetch-from-the-web-tp18920885p19001016.html >>> Sent from the Cygwin list mailing list archive at Nabble.com. >>> >>> >>> -- >>> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple >>> Problem reports: http://cygwin.com/problems.html >>> Documentation: http://cygwin.com/docs.html >>> FAQ: http://cygwin.com/faq/ >>> >> >> _________________________________________________________________ >> Get ideas on sharing photos from people like you. Find new ways to share. >> http://www.windowslive.com/explore/photogallery/posts?ocid=TXT_TAGLM_WL_Photo_Gallery_082008 >> >> -- >> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple >> Problem reports: http://cygwin.com/problems.html >> Documentation: http://cygwin.com/docs.html >> FAQ: http://cygwin.com/faq/ >> >> >> > > -- > View this message in context: http://www.nabble.com/Can%27t-find-how-to-fetch-from-the-web-tp18920885p19003069.html > Sent from the Cygwin list mailing list archive at Nabble.com. > > > -- > Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple > Problem reports: http://cygwin.com/problems.html > Documentation: http://cygwin.com/docs.html > FAQ: http://cygwin.com/faq/ > _________________________________________________________________ Be the filmmaker you always wanted to be—learn how to burn a DVD with Windows®. http://clk.atdmt.com/MRT/go/108588797/direct/01/ -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/