delorie.com/archives/browse.cgi   search  
Mail Archives: cygwin/2007/08/13/14:02:03

X-Spam-Check-By: sourceware.org
Date: Mon, 13 Aug 2007 14:01:34 -0400
From: Christopher Faylor <cgf-use-the-mailinglist-please AT cygwin DOT com>
To: cygwin AT cygwin DOT com
Subject: Re: Rsync and the two latest snapshots
Message-ID: <20070813180134.GA15857@ednor.casa.cgf.cx>
Reply-To: cygwin AT cygwin DOT com
Mail-Followup-To: cygwin AT cygwin DOT com
References: <f99s1q$1ro$1 AT sea DOT gmane DOT org> <20070809095039 DOT GE28646 AT calimero DOT vinschen DOT de> <f9fm40$qrb$1 AT sea DOT gmane DOT org> <20070810113045 DOT GJ8535 AT calimero DOT vinschen DOT de> <f9hoc2$i21$1 AT sea DOT gmane DOT org> <20070810133327 DOT GM8535 AT calimero DOT vinschen DOT de> <20070813151239 DOT GA24215 AT calimero DOT vinschen DOT de> <f9q3s6$obu$2 AT sea DOT gmane DOT org>
MIME-Version: 1.0
In-Reply-To: <f9q3s6$obu$2@sea.gmane.org>
User-Agent: Mutt/1.5.15 (2007-04-06)
Mailing-List: contact cygwin-help AT cygwin DOT com; run by ezmlm
List-Id: <cygwin.cygwin.com>
List-Unsubscribe: <mailto:cygwin-unsubscribe-archive-cygwin=delorie DOT com AT cygwin DOT com>
List-Subscribe: <mailto:cygwin-subscribe AT cygwin DOT com>
List-Archive: <http://sourceware.org/ml/cygwin/>
List-Post: <mailto:cygwin AT cygwin DOT com>
List-Help: <mailto:cygwin-help AT cygwin DOT com>, <http://sourceware.org/ml/#faqs>
Sender: cygwin-owner AT cygwin DOT com
Mail-Followup-To: cygwin AT cygwin DOT com
Delivered-To: mailing list cygwin AT cygwin DOT com

On Mon, Aug 13, 2007 at 06:20:05PM +0100, Thorsten Kampe wrote:
>* Corinna Vinschen (Mon, 13 Aug 2007 17:12:39 +0200)
>> On Aug 10 15:33, Corinna Vinschen wrote:
>> > On Aug 10 14:14, Thorsten Kampe wrote:
>> > > * Corinna Vinschen (Fri, 10 Aug 2007 13:30:45 +0200)
>> > > > On Aug  9 19:23, Thorsten Kampe wrote:
>> > > > > rsync: recv_generator: failed to stat "/cygdrive/j/thorsten/backup/usb/data/in
>> > > > > stall/thebat/imap/IMAP-Einstellungen und Erkl\#344rung der verschiedenen Punkt
>> > > > > e/atb_team.gif": Bad address (14)                                             
>> > > > 
>> > > > Erm... you didn't tell about this "Bad address" error.
>> > > 
>> > > These are just German Umlauts and in my opinion not connected to the "too many open files" errors.
>> > 
>> > "Bad address" is a serious error message (accessing an invalid memory
>> > address) and, even *if* they are due to the german umlauts, it's probably
>> > worth to find out what's causing it.
>> > 
>> > > > > rsync: recv_generator: mkdir "/cygdrive/j/thorsten/backup/usb/data/install/usb
>> > > > > 2" failed: Too many open files (24)                                           
>> Ok, I'm almost sure I found the cause of the problem.  Due to an unlucky
>> combination of function calls, my new code filled up the internal heap
>> of the DLL without ever freeing the mmeory again, for each file access.
>> Since the internal heap is rather big by default, you only encounter this
>> problem for long running processes accessing lots of files.
>> 
>> I've checked in a patch.  Please give the next developer snapshot
>> another try.
>
>Yes, it's fixed now, thanks. You've also done some magic because the 
>whole rsync file transfer runs about 2 - 6 times faster than it used 
>to. It's amazing.

Does rsync use pipes by any chance?  If so, that may be at least part of the reason
since that code has been revamped.

cgf

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

- Raw text -


  webmaster     delorie software   privacy  
  Copyright © 2019   by DJ Delorie     Updated Jul 2019