X-Recipient: archive-cygwin AT delorie DOT com
DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 6D02B3857353
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cygwin.com;
	s=default; t=1693316628;
	bh=oXoZO5wfXLKHNaCsQxfJpVWV78cmw5OPrz71+HMMqbg=;
	h=Date:Subject:To:References:In-Reply-To:List-Id:List-Unsubscribe:
	 List-Archive:List-Post:List-Help:List-Subscribe:From:Reply-To:
	 From;
	b=qUrMbJdvSWaRVlHt+dQ5cRglgctbhHn0twr5bZbeOO1IK7tpHu+z0t71HuJkDTQDc
	 bahmevItPTVzuQUSEiLb60wquW3fMp44h32hefgJcNFa+wzMma8JBdtJoTjnOOqHEC
	 7Ohe+csK4I4DM3aG1GwlAlg95WUZA8a/lPqP1Bns=
X-Original-To: cygwin AT cygwin DOT com
Delivered-To: cygwin AT cygwin DOT com
DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 9DF673856DC0
X-ASG-Debug-ID: 1693316611-24039d7c1760fe70001-w5GHUG
X-Barracuda-Envelope-From: moss AT cs DOT umass DOT edu
X-Barracuda-RBL-Trusted-Forwarder: 128.119.240.136
Message-ID: <b99a98ee-bc82-e930-b8ea-56776af062d0@cs.umass.edu>
X-Barracuda-RBL-Trusted-Forwarder: 192.168.50.148
Date: Tue, 29 Aug 2023 09:43:30 -0400
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Thunderbird/102.14.0
Subject: Re: Faster rsync?
Content-Language: en-US
X-ASG-Orig-Subj: Re: Faster rsync?
To: Mario Emmenlauer <mario AT emmenlauer DOT de>,
        Adam Kessel
 <adam AT rosi-kessel DOT org>, cygwin AT cygwin DOT com
References: <65367e55-57ab-22ec-d651-85ec5afe0416 AT rosi-kessel DOT org>
 <4a3ca0f6-128e-adb7-0140-cacb20f06544 AT emmenlauer DOT de>
In-Reply-To: <4a3ca0f6-128e-adb7-0140-cacb20f06544@emmenlauer.de>
X-Barracuda-Connect: mailsrv.cs.umass.edu[128.119.240.136]
X-Barracuda-Start-Time: 1693316611
X-Barracuda-Encrypted: ECDHE-RSA-AES128-GCM-SHA256
X-Barracuda-URL: https://barramail.cs.umass.edu:443/cgi-mod/mark.cgi
X-Barracuda-BRTS-Status: 1
X-Virus-Scanned: by bsmtpd at cs.umass.edu
X-Barracuda-Scan-Msg-Size: 1512
X-Barracuda-Spam-Score: 0.00
X-Barracuda-Spam-Status: No, SCORE=0.00 using global scores of TAG_LEVEL=1000.0
 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=5.7 tests=
X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.113393
 Rule breakdown below
 pts rule name              description
 ---- ---------------------- --------------------------------------------------
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00, JMQ_SPF_NEUTRAL,
 KAM_DMARC_STATUS, NICE_REPLY_A, SPF_HELO_NONE, SPF_PASS,
 TXREP autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
 server2.sourceware.org
X-BeenThere: cygwin AT cygwin DOT com
X-Mailman-Version: 2.1.30
List-Id: General Cygwin discussions and problem reports <cygwin.cygwin.com>
List-Archive: <https://cygwin.com/pipermail/cygwin/>
List-Post: <mailto:cygwin AT cygwin DOT com>
List-Help: <mailto:cygwin-request AT cygwin DOT com?subject=help>
List-Subscribe: <https://cygwin.com/mailman/listinfo/cygwin>,
 <mailto:cygwin-request AT cygwin DOT com?subject=subscribe>
From: Eliot Moss via Cygwin <cygwin AT cygwin DOT com>
Reply-To: moss AT cs DOT umass DOT edu
Content-Type: text/plain; charset="utf-8"; Format="flowed"
Sender: "Cygwin" <cygwin-bounces+archive-cygwin=delorie DOT com AT cygwin DOT com>
Content-Transfer-Encoding: 8bit
X-MIME-Autoconverted: from base64 to 8bit by delorie.com id 37TDhnMI025408

On 8/29/2023 9:17 AM, Mario Emmenlauer via Cygwin wrote:
> On 29.08.23 14:32, Adam Kessel via Cygwin wrote:
>> I've found rsync to be painfully slow on large folders -- hours to sync thousands of files, even 
>> when they already match size and --size-only is used. It's much faster between native Linux boxes.

I've been told (on this list) that how you mount the Windows drive in Cygwin matters.

I use this in my /etc/fstab:

d:/ /cygdrive/d ntfs binary,posix=0,user,auto,notexec 0 0

Unfortunately, it's still not as quick as I think it ought to be.
(If someone out there can recommend better settings, I'm open!)

I regularly rsync a collection of hundreds of files, each about 2Gb in size.

Windows describes the partition as an NTFS Basic Data Partition.  It takes
rsync a long time to get started (i.e., to figure out which files need
transferring).

My rsync uses these flags:

rsync -avuP --partial --partial-dir=.rsync-partial --log-file=... --log-file-format=...

> I've been using rsync, unison and similar tools on Windows and Linux since basically forever. In my 
> humble opinion, the problem is the Windows file system performance, not the synchronization tools. 
> As a separate example, try to download the boost source code, and extract the archive. I can do the 
> extraction in way under a minute on Linux, but have to wait many many minutes on a similarly 
> equipped Windows machine.
> 
> Just my two cents.
> 
>      Mario
> 

Regards - Eliot Moss

-- 
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple