X-Recipient: archive-cygwin AT delorie DOT com
DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 6DE863857C71
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cygwin.com;
	s=default; t=1693331771;
	bh=MvVo4c9AtaB758Bc/zJY7v7uhn9DGaeBzOEez0XGwVA=;
	h=Date:Subject:To:References:In-Reply-To:List-Id:List-Unsubscribe:
	 List-Archive:List-Post:List-Help:List-Subscribe:From:Reply-To:
	 From;
	b=vlzxOXKRNVjRUHb3Iy9FEYJTxPgXr/F/PJUHON8zbELJM4J0VDPP8eYHk8S6Djo3I
	 QX66w4Kh+wjN6nuBzkaTF4+vilkMludctHrr8vTOMiGEVLoP8QERRc2/0QeIke0h3i
	 l3NUWJnQ16jN8r1T9fpgvd19CWrVvcL9FaciPqWs=
X-Original-To: cygwin AT cygwin DOT com
Delivered-To: cygwin AT cygwin DOT com
DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org E08B33858D20
X-ASG-Debug-ID: 1693331727-24039d7c17637120001-w5GHUG
X-Barracuda-Envelope-From: moss AT cs DOT umass DOT edu
X-Barracuda-RBL-Trusted-Forwarder: 128.119.240.136
Message-ID: <e40bc726-b44d-22dd-2de9-4fecdde8c7c7@cs.umass.edu>
X-Barracuda-RBL-Trusted-Forwarder: 192.168.50.148
Date: Tue, 29 Aug 2023 13:55:27 -0400
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Thunderbird/102.14.0
Subject: Re: Faster rsync?
Content-Language: en-US
X-ASG-Orig-Subj: Re: Faster rsync?
To: Mario Emmenlauer <mario AT emmenlauer DOT de>,
        Adam Kessel
 <adam AT rosi-kessel DOT org>, cygwin AT cygwin DOT com
References: <65367e55-57ab-22ec-d651-85ec5afe0416 AT rosi-kessel DOT org>
 <4a3ca0f6-128e-adb7-0140-cacb20f06544 AT emmenlauer DOT de>
 <b99a98ee-bc82-e930-b8ea-56776af062d0 AT cs DOT umass DOT edu>
In-Reply-To: <b99a98ee-bc82-e930-b8ea-56776af062d0@cs.umass.edu>
X-Barracuda-Connect: mailsrv.cs.umass.edu[128.119.240.136]
X-Barracuda-Start-Time: 1693331727
X-Barracuda-Encrypted: ECDHE-RSA-AES128-GCM-SHA256
X-Barracuda-URL: https://barramail.cs.umass.edu:443/cgi-mod/mark.cgi
X-Virus-Scanned: by bsmtpd at cs.umass.edu
X-Barracuda-Scan-Msg-Size: 1239
X-Barracuda-BRTS-Status: 1
X-Barracuda-Spam-Score: 0.00
X-Barracuda-Spam-Status: No, SCORE=0.00 using global scores of TAG_LEVEL=1000.0
 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=5.7 tests=
X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.113401
 Rule breakdown below
 pts rule name              description
 ---- ---------------------- --------------------------------------------------
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00, JMQ_SPF_NEUTRAL,
 KAM_DMARC_STATUS, NICE_REPLY_A, SPF_HELO_NONE, SPF_PASS,
 TXREP autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
 server2.sourceware.org
X-BeenThere: cygwin AT cygwin DOT com
X-Mailman-Version: 2.1.30
List-Id: General Cygwin discussions and problem reports <cygwin.cygwin.com>
List-Archive: <https://cygwin.com/pipermail/cygwin/>
List-Post: <mailto:cygwin AT cygwin DOT com>
List-Help: <mailto:cygwin-request AT cygwin DOT com?subject=help>
List-Subscribe: <https://cygwin.com/mailman/listinfo/cygwin>,
 <mailto:cygwin-request AT cygwin DOT com?subject=subscribe>
From: Eliot Moss via Cygwin <cygwin AT cygwin DOT com>
Reply-To: moss AT cs DOT umass DOT edu
Content-Type: text/plain; charset="utf-8"; Format="flowed"
Sender: "Cygwin" <cygwin-bounces+archive-cygwin=delorie DOT com AT cygwin DOT com>
Content-Transfer-Encoding: 8bit
X-MIME-Autoconverted: from base64 to 8bit by delorie.com id 37THuDXG012652

On 8/29/2023 9:43 AM, Eliot Moss wrote:
> On 8/29/2023 9:17 AM, Mario Emmenlauer via Cygwin wrote:
>> On 29.08.23 14:32, Adam Kessel via Cygwin wrote:
>>> I've found rsync to be painfully slow on large folders -- hours to sync thousands of files, even 
>>> when they already match size and --size-only is used. It's much faster between native Linux boxes.
> 
> I've been told (on this list) that how you mount the Windows drive in Cygwin matters.
> 
> I use this in my /etc/fstab:
> 
> d:/ /cygdrive/d ntfs binary,posix=0,user,auto,notexec 0 0
> 
> Unfortunately, it's still not as quick as I think it ought to be.
> (If someone out there can recommend better settings, I'm open!)
> 
> I regularly rsync a collection of hundreds of files, each about 2Gb in size.
> 
> Windows describes the partition as an NTFS Basic Data Partition.  It takes
> rsync a long time to get started (i.e., to figure out which files need
> transferring).
> 
> My rsync uses these flags:
> 
> rsync -avuP --partial --partial-dir=.rsync-partial --log-file=... --log-file-format=...

These flags seems to give speedy directory scanning:

rsync -r --chmod=D2700,F600 -t -z -p -v --size-only --partial-dir=.rsync-partial

Regards - EM

-- 
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple