X-Recipient:	archive-cygwin AT delorie DOT com
DKIM-Filter:	OpenDKIM Filter v2.11.0 sourceware.org 6D02B3857353
DKIM-Signature:	v=1; a=rsa-sha256; c=relaxed/relaxed; d=cygwin.com;
	s=default; t=1693316628;
	bh=oXoZO5wfXLKHNaCsQxfJpVWV78cmw5OPrz71+HMMqbg=;
	h=Date:Subject:To:References:In-Reply-To:List-Id:List-Unsubscribe:
	List-Archive:List-Post:List-Help:List-Subscribe:From:Reply-To:
	From;
	b=qUrMbJdvSWaRVlHt+dQ5cRglgctbhHn0twr5bZbeOO1IK7tpHu+z0t71HuJkDTQDc
	bahmevItPTVzuQUSEiLb60wquW3fMp44h32hefgJcNFa+wzMma8JBdtJoTjnOOqHEC
	7Ohe+csK4I4DM3aG1GwlAlg95WUZA8a/lPqP1Bns=
X-Original-To:	cygwin AT cygwin DOT com
Delivered-To:	cygwin AT cygwin DOT com
DMARC-Filter:	OpenDMARC Filter v1.4.2 sourceware.org 9DF673856DC0
X-ASG-Debug-ID:	1693316611-24039d7c1760fe70001-w5GHUG
X-Barracuda-Envelope-From:	moss AT cs DOT umass DOT edu
X-Barracuda-RBL-Trusted-Forwarder:	128.119.240.136
Message-ID:	<b99a98ee-bc82-e930-b8ea-56776af062d0@cs.umass.edu>
X-Barracuda-RBL-Trusted-Forwarder:	192.168.50.148
Date:	Tue, 29 Aug 2023 09:43:30 -0400
MIME-Version:	1.0
User-Agent:	Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
	Thunderbird/102.14.0
Subject:	Re: Faster rsync?
X-ASG-Orig-Subj:	Re: Faster rsync?
To:	Mario Emmenlauer <mario AT emmenlauer DOT de>,
	Adam Kessel
	<adam AT rosi-kessel DOT org>, cygwin AT cygwin DOT com
References:	<65367e55-57ab-22ec-d651-85ec5afe0416 AT rosi-kessel DOT org>
	<4a3ca0f6-128e-adb7-0140-cacb20f06544 AT emmenlauer DOT de>
In-Reply-To:	<4a3ca0f6-128e-adb7-0140-cacb20f06544@emmenlauer.de>
X-Barracuda-Connect:	mailsrv.cs.umass.edu[128.119.240.136]
X-Barracuda-Start-Time:	1693316611
X-Barracuda-Encrypted:	ECDHE-RSA-AES128-GCM-SHA256
X-Barracuda-URL:	https://barramail.cs.umass.edu:443/cgi-mod/mark.cgi
X-Barracuda-BRTS-Status:	1
X-Virus-Scanned:	by bsmtpd at cs.umass.edu
X-Barracuda-Scan-Msg-Size:	1512
X-Barracuda-Spam-Score:	0.00
X-Barracuda-Spam-Status:	No, SCORE=0.00 using global scores of TAG_LEVEL=1000.0
	QUARANTINE_LEVEL=1000.0 KILL_LEVEL=5.7 tests=
X-Barracuda-Spam-Report:	Code version 3.2, rules version 3.2.3.113393
	Rule breakdown below
	pts rule name description
	---- ---------------------- --------------------------------------------------
X-Spam-Status:	No, score=-2.6 required=5.0 tests=BAYES_00, JMQ_SPF_NEUTRAL,
	KAM_DMARC_STATUS, NICE_REPLY_A, SPF_HELO_NONE, SPF_PASS,
	TXREP autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version:	SpamAssassin 3.4.6 (2021-04-09) on
	server2.sourceware.org
X-BeenThere:	cygwin AT cygwin DOT com
X-Mailman-Version:	2.1.30
List-Id:	General Cygwin discussions and problem reports <cygwin.cygwin.com>
List-Archive:	<https://cygwin.com/pipermail/cygwin/>
List-Post:	<mailto:cygwin AT cygwin DOT com>
List-Help:	<mailto:cygwin-request AT cygwin DOT com?subject=help>
List-Subscribe:	<https://cygwin.com/mailman/listinfo/cygwin>,
	<mailto:cygwin-request AT cygwin DOT com?subject=subscribe>
From:	Eliot Moss via Cygwin <cygwin AT cygwin DOT com>
Reply-To:	moss AT cs DOT umass DOT edu
Sender:	"Cygwin" <cygwin-bounces+archive-cygwin=delorie DOT com AT cygwin DOT com>
X-MIME-Autoconverted:	from base64 to 8bit by delorie.com id 37TDhnMI025408

On 8/29/2023 9:17 AM, Mario Emmenlauer via Cygwin wrote:
> On 29.08.23 14:32, Adam Kessel via Cygwin wrote:
>> I've found rsync to be painfully slow on large folders -- hours to sync thousands of files, even 
>> when they already match size and --size-only is used. It's much faster between native Linux boxes.

I've been told (on this list) that how you mount the Windows drive in Cygwin matters.

I use this in my /etc/fstab:

d:/ /cygdrive/d ntfs binary,posix=0,user,auto,notexec 0 0

Unfortunately, it's still not as quick as I think it ought to be.
(If someone out there can recommend better settings, I'm open!)

I regularly rsync a collection of hundreds of files, each about 2Gb in size.

Windows describes the partition as an NTFS Basic Data Partition.  It takes
rsync a long time to get started (i.e., to figure out which files need
transferring).

My rsync uses these flags:

rsync -avuP --partial --partial-dir=.rsync-partial --log-file=... --log-file-format=...

> I've been using rsync, unison and similar tools on Windows and Linux since basically forever. In my 
> humble opinion, the problem is the Windows file system performance, not the synchronization tools. 
> As a separate example, try to download the boost source code, and extract the archive. I can do the 
> extraction in way under a minute on Linux, but have to wait many many minutes on a similarly 
> equipped Windows machine.
> 
> Just my two cents.
> 
>      Mario
> 

Regards - Eliot Moss

-- 
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple

- Raw text -