delorie.com/archives/browse.cgi   search  
Mail Archives: cygwin/2022/01/31/10:14:14

X-Recipient: archive-cygwin AT delorie DOT com
X-Original-To: cygwin AT cygwin DOT com
Delivered-To: cygwin AT cygwin DOT com
DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org C04E03857811
Authentication-Results: sourceware.org;
dmarc=pass (p=none dis=none) header.from=gmail.com
Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=gmail.com
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112;
h=message-id:date:mime-version:user-agent:subject:content-language:to
:newsgroups:references:from:in-reply-to:content-transfer-encoding;
bh=kcZXUKkVPX/NKlbfkzb+fJBPNeuD+PxGN0sjj3r31+o=;
b=hNOTk9+AwMIpxelp6G5uLoS7G7nboW5DYD0rra3SxeiCRKtGFZQbMgHTDuEQ4tKLGY
Fi4QJnZhetJjsikW+QOmVnu5NSe/X9t7IHqFbWvkgPYmeelV7IefErFTom9SZfNQq9ub
OP+XVyQ2HzRekD+bObj5r6CQPioCHbgk+q9SF18x7si3Ke1S0gSC4YQ7qS56BcpZaF5v
v8HFsbIC/MPrSdguT8fkR2D3b05hfGt0W69/CislvN+9EzmYArQIM5M7owIodP+z7I7t
Ed/6Cc0WWnaNYsoTU3jOV3dx6Md7bxZLkddAbo7c+YblCi9D3rXg7IIPdCfVWOqvZHrn
et9g==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20210112;
h=x-gm-message-state:message-id:date:mime-version:user-agent:subject
:content-language:to:newsgroups:references:from:in-reply-to
:content-transfer-encoding;
bh=kcZXUKkVPX/NKlbfkzb+fJBPNeuD+PxGN0sjj3r31+o=;
b=c6vKX5cwLGusqoL6t+MyDg2jnVO9R6+q3EVVjt7je2qXQWZNl0tj4HbflAy0e0vcI6
ckVadtW2Pj4yUDh8Y+hrjeFZluotAFnqTik6IE1hyBCzYuA6Ha1jLNpeRcshjWHEdgR+
qRqQf+qs6nK+LnCXUcckE5NYq1ydp9GQuRll2oMS0LxeEB3MqN81KqBTYx47kTmIEkEC
Z8InYlG45KoCRX1j2ecErSY3aVaRemXHSAs0k7lXzYgKCMQIKVzLte0I4098aA91l33r
VRUowvJBoBDYaOPXpvvHKuVVX5JXFeUdjF1xCRtoZtt+DdM7PPlq6r60feRjt9Md0wUJ
exng==
X-Gm-Message-State: AOAM531vu6PwzrvaA3oGzX+5H9We8taYTSOlo+9Vd8DHt7blvWOwkwpe
PmtiEhYR4isXsNseBhuqKJsxwyfV1sa73w==
X-Google-Smtp-Source: ABdhPJzVx7NZ78Cnb8dw0SJXutB2LHe/yx/8sgiQ8KJp7NsJiHPGk0dF4U2BpbjZF7d5iSry7JhVIw==
X-Received: by 2002:a9d:2278:: with SMTP id
o111mr11398945ota.278.1643642035989;
Mon, 31 Jan 2022 07:13:55 -0800 (PST)
Message-ID: <d3c5507d-4425-94d6-c985-30c7093d626b@gmail.com>
Date: Mon, 31 Jan 2022 09:13:59 -0600
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.19)
Gecko/20081209 Lightning/0.9 Thunderbird/2.0.0.19 Mnenhy/0.7.6.0
Subject: Re: Renaming (with 'mv') very large files is SLOW
To: cygwin AT cygwin DOT com
Newsgroups: gmane.os.cygwin
References: <25079 DOT 63376 DOT 349893 DOT 86395 AT consult DOT pretender>
<c1e4529a-d119-1662-6eeb-2d42950802c7 AT cs DOT umass DOT edu>
From: =?UTF-8?Q?Ren=c3=a9_Berber?= <rene DOT berber AT gmail DOT com>
In-Reply-To: <c1e4529a-d119-1662-6eeb-2d42950802c7@cs.umass.edu>
X-Spam-Status: No, score=-2.5 required=5.0 tests=BAYES_00, DKIM_SIGNED,
DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, FREEMAIL_FROM, NICE_REPLY_A,
RCVD_IN_DNSWL_NONE, SPF_HELO_NONE, SPF_PASS, TXREP,
T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.4
X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on
server2.sourceware.org
X-BeenThere: cygwin AT cygwin DOT com
X-Mailman-Version: 2.1.29
List-Id: General Cygwin discussions and problem reports <cygwin.cygwin.com>
List-Unsubscribe: <https://cygwin.com/mailman/options/cygwin>,
<mailto:cygwin-request AT cygwin DOT com?subject=unsubscribe>
List-Archive: <https://cygwin.com/pipermail/cygwin/>
List-Post: <mailto:cygwin AT cygwin DOT com>
List-Help: <mailto:cygwin-request AT cygwin DOT com?subject=help>
List-Subscribe: <https://cygwin.com/mailman/listinfo/cygwin>,
<mailto:cygwin-request AT cygwin DOT com?subject=subscribe>
Errors-To: cygwin-bounces+archive-cygwin=delorie DOT com AT cygwin DOT com
Sender: "Cygwin" <cygwin-bounces+archive-cygwin=delorie DOT com AT cygwin DOT com>

On 1/31/2022 8:59 AM, Eliot Moss wrote:

> On 1/31/2022 9:52 AM, cygwin AT kosowsky DOT org wrote:

>> I tried renaming some very large files (20-40 GB) using: mv
>> <oldname> <newname> without changing the directory of course.
>> 
>> The process took about 10-20 minutes with Task Manager showing
>> disk activity of 100+ MB/s.
>> 
>> Is there something about such large 'renaming' that actually
>> results in the file being really moved (aka copied) rather than
>> just renamed?
> 
> The two places are probably on different volumes (loosely, different
>  disks). That requires a physical move, even under Linux.  Your
> volumes seem a bit slow to access - is one perhaps across a slow
> network?  The rates you cite suggest movement of 50Mb/s (50Mb read +
> 50Mb write = 100Mb overall).  For 40 Gb that should take 40Gb / 50Mb
> = about 820 secs = a little under 14 mins.
> 
> (When I say your volumes are slow, I speak from the luxury of having
> a 2Tb solid state drive!  Actually, those speeds may be reasonable
> depending on the nature of your system.)
> 
> If the two locations are on different drives, there's no real
> avoiding this.

Nope, I've also complained about this (long ago), if the two locations
are the same remote drive... Cygwin moves the entire file over the network.

I ended up writing my own Samba mv command.
-- 
R. Berber

-- 
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple

- Raw text -


  webmaster     delorie software   privacy  
  Copyright © 2019   by DJ Delorie     Updated Jul 2019