delorie.com/archives/browse.cgi   search  
Mail Archives: cygwin/2016/03/31/16:49:44

X-Recipient: archive-cygwin AT delorie DOT com
DomainKey-Signature: a=rsa-sha1; c=nofws; d=sourceware.org; h=list-id
:list-unsubscribe:list-subscribe:list-archive:list-post
:list-help:sender:mime-version:from:date:message-id:subject:to
:content-type; q=dns; s=default; b=BAbgkgM++axjMve0XOoM2dQECbiws
gGWNm2WAp7SD7WH4dK4OYWeCLL8qyd/GNzDJWzgzZ47gwqSuTywfQi8aU1xjX6N8
MGQ6JW3AmRZ2TXPykco59fESWNmTbV1Geq2JePD8d7JYXXbxkikwnFxldfqnrQpw
l73rdrsYnZLMsE=
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=sourceware.org; h=list-id
:list-unsubscribe:list-subscribe:list-archive:list-post
:list-help:sender:mime-version:from:date:message-id:subject:to
:content-type; s=default; bh=lJ8AIforRExucec83ybblF2xUMo=; b=NQO
sH0W6OBkGFtJEnKdbYBl4IsvIU0Ccs4Mkw9V7qR6IjltAlZK3IthyiHM2xgzNDew
Fv/MIo4VUNUuaV13RAvLdDy60NJUbcx9rDg3yfgSAjMtsKrSnuAadNnQszrX8kaK
sRlvl8q+0ZV0fGs1/jMnT969s0eObz7hOpDcWzf4=
Mailing-List: contact cygwin-help AT cygwin DOT com; run by ezmlm
List-Id: <cygwin.cygwin.com>
List-Subscribe: <mailto:cygwin-subscribe AT cygwin DOT com>
List-Archive: <http://sourceware.org/ml/cygwin/>
List-Post: <mailto:cygwin AT cygwin DOT com>
List-Help: <mailto:cygwin-help AT cygwin DOT com>, <http://sourceware.org/ml/#faqs>
Sender: cygwin-owner AT cygwin DOT com
Mail-Followup-To: cygwin AT cygwin DOT com
Delivered-To: mailing list cygwin AT cygwin DOT com
Authentication-Results: sourceware.org; auth=none
X-Virus-Found: No
X-Spam-SWARE-Status: No, score=0.1 required=5.0 tests=BAYES_50,FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS autolearn=ham version=3.3.2 spammy=ontopic, on-topic, 750GB, 128GB
X-HELO: mail-lf0-f42.google.com
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=yw/1keCr/RY+SBK/Pjo+d4Vyl3J2ECcC118G1sI10gI=; b=YRIpsuPR2CyJPnHjjAuzfSOlKOfGbGxzfX+W6nrX0ww9sSVwoo9MgehZjoVyHQUl8v Ah3pf67Es86FvmOS6cKLJncfmaYxYPfx8+wYVVaAQse6ZEDZgLFlphWxFu2F3QpgBMXj 0+3UXWNPIxRvWx94V9og4VB4RDYilONHt4edaPnSxXOX6IxZcMcvaSxBsomONENz9xDs NM3LKg2+72jEo/3LK3vyLSbCTDh29DKelhWHP2IzEJKjyIqC73dj9OoqtVkkrUgnun0S hHsS2YlGIQ8ynDHUI6PLHfPHIQUX5BqdsSdzsRYHkz2y/kYYJ2FiYgtW4wS3oN5P677I JieA==
X-Gm-Message-State: AD7BkJLVL8mdp9msJVLsWNBEQn3MfOG0ivH3LLSyQZ5SqXAtjRoU/aFiT0kaWawdB1LEkRjkI0TDc85ieLta2g==
X-Received: by 10.25.17.91 with SMTP id g88mr88417lfi.38.1459457353676; Thu, 31 Mar 2016 13:49:13 -0700 (PDT)
MIME-Version: 1.0
From: Greg Freemyer <greg DOT freemyer AT gmail DOT com>
Date: Thu, 31 Mar 2016 16:48:34 -0400
Message-ID: <CAGpXXZJV-nsB=xyO7=EBUb-JCk5KqMPS=bvg2aWgw_jm4OZFsQ@mail.gmail.com>
Subject: rsync performance degradation? Could be a windows issue?
To: cygwin AT cygwin DOT com
X-IsSubscribed: yes

All,

I'm not sure this is on-topic, but at least I'm in cygwin when I
notice the below:

I do a lot of large data transfers between USB drives.  Often I get
great speeds (70MB/sec or more).

Sometimes it falls way off to closer to 20MB/sec with the same class
of hardware.

I experienced the "slow" transfer speed today, so I thought I'd ask if
anyone knew a way to resolve it?

The PC I'm running on is spec'ed for data processing so a 6 core (12
thread) setup with 128GB or RAM.

No significant data processing is going on.  Basically the machine is
currently dedicated to running rsync (as below).

I have 2 USB drives hooked up.  Both are USB-3 and should be able to
do 70MB/sec with no issue.

Neither drive has any unrelated I/O going on that I know of.  (I don't
see any in the Windows Performance Monitor.)

I have a folder with almost 200 4GB files ( 750GB total and all the
files are large).

I'm using "rsync -av" to copy files from the source to the destination
and the folder on the destination started out empty

Using Windows "Resource Monitor" I normally would see both drives
hitting over 70 MB/sec.  Today I'm seeing the source drive jump all
the way up to 125 MB/sec or so, but the destination is down around 20
MB/sec

When the 4GB source file completes reading, the source drive basically
goes idle for a while until the file is written out.

Then the source drive jumps back to 125 MB/sec until it finishes
reading the next file.  The destination drive on the other hand is
stuck down around 20 MB/sec.

I really don't think this is caused by slow hardware.  Could the
destination drive be dropping down to USB-2 mode?

===
And now that I've written up the above, the system has returned to a
more normal 75 MB/sec consistently on the output drive.

I'm still curious what might be going on.  As I say I move a lot of
data around as part of my work, and much of the time it is big groups
of either 1.5GB or 4GB files.

Thanks
Greg
--
Greg Freemyer
www.IntelligentAvatar.net

--
Problem reports:       http://cygwin.com/problems.html
FAQ:                   http://cygwin.com/faq/
Documentation:         http://cygwin.com/docs.html
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple

- Raw text -


  webmaster     delorie software   privacy  
  Copyright © 2019   by DJ Delorie     Updated Jul 2019