delorie.com/archives/browse.cgi   search  
Mail Archives: cygwin/2010/12/15/20:50:18

X-Recipient: archive-cygwin AT delorie DOT com
X-SWARE-Spam-Status: No, hits=0.1 required=5.0 tests=AWL,BAYES_40,T_RP_MATCHES_RCVD
X-Spam-Check-By: sourceware.org
Message-ID: <4D097043.9000105@tlinx.org>
Date: Wed, 15 Dec 2010 17:49:55 -0800
From: Linda Walsh <cygwin AT tlinx DOT org>
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.24) Thunderbird/2.0.0.24 Mnenhy/0.7.6.666
MIME-Version: 1.0
To: "cygwin AT cygwin DOT com" <cygwin AT cygwin DOT com>
Subject: settable optimal transfer size for a given cygwin-install, (or just set it to 4MB)
X-Stationery: 0.4.10
X-IsSubscribed: yes
Mailing-List: contact cygwin-help AT cygwin DOT com; run by ezmlm
List-Id: <cygwin.cygwin.com>
List-Subscribe: <mailto:cygwin-subscribe AT cygwin DOT com>
List-Archive: <http://sourceware.org/ml/cygwin/>
List-Post: <mailto:cygwin AT cygwin DOT com>
List-Help: <mailto:cygwin-help AT cygwin DOT com>, <http://sourceware.org/ml/#faqs>
Sender: cygwin-owner AT cygwin DOT com
Mail-Followup-To: cygwin AT cygwin DOT com
Delivered-To: mailing list cygwin AT cygwin DOT com

It may not be optimal for everyone, but for most systems I've seen, increasing the default I/O size to ~ 4MB would seem to provide a big boost in performance both in local file access as well in network file I/O.

Just now I wanted to copy some files from a local disk to my network and ran 'cp'.  I coughed, when I saw only 50MB/s.  I ran a for i in *; dd if/of bs=xx oflag/iflag=direct;done type loop in it's place.  Tried 16MB first and got 98MB throughput -- but trying 1MB->16MB, 4MB seemed to do the best and gave about 105MB/s.  Not bad for unoptimized file transfer.

For optimized file writes (large, linear, defrag'ed files, with target space pre-allocated as well), my max network speed is 125MB/s, and reads @ 109MB/s, so 105MB/s isn't bad.  

If providing some way to set the 'optimal I/O' isn't possible, could this be upped to 4MB in cygwin?  I'd think this would benefit nearly all systems, but obviously I can't bench them, which is why it'd be neat if it could be configured, perhaps with a registry or ENV setting.

I know it was increased once due to complaints about excessive fragmenting (and that helped speed as well), but making it larger would really help speed too.

Thanks & Hoping...
Linda


--
Problem reports:       http://cygwin.com/problems.html
FAQ:                   http://cygwin.com/faq/
Documentation:         http://cygwin.com/docs.html
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple

- Raw text -


  webmaster     delorie software   privacy  
  Copyright © 2019   by DJ Delorie     Updated Jul 2019