X-Recipient:	archive-cygwin AT delorie DOT com
X-Spam-Check-By:	sourceware.org
From:	Evgeniy <_oiler_ AT mail DOT ru>
To:	cygwin AT cygwin DOT com
Subject:	=?koi8-r?Q?cygwin_1.5.25-15=3A_cwrsync_2.1.3_=22hangs=22_when_80_mb_of_100_gb_data_network_folder_is_to_be_transmitted?=
Mime-Version:	1.0
X-Mailer:	mPOP Web-Mail 2.19
Date:	Mon, 10 Nov 2008 19:59:31 +0300
Reply-To:	Evgeniy <_oiler_ AT mail DOT ru>
Message-Id:	<E1Kza6t-000Dlt-00._oiler_-mail-ru@f169.mail.ru>
X-Spam:	Not detected
X-Mras:	OK
Mailing-List:	contact cygwin-help AT cygwin DOT com; run by ezmlm
List-Id:	<cygwin.cygwin.com>
List-Subscribe:	<mailto:cygwin-subscribe AT cygwin DOT com>
List-Archive:	<http://sourceware.org/ml/cygwin/>
List-Post:	<mailto:cygwin AT cygwin DOT com>
List-Help:	<mailto:cygwin-help AT cygwin DOT com>, <http://sourceware.org/ml/#faqs>
Sender:	cygwin-owner AT cygwin DOT com
Mail-Followup-To:	cygwin AT cygwin DOT com
Delivered-To:	mailing list cygwin AT cygwin DOT com

Hello,

At main office we have a data storage server with a ~100 Gb folder of data which is daily updated on about 80 Mb. These updated 80 Mb of data should be daily synchronized to a remote data storage at branch office via rsync. rsync client is installed on a workstation at the branch office and cygwin 1.5.25-15 sshd service is installed on a workstation at the main office. The synchronized data storage folders are available to these workstations as network drives. These ~100 Gb folders of data contain a lot of 0,5 - 2 Mb sized files which are pdfs and picture scans. rsync works perfectly on smaller volumes of data, when we transmit, for example, 100 Mb of these files. But when we try to transmit all the 100 Gb folder in which we have only 80 Mb of new files and the rest of the files are identical by name, size and modification time to destination folder files, we got rsync somewhat "hung".

The following cmd file is used to run rsync at the branch workstation:

rsync -Wvrt --ignore-existing --progress -e "ssh.exe -i C:\id_dsa" user AT mainoffice:/x/ /cygdrive/z/

where x - is an attached network drive ~100 Gb folder of the data storage at the main office,
z - is an attached network drive ~100 Gb folder of the data storage at the branch office.

During the execution rsync tells "receiving incremental file list" and then it "hangs" - it doesn't update this incremental file list. After 14 hours of transmission according to a transmission log it transferred only two files of 0 bytes total size.

So the question is what is wrong? I can't beleive that rsync can't handle with such a big volume of data when it is necessary to transmit only a small part of it.

Any ideas and suggestions would be very much appreciated.

Thank you in advance.

 


--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

- Raw text -