X-Recipient: archive-cygwin@delorie.com X-Spam-Check-By: sourceware.org Date: Wed, 31 Oct 2007 17:27:12 -0500 From: Brian Ford Reply-To: cygwin@cygwin.com To: cygwin@cygwin.com Subject: Re: copying a million tiny files? In-Reply-To: <6a42eec70710311438s273b63dcxc6c741dde4593afc@mail.gmail.com> Message-ID: References: <6a42eec70710311438s273b63dcxc6c741dde4593afc@mail.gmail.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-IsSubscribed: yes Mailing-List: contact cygwin-help@cygwin.com; run by ezmlm Precedence: bulk List-Id: List-Unsubscribe: List-Subscribe: List-Archive: List-Post: List-Help: , Sender: cygwin-owner@cygwin.com Mail-Followup-To: cygwin@cygwin.com Delivered-To: mailing list cygwin@cygwin.com On Wed, 31 Oct 2007, sam reckoner wrote: > I'm not exaggerating. I have over one million small files that like to > move between disks. The problem is that even getting a directory > listing takes forever. > > Is there a best practice for this? > > I don't really need the directory listing, I just need to move all the > files. I have been using rsync, but that takes a very long time to > generate the list of files to be moved. That usually is the best method if you are doing an incremental move. A first time move is usually faster this way: tar -cf - srcdir | tar -C dstdir -xf - -- Brian Ford Lead Realtime Software Engineer VITAL - Visual Simulation Systems FlightSafety International the best safety device in any aircraft is a well-trained crew... -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/