Mailing-List: contact cygwin-apps-help AT cygwin DOT com; run by ezmlm
Sender: cygwin-apps-owner AT cygwin DOT com
List-Subscribe: <mailto:cygwin-apps-subscribe AT cygwin DOT com>
List-Archive: <http://sources.redhat.com/ml/cygwin-apps/>
List-Post: <mailto:cygwin-apps AT cygwin DOT com>
List-Help: <mailto:cygwin-apps-help AT cygwin DOT com>, <http://sources.redhat.com/lists.html#faqs>
Mail-Followup-To: cygwin-apps AT cygwin DOT com
Delivered-To: mailing list cygwin-apps AT cygwin DOT com
Message-ID: <3CB39B0D.2050401@ece.gatech.edu>
Date: Tue, 09 Apr 2002 21:53:17 -0400
From: Charles Wilson <cwilson AT ece DOT gatech DOT edu>
User-Agent: Mozilla/5.0 (Windows; U; Win98; en-US; rv:0.9.4) Gecko/20011019 Netscape6/6.2
X-Accept-Language: en-us
MIME-Version: 1.0
To: cygwin-apps AT cygwin DOT com
Subject: Re: Now that the new setup is here...
References: <FC169E059D1A0442A04C40F86D9BA76008AC93 AT itdomain003 DOT itdomain DOT net DOT au> <20020410001021 DOT GA23551 AT redhat DOT com> <3CB395E5 DOT 7070002 AT ece DOT gatech DOT edu> <20020410014333 DOT GK23551 AT redhat DOT com>
Content-Type: multipart/mixed;
 boundary="------------020507090202030706020808"

This is a multi-part message in MIME format.
--------------020507090202030706020808
Content-Type: text/plain; charset=us-ascii; format=flowed
Content-Transfer-Encoding: 7bit

Christopher Faylor wrote:

>>>Regardless, I'm with Robert.  setup was never designed to be a mirroring
>>>tool or a site deployment tool.  If people are relying on a particular
>>>directory arrangement then, er, tough...
>>>
>>Agreed.  I have a pretty clever (IMHO; although, being based on wget it
>>qualifies as "dumb" according to the definition above) wrapper around
>>wget that I use to mirror the cygwin dist; I wonder if it would be
>>useful to provide that somewhere (cgf's magic script area in the
>>repository?  Some other "random useful stuff here" repository?).  Then,
>>when people complain about setup, we say
>>
>>"Here.  Go use THIS tool, HERE, and don't try to fit the (setup) round
>>peg into the (mirroring) square hole"
>>
> 
> I've been contemplating something very much like that, actually.  I guess
> that's no surprise.


My version, attached.

 
> I was thinking about polishing up and checking in the simple setup .bat
> file that I posted a while ago but I was wondering if that would lead
> to real confusion.
> 
> "I used the cgfdeploy tool to download setup.exe but when I run
> setup.exe it just displays a bunch of windows.  What's going on?  I
> thought cgfdeply was supposed to be a simple mirroring tool!"


Urk.


> I also have a friend who's working on and off on a web based install,
> fwiw.


neat.

>>does sourceware (or any of the official mirrors) provide anonymous 
>>rsync?
>>
> 
> sourceware provides anonymous rsync.  It's a resource hog but it is
> available.
> 
> I don't know if I want to advertise it too widely, though or there
> will be 257 people trying it out tomorrow.


Yep.


> We already suffer from people firing off 4 ftp sessions at a time
> to download their favorite tools.  I can just imagine what will
> happen when people experiment with rsync.


Yeah -- "Why is rsync continually downloading all the files, even though 
I already have most of them" is an rsync FAQ.  Scary.

(Also, the 2second time granularity of the FAT filesystem causes massive 
unnecessary rsync downloadiness.  No doubt we'd get hit with that, and 
often.)

 
> I did get the new sourceware system today.  I set it up in my office
> (I'm not working from home anymore) where I cleverly killed the sshd
> daemon so that I can no longer access it to configure it.


Been there, done that.

 
> Once that box is deployed we should have some excess capacity for things
> like rsync and maybe we can even allow downloads from
> sources.redhat.com again.


But I thought the problem with sourceware has been (a) processing load 
AND (b) bandwidth.  The new machine may fix (a), but what of (b) ?  Ah 
well -- NMP(tm).  [Not My Problem]

--Chuck

--------------020507090202030706020808
Content-Type: text/plain;
 name="update_mirror"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline;
 filename="update_mirror"

#!/bin/sh
mirror="ftp://mirrors.rcn.net"
mpath="/mirrors/sources.redhat.com/cygwin"

cleanup() {
echo "Cleaning up obsolete files in $1"
cd $1
listings=$(find . -name ".listing");
for f in $listings ; do 
  dirn=$(dirname $f);
  # d2u $f
  (cd $dirn; 
  filelist="";
  while read line
  do
    line2=$(echo $line | awk '{print $9}');
    filelist="$filelist $line2"
  done<.listing
  for file in *; do
    if [ -f "$file" ] ; then
      case "$filelist" in
        *$file* ) ;;
        *)        echo "Removing obsolete file: ${1}/${dirn}/${file}"
                  rm -f $file ;;
      esac
    fi
  done)
done
}

wget -m -nr -nH --cut-dirs=3 --dot-style=binary \
  ${mirror}${mpath}/contrib
(cleanup contrib)
wget -m -nr -nH --cut-dirs=3 --dot-style=binary \
  ${mirror}${mpath}/latest
(cleanup latest)
wget -N --dot-style=binary ${mirror}${mpath}/setup.ini
cp latest/setup.exe ./setup.exe

--------------020507090202030706020808--