DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org DD2CB3858CD1
MIME-Version: 1.0
References: <CAGen01ickv9cenzeT3SkV9buugEh5CSGW-JWKkWfHUQUsCoVxg@mail.gmail.com>
 <52556213-2914-449d-a719-e1a0826f6ba1@dronecode.org.uk>
 <CAGen01iESMAAzWL+hdp2nNpCBHiD0fhsuK-Fhw6yyFDSzV388A@mail.gmail.com>
 <CAGen01gf91LXQrLp32DWbVFkAHn2A92WqjQOmwRm3LMtoZR2Nw@mail.gmail.com>
 <d98dc0e8-d6be-47c6-af8f-fae93fd04bbf@SystematicSW.ab.ca>
 <CAGen01j1FUAA0XAhH1ygEC30Bjvq2DPaWKhJ5CSoabh7trcSHg@mail.gmail.com>
 <af8da25d-d290-4db3-8343-dee5587f5fe3@systematicsw.ab.ca>
 <CAGen01jySbjiKh1GkyP_LfkhVYTv4TRpm1TMJri+j4VkA09ekA@mail.gmail.com>
In-Reply-To: <CAGen01jySbjiKh1GkyP_LfkhVYTv4TRpm1TMJri+j4VkA09ekA@mail.gmail.com>
Date: Tue, 22 Oct 2024 09:21:43 +0100
Message-ID: <CAJQQdJigOqN=+NwtY=MR2q5DEBiUas_9NqsUD9UXyXQNEa9sVg@mail.gmail.com>
Subject: Re: Installer freezes in windows-2022 GitHub Action
To: Michele Locati <michele@locati.it>
Cc: cygwin@cygwin.com, Brian Inglis <brian.inglis@systematicsw.ab.ca>
From: David Allsopp via Cygwin <cygwin@cygwin.com>
Reply-To: David Allsopp <david@tarides.com>
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Sender: "Cygwin" <cygwin-bounces~archive-cygwin=delorie.com@cygwin.com>

On Tue, 22 Oct 2024 at 09:02, Michele Locati via Cygwin
<cygwin@cygwin.com> wrote:
>

More data-points - running from a couple of networks here in the UK,
but adapting your script to display the x-cache header as well:

Downloading https://cygwin.com/setup-x86_64.exe multiple times (press
Ctrl+C to stop)
x-cache: MISS from cygwin.com
Actual size: 1407507

x-cache: MISS from cygwin.com
Actual size: 1407507

x-cache: REVALIDATE from cygwin.com
Actual size: 1407507

x-cache: REVALIDATE from cygwin.com
Actual size: 0

<10 more REVALIDATE with Actual size 0>

x-cache: MISS from cygwin.com
Actual size: 1407507

x-cache: REVALIDATE from cygwin.com
Actual size: 1407507

x-cache: REVALIDATE from cygwin.com
Actual size: 0

x-cache: MISS from cygwin.com
Actual size: 1407507

x-cache: REVALIDATE from cygwin.com
Actual size: 1407507

x-cache: REVALIDATE from cygwin.com
Actual size: 0

so there seems to be a pattern. Isn't that x-cache header coming from
Apache's mod_cache (i.e. something at the cygwin.com/sourceware end,
not any CDN sat in the way)? Having _never_ seen anything like this
from cygwin.com before, and the fact it's happening on diverse
networks, my debugging intuition would be to find out if sourceware
reconfigured anything last week before trying to engage in the futile
task of contacting any network providers......

All best,


David


> Il giorno mar 22 ott 2024 alle ore 06:28 Brian Inglis via Cygwin
> <cygwin@cygwin.com> ha scritto:
> > I typically use wget -N -nv for downloads, without any issues for decades, on
> > any service.
>
> Hello Brian,
>
> thanks for the reply!
>
> It seems the problem occurs when we require the same URL from the same
> IP multiple times.
> This occurs for example in GitHub Actions, where the cygwin server
> sees just one or few IPs for the whole GitHub system).
>
> You can "simulate" it by using curl (or wget or any tool you prefer)
> by forcing the download of the same file multiple times.
> Consider for example the following script:
>
>
> #!/bin/bash
> set -o errexit
> set -o nounset
> set -o pipefail
> url=https://cygwin.com/setup-x86_64.exe
> filename="$(basename "$url")"
> printf 'Downloading %s multiple times (press Ctrl+C to stop)\n' "$url"
> while :; do
>     wget -N -nv $url
>     size=$(cat "$filename" | wc -c)
>     rm "$filename"
>     printf 'Actual size: %s\n\n' $size
>     sleep 1
> done
>
> Please remark that I used wget like you wrote, with the difference
> that I delete the downloaded file before performing another wget call.
> This "simulates" different wget calls from different PCs, but seen by
> cygwin.com always with the same IP.
>
> I always have results similar to the following:
>
> Downloading https://cygwin.com/setup-x86_64.exe multiple times (press
> Ctrl+C to stop)
> 2024-10-22 09:52:10 URL:https://cygwin.com/setup-x86_64.exe
> [1407507/1407507] -> "setup-x86_64.exe" [1]
> Actual size: 1407507
>
> 2024-10-22 09:52:14 URL:https://cygwin.com/setup-x86_64.exe
> [1407507/1407507] -> "setup-x86_64.exe" [1]
> Actual size: 1407507
>
> 2024-10-22 09:52:16 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
> "setup-x86_64.exe" [1]
> Actual size: 0
>
> 2024-10-22 09:52:18 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
> "setup-x86_64.exe" [1]
> Actual size: 0
>
> 2024-10-22 09:52:20 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
> "setup-x86_64.exe" [1]
> Actual size: 0
>
> 2024-10-22 09:52:22 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
> "setup-x86_64.exe" [1]
> Actual size: 0
>
> 2024-10-22 09:52:24 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
> "setup-x86_64.exe" [1]
> Actual size: 0
>
> 2024-10-22 09:52:26 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
> "setup-x86_64.exe" [1]
> Actual size: 0
>
> ^C
>
>
> I tried the script above on:
> - WSL from my home PC
> - WSL from my office PC
> - bare metal Linux located in my office LAN
> - DigitalOcean droplet located in New York
> - DigitalOcean droplet located in Amsterdam
> - VPS hosted on Aruba located in Italy
> - Amazon Lightsail located in Frankfurt
>
> And I always have similar results...
>
> Ciao,
> Michele
>
> --
> Problem reports:      https://cygwin.com/problems.html
> FAQ:                  https://cygwin.com/faq/
> Documentation:        https://cygwin.com/docs.html
> Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple

-- 
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple