DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 0D6C63857346
MIME-Version: 1.0
References: <CAGen01ickv9cenzeT3SkV9buugEh5CSGW-JWKkWfHUQUsCoVxg@mail.gmail.com>
 <52556213-2914-449d-a719-e1a0826f6ba1@dronecode.org.uk>
 <CAGen01iESMAAzWL+hdp2nNpCBHiD0fhsuK-Fhw6yyFDSzV388A@mail.gmail.com>
 <CAGen01gf91LXQrLp32DWbVFkAHn2A92WqjQOmwRm3LMtoZR2Nw@mail.gmail.com>
 <d98dc0e8-d6be-47c6-af8f-fae93fd04bbf@SystematicSW.ab.ca>
 <CAGen01j1FUAA0XAhH1ygEC30Bjvq2DPaWKhJ5CSoabh7trcSHg@mail.gmail.com>
 <af8da25d-d290-4db3-8343-dee5587f5fe3@systematicsw.ab.ca>
In-Reply-To: <af8da25d-d290-4db3-8343-dee5587f5fe3@systematicsw.ab.ca>
Date: Tue, 22 Oct 2024 10:01:37 +0200
Message-ID: <CAGen01jySbjiKh1GkyP_LfkhVYTv4TRpm1TMJri+j4VkA09ekA@mail.gmail.com>
Subject: Re: Installer freezes in windows-2022 GitHub Action
To: cygwin@cygwin.com, Brian Inglis <brian.inglis@systematicsw.ab.ca>
From: Michele Locati via Cygwin <cygwin@cygwin.com>
Reply-To: Michele Locati <michele@locati.it>
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Sender: "Cygwin" <cygwin-bounces~archive-cygwin=delorie.com@cygwin.com>

Il giorno mar 22 ott 2024 alle ore 06:28 Brian Inglis via Cygwin
<cygwin@cygwin.com> ha scritto:
> I typically use wget -N -nv for downloads, without any issues for decades, on
> any service.

Hello Brian,

thanks for the reply!

It seems the problem occurs when we require the same URL from the same
IP multiple times.
This occurs for example in GitHub Actions, where the cygwin server
sees just one or few IPs for the whole GitHub system).

You can "simulate" it by using curl (or wget or any tool you prefer)
by forcing the download of the same file multiple times.
Consider for example the following script:


#!/bin/bash
set -o errexit
set -o nounset
set -o pipefail
url=https://cygwin.com/setup-x86_64.exe
filename="$(basename "$url")"
printf 'Downloading %s multiple times (press Ctrl+C to stop)\n' "$url"
while :; do
    wget -N -nv $url
    size=$(cat "$filename" | wc -c)
    rm "$filename"
    printf 'Actual size: %s\n\n' $size
    sleep 1
done

Please remark that I used wget like you wrote, with the difference
that I delete the downloaded file before performing another wget call.
This "simulates" different wget calls from different PCs, but seen by
cygwin.com always with the same IP.

I always have results similar to the following:

Downloading https://cygwin.com/setup-x86_64.exe multiple times (press
Ctrl+C to stop)
2024-10-22 09:52:10 URL:https://cygwin.com/setup-x86_64.exe
[1407507/1407507] -> "setup-x86_64.exe" [1]
Actual size: 1407507

2024-10-22 09:52:14 URL:https://cygwin.com/setup-x86_64.exe
[1407507/1407507] -> "setup-x86_64.exe" [1]
Actual size: 1407507

2024-10-22 09:52:16 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
"setup-x86_64.exe" [1]
Actual size: 0

2024-10-22 09:52:18 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
"setup-x86_64.exe" [1]
Actual size: 0

2024-10-22 09:52:20 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
"setup-x86_64.exe" [1]
Actual size: 0

2024-10-22 09:52:22 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
"setup-x86_64.exe" [1]
Actual size: 0

2024-10-22 09:52:24 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
"setup-x86_64.exe" [1]
Actual size: 0

2024-10-22 09:52:26 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
"setup-x86_64.exe" [1]
Actual size: 0

^C


I tried the script above on:
- WSL from my home PC
- WSL from my office PC
- bare metal Linux located in my office LAN
- DigitalOcean droplet located in New York
- DigitalOcean droplet located in Amsterdam
- VPS hosted on Aruba located in Italy
- Amazon Lightsail located in Frankfurt

And I always have similar results...

Ciao,
Michele

-- 
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple