DKIM-Filter: OpenDKIM Filter v2.11.0 delorie.com 49M8UT9J2785121
Authentication-Results: delorie.com;
	dkim=pass (1024-bit key, unprotected) header.d=cygwin.com header.i=@cygwin.com header.a=rsa-sha256 header.s=default header.b=PETU/Tyn
X-Recipient: archive-cygwin AT delorie DOT com
DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 89F823857C5D
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cygwin.com;
	s=default; t=1729585828;
	bh=NJG5wrYhoNT4WGloEVIB0CqkclOeBty6YOBy31uzDcA=;
	h=Subject:Date:In-Reply-To:To:References:List-Id:List-Unsubscribe:
	 List-Archive:List-Post:List-Help:List-Subscribe:From:Reply-To:Cc:
	 From;
	b=PETU/TynW4kyypZb4HYqtYbNMzj4M/Q3+Vk1irkA/aRs/wZUPYsUGSh19v+brO1lS
	 wovmycZ9Sn2FPb0YsqS46U5nS1MHZjbS0WPXPb6G91zfPnRBVU+GT8IrsbU1bKlHXk
	 ldYrJRQtbtN8/kk9aOGRwCJLLYUUHEj2uurt7xPI=
X-Original-To: cygwin AT cygwin DOT com
Delivered-To: cygwin AT cygwin DOT com
DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 2728F3858CD1
ARC-Filter: OpenARC Filter v1.0.0 sourceware.org 2728F3858CD1
ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1729585807; cv=none;
 b=F1w9ndSq5fPgNG+0JKGd0gnt3K7axfVMQLv+l/hbA6pq6p9YZCC3VRSNblntIvBxjO1u8nNfQI+l+EZ42Zx610As+Dag9itj6dTmQjoyI5iSXg/h8wyaZt7ft92CYNsSBuX+8Gwa+40kqbVG+7dWj+5Gkx5gkEs8Q6qv8i0olkw=
ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key;
 t=1729585807; c=relaxed/simple;
 bh=xSpmtJG/D5ZOlmRWh56uHwjkkrbx0AR+pEvI0c44UD4=;
 h=DKIM-Signature:From:Message-Id:Mime-Version:Subject:Date:To;
 b=pWmnlpiOC76Wk12pukDVG6SlEi9CWDTIOmMBhz06XkjYuh+BgkRYZ/FxdHPeBTFFdjYDz7P4czy2gAvUf7zoShU87KKuyu64XdKCCUTAxRLguUk6JQLHyuA0HcPYU4EqOUG6OMWAKmC8jjpIZaDePVHrWgbi0JFsdc1fCefZWYg=
ARC-Authentication-Results: i=1; server2.sourceware.org
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20230601; t=1729585794; x=1730190594;
 h=references:to:cc:in-reply-to:date:subject:mime-version:message-id
 :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
 bh=8kDeMJzNyc6guwGnK8eD1TPiPviTpU6RqkL9JmnSJgA=;
 b=Hg1aeaHC1rKVcUlYIXosQHbYLu4+SIgwBxdDGB9E64ns+DtrdRtZEEU4jnKO/CXhU2
 5ertBfHeHENhMfm2VE3oScRo1U66LC9MTXgeNYOiR37+pmqMCf2kVP6UN9vEp/mHRCrg
 nr9jKDfbpCp4vSqjYCcw43Yq9hJeB77kNJ1q4k9FSUeJTt3CZtDLJeaRWzgNdEJtAh0n
 MZ86WcmXo3+C0h4x7n8J6l828bSM7nO9zmzwfCnTEiFRNbRC+oUJNbL/5L9tpA0uD7n+
 b1CMMunGCYre9ut2ObkTGszJlrSliY55/kbybmrGccgjAaSCUOSOxaCspwFn8aewSpK3
 AAOw==
X-Forwarded-Encrypted: i=1;
 AJvYcCVGnX+iaxVu5DM6XNSIdQm92Wrq0lHtOp/LJoie21ZiLezVtO2rnGj4BkmtyRWShXSg/YMK1Y8=@cygwin.com
X-Gm-Message-State: AOJu0YyuqtSzVuFmogysFZOlhZXsqnregPZkPDt9uZfvG5LDgypTtYQY
 r+Qam8A9DFcO/CHVv8Eigt3TjAg1dDX3p2G/16dMly0HlDMrYfvAM5ziHVpEDlY=
X-Google-Smtp-Source: AGHT+IGpWb2BIhamAsKFfm3p4GFOsUOht32aUxlTiZgitF0xacT2V4knhQ1sqJXrPrmtErdxZjtNrQ==
X-Received: by 2002:a05:6512:308d:b0:536:55a8:6f78 with SMTP id
 2adb3069b0e04-53a15219180mr6486967e87.17.1729585794097; 
 Tue, 22 Oct 2024 01:29:54 -0700 (PDT)
Message-Id: <88EB74AD-DE58-4BC2-A109-96FF19D49F5E@unified-streaming.com>
Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6.1.2\))
Subject: Re: Installer freezes in windows-2022 GitHub Action
Date: Tue, 22 Oct 2024 10:29:53 +0200
In-Reply-To: <CAJQQdJigOqN=+NwtY=MR2q5DEBiUas_9NqsUD9UXyXQNEa9sVg@mail.gmail.com>
To: David Allsopp <david AT tarides DOT com>
References: <CAGen01ickv9cenzeT3SkV9buugEh5CSGW-JWKkWfHUQUsCoVxg AT mail DOT gmail DOT com>
 <52556213-2914-449d-a719-e1a0826f6ba1 AT dronecode DOT org DOT uk>
 <CAGen01iESMAAzWL+hdp2nNpCBHiD0fhsuK-Fhw6yyFDSzV388A AT mail DOT gmail DOT com>
 <CAGen01gf91LXQrLp32DWbVFkAHn2A92WqjQOmwRm3LMtoZR2Nw AT mail DOT gmail DOT com>
 <d98dc0e8-d6be-47c6-af8f-fae93fd04bbf AT SystematicSW DOT ab DOT ca>
 <CAGen01j1FUAA0XAhH1ygEC30Bjvq2DPaWKhJ5CSoabh7trcSHg AT mail DOT gmail DOT com>
 <af8da25d-d290-4db3-8343-dee5587f5fe3 AT systematicsw DOT ab DOT ca>
 <CAGen01jySbjiKh1GkyP_LfkhVYTv4TRpm1TMJri+j4VkA09ekA AT mail DOT gmail DOT com>
 <CAJQQdJigOqN=+NwtY=MR2q5DEBiUas_9NqsUD9UXyXQNEa9sVg AT mail DOT gmail DOT com>
X-Mailer: Apple Mail (2.3731.700.6.1.2)
X-Spam-Status: No, score=-1.6 required=5.0 tests=BAYES_00, DKIM_SIGNED,
 DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, HTML_MESSAGE, KAM_EXEURI,
 RCVD_IN_DNSWL_NONE, SPF_HELO_NONE, SPF_PASS,
 TXREP autolearn=no autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
 server2.sourceware.org
X-Content-Filtered-By: Mailman/MimeDel 2.1.30
X-BeenThere: cygwin AT cygwin DOT com
X-Mailman-Version: 2.1.30
Precedence: list
List-Id: General Cygwin discussions and problem reports <cygwin.cygwin.com>
List-Unsubscribe: <https://cygwin.com/mailman/options/cygwin>,
 <mailto:cygwin-request AT cygwin DOT com?subject=unsubscribe>
List-Archive: <https://cygwin.com/pipermail/cygwin/>
List-Post: <mailto:cygwin AT cygwin DOT com>
List-Help: <mailto:cygwin-request AT cygwin DOT com?subject=help>
List-Subscribe: <https://cygwin.com/mailman/listinfo/cygwin>,
 <mailto:cygwin-request AT cygwin DOT com?subject=subscribe>
From: Dimitry Andric via Cygwin <cygwin AT cygwin DOT com>
Reply-To: Dimitry Andric <dimitry AT unified-streaming DOT com>
Cc: Brian Inglis <brian DOT inglis AT systematicsw DOT ab DOT ca>, cygwin AT cygwin DOT com
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Errors-To: cygwin-bounces~archive-cygwin=delorie DOT com AT cygwin DOT com
Sender: "Cygwin" <cygwin-bounces~archive-cygwin=delorie DOT com AT cygwin DOT com>

Yeah, this is even happening over http/2:

Host cygwin.com:443 was resolved.
* IPv6: (none)
* IPv4: 8.43.85.97
*   Trying 8.43.85.97:443...
* Connected to cygwin.com (8.43.85.97) port 443
> GET /setup-x86_64.exe HTTP/2
> Host: cygwin.com
> User-Agent: curl/8.7.1
> Accept: */*
>
* Request completely sent off
< HTTP/2 200
< date: Tue, 22 Oct 2024 08:25:16 GMT
< server: Apache/2.4.37 (Red Hat Enterprise Linux) OpenSSL/1.1.1k mod_qos/11.74 mod_wsgi/4.6.4 Python/3.6 mod_perl/2.0.12 Perl/v5.26.3
< vary: User-Agent
< last-modified: Tue, 16 Apr 2024 18:39:04 GMT
< etag: "157a13-6163b0d6e8405"
< accept-ranges: bytes
< content-length: 1407507
< cache-control: max-age=0
< expires: Tue, 22 Oct 2024 08:25:16 GMT
< content-security-policy: default-src 'self' http: https:
< strict-transport-security: max-age=16070400
< x-cache: MISS from cygwin.com
< content-type: application/octet-stream
<
...
> GET /setup-x86_64.exe HTTP/2
> Host: cygwin.com
> User-Agent: curl/8.7.1
> Accept: */*
>
* Request completely sent off
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0< HTTP/2 200
< date: Tue, 22 Oct 2024 08:25:24 GMT
< server: Apache/2.4.37 (Red Hat Enterprise Linux) OpenSSL/1.1.1k mod_qos/11.74 mod_wsgi/4.6.4 Python/3.6 mod_perl/2.0.12 Perl/v5.26.3
< last-modified: Tue, 16 Apr 2024 18:39:04 GMT
< content-length: 0
< vary: User-Agent
< etag: "157a13-6163b0d6e8405"
< accept-ranges: bytes
< cache-control: max-age=0
< expires: Tue, 22 Oct 2024 08:25:24 GMT
< content-security-policy: default-src 'self' http: https:
< strict-transport-security: max-age=16070400
< x-cache: REVALIDATE from cygwin.com
< content-type: application/octet-stream

I suspect this is mod_qos (https://mod-qos.sourceforge.net/) that is doing something like rate-limiting, but instead of giving you a 403 Forbidden, it gives you a zero content-length.

Looks like it would be best to contact the webmaster of cygwin.com <http://cygwin.com/>? It's all hosted on sourceware.org <http://sourceware.org/>, as far as I can see.

-Dimitry

> On 22 Oct 2024, at 10:21, David Allsopp via Cygwin <cygwin AT cygwin DOT com> wrote:
> 
> On Tue, 22 Oct 2024 at 09:02, Michele Locati via Cygwin
> <cygwin AT cygwin DOT com> wrote:
>> 
> 
> More data-points - running from a couple of networks here in the UK,
> but adapting your script to display the x-cache header as well:
> 
> Downloading https://cygwin.com/setup-x86_64.exe multiple times (press
> Ctrl+C to stop)
> x-cache: MISS from cygwin.com
> Actual size: 1407507
> 
> x-cache: MISS from cygwin.com
> Actual size: 1407507
> 
> x-cache: REVALIDATE from cygwin.com
> Actual size: 1407507
> 
> x-cache: REVALIDATE from cygwin.com
> Actual size: 0
> 
> <10 more REVALIDATE with Actual size 0>
> 
> x-cache: MISS from cygwin.com
> Actual size: 1407507
> 
> x-cache: REVALIDATE from cygwin.com
> Actual size: 1407507
> 
> x-cache: REVALIDATE from cygwin.com
> Actual size: 0
> 
> x-cache: MISS from cygwin.com
> Actual size: 1407507
> 
> x-cache: REVALIDATE from cygwin.com
> Actual size: 1407507
> 
> x-cache: REVALIDATE from cygwin.com
> Actual size: 0
> 
> so there seems to be a pattern. Isn't that x-cache header coming from
> Apache's mod_cache (i.e. something at the cygwin.com/sourceware end,
> not any CDN sat in the way)? Having _never_ seen anything like this
> from cygwin.com before, and the fact it's happening on diverse
> networks, my debugging intuition would be to find out if sourceware
> reconfigured anything last week before trying to engage in the futile
> task of contacting any network providers......
> 
> All best,
> 
> 
> David
> 
> 
>> Il giorno mar 22 ott 2024 alle ore 06:28 Brian Inglis via Cygwin
>> <cygwin AT cygwin DOT com> ha scritto:
>>> I typically use wget -N -nv for downloads, without any issues for decades, on
>>> any service.
>> 
>> Hello Brian,
>> 
>> thanks for the reply!
>> 
>> It seems the problem occurs when we require the same URL from the same
>> IP multiple times.
>> This occurs for example in GitHub Actions, where the cygwin server
>> sees just one or few IPs for the whole GitHub system).
>> 
>> You can "simulate" it by using curl (or wget or any tool you prefer)
>> by forcing the download of the same file multiple times.
>> Consider for example the following script:
>> 
>> 
>> #!/bin/bash
>> set -o errexit
>> set -o nounset
>> set -o pipefail
>> url=https://cygwin.com/setup-x86_64.exe
>> filename="$(basename "$url")"
>> printf 'Downloading %s multiple times (press Ctrl+C to stop)\n' "$url"
>> while :; do
>>    wget -N -nv $url
>>    size=$(cat "$filename" | wc -c)
>>    rm "$filename"
>>    printf 'Actual size: %s\n\n' $size
>>    sleep 1
>> done
>> 
>> Please remark that I used wget like you wrote, with the difference
>> that I delete the downloaded file before performing another wget call.
>> This "simulates" different wget calls from different PCs, but seen by
>> cygwin.com always with the same IP.
>> 
>> I always have results similar to the following:
>> 
>> Downloading https://cygwin.com/setup-x86_64.exe multiple times (press
>> Ctrl+C to stop)
>> 2024-10-22 09:52:10 URL:https://cygwin.com/setup-x86_64.exe
>> [1407507/1407507] -> "setup-x86_64.exe" [1]
>> Actual size: 1407507
>> 
>> 2024-10-22 09:52:14 URL:https://cygwin.com/setup-x86_64.exe
>> [1407507/1407507] -> "setup-x86_64.exe" [1]
>> Actual size: 1407507
>> 
>> 2024-10-22 09:52:16 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
>> "setup-x86_64.exe" [1]
>> Actual size: 0
>> 
>> 2024-10-22 09:52:18 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
>> "setup-x86_64.exe" [1]
>> Actual size: 0
>> 
>> 2024-10-22 09:52:20 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
>> "setup-x86_64.exe" [1]
>> Actual size: 0
>> 
>> 2024-10-22 09:52:22 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
>> "setup-x86_64.exe" [1]
>> Actual size: 0
>> 
>> 2024-10-22 09:52:24 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
>> "setup-x86_64.exe" [1]
>> Actual size: 0
>> 
>> 2024-10-22 09:52:26 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
>> "setup-x86_64.exe" [1]
>> Actual size: 0
>> 
>> ^C
>> 
>> 
>> I tried the script above on:
>> - WSL from my home PC
>> - WSL from my office PC
>> - bare metal Linux located in my office LAN
>> - DigitalOcean droplet located in New York
>> - DigitalOcean droplet located in Amsterdam
>> - VPS hosted on Aruba located in Italy
>> - Amazon Lightsail located in Frankfurt
>> 
>> And I always have similar results...
>> 
>> Ciao,
>> Michele
>> 
>> --
>> Problem reports:      https://cygwin.com/problems.html
>> FAQ:                  https://cygwin.com/faq/
>> Documentation:        https://cygwin.com/docs.html
>> Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple
> 
> -- 
> Problem reports:      https://cygwin.com/problems.html
> FAQ:                  https://cygwin.com/faq/
> Documentation:        https://cygwin.com/docs.html
> Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple


-- 
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple