DKIM-Filter: OpenDKIM Filter v2.11.0 delorie.com 49M8MQBG2782600
Authentication-Results: delorie.com;
	dkim=pass (1024-bit key, unprotected) header.d=cygwin.com header.i=@cygwin.com header.a=rsa-sha256 header.s=default header.b=sYxh8muc
X-Recipient: archive-cygwin AT delorie DOT com
DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 234BB3857B91
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cygwin.com;
	s=default; t=1729585345;
	bh=Jdk+uL/02gNhJfUFxiKVxzoF7PfqX9z4a7VNNoj843o=;
	h=References:In-Reply-To:Date:Subject:To:Cc:List-Id:
	 List-Unsubscribe:List-Archive:List-Post:List-Help:List-Subscribe:
	 From:Reply-To:From;
	b=sYxh8mucAdgrevnk67K1KQBFzrm39Ayqx5Zzu1IEP6yniZXOjFlNyyyfTxggpwoUv
	 RUOSKklgjme1pkbumSEMUNSxmWL5ZlY4yz4+UmsLX2Ih5oe1HmKdqoR0te2fxY55LL
	 hE+zcQwr8V0Q3pHOeZSc5xCSX4HrAryX4b1zAvJY=
X-Original-To: cygwin AT cygwin DOT com
Delivered-To: cygwin AT cygwin DOT com
DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org DD2CB3858CD1
ARC-Filter: OpenARC Filter v1.0.0 sourceware.org DD2CB3858CD1
ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1729585324; cv=none;
 b=eI2QtKvMUsHTykv2QATeXcWpXrdHsLF/B2g5EJIGcr+mB/we9v9CUvhaiBh4V94L1cBnEe/VkkpKWgd3fCbYcu1TDxERXadUHQQkhT+OIhKqm832mwXQBOpGC9zufqsU1IuBr6Lyf0NyLa+CQgOn52iLMeP/9ErOuosjx+Bo7zQ=
ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key;
 t=1729585324; c=relaxed/simple;
 bh=TQ5FytQlKwn+lRLqWFMqk1XWXjSSfv7xmrce4e9GT2s=;
 h=DKIM-Signature:MIME-Version:From:Date:Message-ID:Subject:To;
 b=etsWtqMa1tupUy2nkPCsLjyhYLvjFMpSL4mwbVbmuiM1msdDw7DHsIurUPSSc7UM3Y7MlMc9AAMzOTTf6J284IqrI/2gDmb77K883gKfXwtz9rDMXzeE2R41TRP7tYkEnxs1ZiMM0ubMob6Vx+0vlF4Xdhsqi7glCc/y22pzKLk=
ARC-Authentication-Results: i=1; server2.sourceware.org
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20230601; t=1729585314; x=1730190114;
 h=cc:to:subject:message-id:date:from:in-reply-to:references
 :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id
 :reply-to;
 bh=I2fmKeehYnGk/132paFdtrPRn2HKi0dNLn3H4gpUTh8=;
 b=jnUtwKurIYZpmLi7nft+a9i2b5y0nFgGTnKsSzzULGxBPWONY7m/YFx39KE+JXqbv4
 vknQAuEmWDZhzFsgtOIGHy5Pk4hytFn/a2+sgLWoM/MR0c8T1TG/jzuo1suEQaFOUAxm
 /wkGvu4warxy4kPxUh9pDavp5sb1F+CmNZOWJJSpfsV/IaYe9EiKxpkaGvSLLNL8PJ4z
 mc/AfYedQa+/q2zgcQL4xJVrAOu2ypAYdaAKip95hw7Vl0mCX4MAIHDtorKXrQFgiOD6
 Qi0GeJQC3Ija/oz7kIs/eILElyTVgxmUGX4YJY7M9+85jeh80drdwTME/wqqfhkhR1ea
 /qjw==
X-Gm-Message-State: AOJu0Yyi+WxAFK/rkVE8j8vlha5bqtPmdHHrryHA6ZfZF+HQWL8TAjiQ
 ZyRRlv63RTiMswYKe3r+Xob2S3TyKAhMGX5gt7wvvMTvtuZtElJDFY5N2b6HUjgH12XJ9wvVU5+
 hUDNe9qeRFkmE3Z6PPvVAoT4kLZsaLNP4gKAGykJveVbxtpzddgo=
X-Google-Smtp-Source: AGHT+IGGclt5CtkPGFZ8wk2+tSrxZxRKIC/1VKg3G0Dgim9J/NAtz/98yyB4eNNyAtMs4bq4khr/8YUhYNDMBlZ0LT8=
X-Received: by 2002:a05:6512:2314:b0:539:f51e:2465 with SMTP id
 2adb3069b0e04-53b139e803fmr865512e87.22.1729585313955; Tue, 22 Oct 2024
 01:21:53 -0700 (PDT)
MIME-Version: 1.0
References: <CAGen01ickv9cenzeT3SkV9buugEh5CSGW-JWKkWfHUQUsCoVxg AT mail DOT gmail DOT com>
 <52556213-2914-449d-a719-e1a0826f6ba1 AT dronecode DOT org DOT uk>
 <CAGen01iESMAAzWL+hdp2nNpCBHiD0fhsuK-Fhw6yyFDSzV388A AT mail DOT gmail DOT com>
 <CAGen01gf91LXQrLp32DWbVFkAHn2A92WqjQOmwRm3LMtoZR2Nw AT mail DOT gmail DOT com>
 <d98dc0e8-d6be-47c6-af8f-fae93fd04bbf AT SystematicSW DOT ab DOT ca>
 <CAGen01j1FUAA0XAhH1ygEC30Bjvq2DPaWKhJ5CSoabh7trcSHg AT mail DOT gmail DOT com>
 <af8da25d-d290-4db3-8343-dee5587f5fe3 AT systematicsw DOT ab DOT ca>
 <CAGen01jySbjiKh1GkyP_LfkhVYTv4TRpm1TMJri+j4VkA09ekA AT mail DOT gmail DOT com>
In-Reply-To: <CAGen01jySbjiKh1GkyP_LfkhVYTv4TRpm1TMJri+j4VkA09ekA@mail.gmail.com>
Date: Tue, 22 Oct 2024 09:21:43 +0100
Message-ID: <CAJQQdJigOqN=+NwtY=MR2q5DEBiUas_9NqsUD9UXyXQNEa9sVg@mail.gmail.com>
Subject: Re: Installer freezes in windows-2022 GitHub Action
To: Michele Locati <michele AT locati DOT it>
Cc: cygwin AT cygwin DOT com, Brian Inglis <brian DOT inglis AT systematicsw DOT ab DOT ca>
X-Spam-Status: No, score=1.3 required=5.0 tests=BAYES_05, DKIM_SIGNED,
 DKIM_VALID, KAM_EXEURI, RCVD_IN_DNSWL_NONE, SPF_HELO_NONE, SPF_PASS,
 TXREP autolearn=no autolearn_force=no version=3.4.6
X-Spam-Level: *
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
 server2.sourceware.org
X-BeenThere: cygwin AT cygwin DOT com
X-Mailman-Version: 2.1.30
List-Id: General Cygwin discussions and problem reports <cygwin.cygwin.com>
List-Archive: <https://cygwin.com/pipermail/cygwin/>
List-Post: <mailto:cygwin AT cygwin DOT com>
List-Help: <mailto:cygwin-request AT cygwin DOT com?subject=help>
List-Subscribe: <https://cygwin.com/mailman/listinfo/cygwin>,
 <mailto:cygwin-request AT cygwin DOT com?subject=subscribe>
From: David Allsopp via Cygwin <cygwin AT cygwin DOT com>
Reply-To: David Allsopp <david AT tarides DOT com>
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Sender: "Cygwin" <cygwin-bounces~archive-cygwin=delorie DOT com AT cygwin DOT com>

On Tue, 22 Oct 2024 at 09:02, Michele Locati via Cygwin
<cygwin AT cygwin DOT com> wrote:
>

More data-points - running from a couple of networks here in the UK,
but adapting your script to display the x-cache header as well:

Downloading https://cygwin.com/setup-x86_64.exe multiple times (press
Ctrl+C to stop)
x-cache: MISS from cygwin.com
Actual size: 1407507

x-cache: MISS from cygwin.com
Actual size: 1407507

x-cache: REVALIDATE from cygwin.com
Actual size: 1407507

x-cache: REVALIDATE from cygwin.com
Actual size: 0

<10 more REVALIDATE with Actual size 0>

x-cache: MISS from cygwin.com
Actual size: 1407507

x-cache: REVALIDATE from cygwin.com
Actual size: 1407507

x-cache: REVALIDATE from cygwin.com
Actual size: 0

x-cache: MISS from cygwin.com
Actual size: 1407507

x-cache: REVALIDATE from cygwin.com
Actual size: 1407507

x-cache: REVALIDATE from cygwin.com
Actual size: 0

so there seems to be a pattern. Isn't that x-cache header coming from
Apache's mod_cache (i.e. something at the cygwin.com/sourceware end,
not any CDN sat in the way)? Having _never_ seen anything like this
from cygwin.com before, and the fact it's happening on diverse
networks, my debugging intuition would be to find out if sourceware
reconfigured anything last week before trying to engage in the futile
task of contacting any network providers......

All best,


David


> Il giorno mar 22 ott 2024 alle ore 06:28 Brian Inglis via Cygwin
> <cygwin AT cygwin DOT com> ha scritto:
> > I typically use wget -N -nv for downloads, without any issues for decades, on
> > any service.
>
> Hello Brian,
>
> thanks for the reply!
>
> It seems the problem occurs when we require the same URL from the same
> IP multiple times.
> This occurs for example in GitHub Actions, where the cygwin server
> sees just one or few IPs for the whole GitHub system).
>
> You can "simulate" it by using curl (or wget or any tool you prefer)
> by forcing the download of the same file multiple times.
> Consider for example the following script:
>
>
> #!/bin/bash
> set -o errexit
> set -o nounset
> set -o pipefail
> url=https://cygwin.com/setup-x86_64.exe
> filename="$(basename "$url")"
> printf 'Downloading %s multiple times (press Ctrl+C to stop)\n' "$url"
> while :; do
>     wget -N -nv $url
>     size=$(cat "$filename" | wc -c)
>     rm "$filename"
>     printf 'Actual size: %s\n\n' $size
>     sleep 1
> done
>
> Please remark that I used wget like you wrote, with the difference
> that I delete the downloaded file before performing another wget call.
> This "simulates" different wget calls from different PCs, but seen by
> cygwin.com always with the same IP.
>
> I always have results similar to the following:
>
> Downloading https://cygwin.com/setup-x86_64.exe multiple times (press
> Ctrl+C to stop)
> 2024-10-22 09:52:10 URL:https://cygwin.com/setup-x86_64.exe
> [1407507/1407507] -> "setup-x86_64.exe" [1]
> Actual size: 1407507
>
> 2024-10-22 09:52:14 URL:https://cygwin.com/setup-x86_64.exe
> [1407507/1407507] -> "setup-x86_64.exe" [1]
> Actual size: 1407507
>
> 2024-10-22 09:52:16 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
> "setup-x86_64.exe" [1]
> Actual size: 0
>
> 2024-10-22 09:52:18 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
> "setup-x86_64.exe" [1]
> Actual size: 0
>
> 2024-10-22 09:52:20 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
> "setup-x86_64.exe" [1]
> Actual size: 0
>
> 2024-10-22 09:52:22 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
> "setup-x86_64.exe" [1]
> Actual size: 0
>
> 2024-10-22 09:52:24 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
> "setup-x86_64.exe" [1]
> Actual size: 0
>
> 2024-10-22 09:52:26 URL:https://cygwin.com/setup-x86_64.exe [0/0] ->
> "setup-x86_64.exe" [1]
> Actual size: 0
>
> ^C
>
>
> I tried the script above on:
> - WSL from my home PC
> - WSL from my office PC
> - bare metal Linux located in my office LAN
> - DigitalOcean droplet located in New York
> - DigitalOcean droplet located in Amsterdam
> - VPS hosted on Aruba located in Italy
> - Amazon Lightsail located in Frankfurt
>
> And I always have similar results...
>
> Ciao,
> Michele
>
> --
> Problem reports:      https://cygwin.com/problems.html
> FAQ:                  https://cygwin.com/faq/
> Documentation:        https://cygwin.com/docs.html
> Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple

-- 
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple