X-Recipient:	archive-cygwin AT delorie DOT com
X-Original-To:	cygwin AT cygwin DOT com
Delivered-To:	cygwin AT cygwin DOT com
DMARC-Filter:	OpenDMARC Filter v1.4.1 sourceware.org 1BD933860825
Authentication-Results:	sourceware.org;
	dmarc=pass (p=none dis=none) header.from=cornell.edu
Authentication-Results:	sourceware.org; spf=pass smtp.mailfrom=cornell.edu
ARC-Seal:	i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none;
	b=TdQxzi6eCaksOMo0FOOaXOkqNx/lCatqozbGfhN7ghY+Y0gEkLbqZPMeATQ4egZ2fTVUlaF8GsUeyoTOxiZnfqrHrvTr71BQ5dm/oRxLcCin3OIMPNUTEZtCDeSjtHN6X5tgRTLbBr7YcohDbDtUAgnA2bPUwSdYNurzreaXj2tFxl4ZrETuFoSr3GJErP80wAn7hFzoOjeX6jC5p8HnLqPgi9v4qbBrz9lJTyy1CEN/GHnyOcCGJRW8Mah2oF2wPKtgbb7RUYbgm2ysYPqo9W2bPlDY4RHN1aTr4YQnb0KhYXl7JJ2McVCSZhojOc5dLu/OosyA+klEAijfjmEDYQ==
ARC-Message-Signature:	i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com;
	s=arcselector9901;
	h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1;
	bh=MpBvTvV1jqfwUYVPndOiB+97M+rN+KOWMRe9U/tkyU0=;
	b=WxMvxmfc+Din1laLaieYbTLVb3f0zrKuQU1TK9KT49p+JRwsygYF8Bk+z7ZRTiZO2DkfnZ8TJlMYee75lrvkLmlI16nxjUqAkIRQ5ZV2yQD1Cjpf4dVgpQN2FN2aQKJ8Zm2WRXGBS0SmXGB5Cs4M0ko125PisWjMX2LB3+ErFJ9PPiwkUfSFC0nzgHqaHbjTig1kbGQrCR/QWkLCzcxK5F0XuqsaLse7OgHBDKhYr6zLGrForNxMWIrch3xD558r1tkrXSBpNFhK0Xu6CLsgVIIdlnfd24N0zzAUNx2rEqmHC4ux64KORlDzmzg/I5hqJJV5782iBHvR5vpfzaEMEw==
ARC-Authentication-Results:	i=1; mx.microsoft.com 1; spf=pass
	smtp.mailfrom=cornell.edu; dmarc=pass action=none header.from=cornell.edu;
	dkim=pass header.d=cornell.edu; arc=none
DKIM-Signature:	v=1; a=rsa-sha256; c=relaxed/relaxed; d=cornell.edu;
	s=selector2;
	h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
	bh=MpBvTvV1jqfwUYVPndOiB+97M+rN+KOWMRe9U/tkyU0=;
	b=DWxY4+hkbhzBc9k9McyTZAiophBTMhPYX+dTiAujiXJi0wbO1zPig0XxqjRYGAT1rUtjEBRB5N0Z3u2SGl6jx9XXKhCzlVTmfBLXBPnhgO/wQLQ7XtwGWe2kCSDp07ZHgaiIu0iYm8lLxdHxjNGkwgS3j+pYScE1JKV33oK/8qY=
Authentication-Results:	dkim=none (message not signed)
	header.d=none;dmarc=none action=none header.from=cornell.edu;
Message-ID:	<09d8cb84-b3e3-0760-2245-0f3d2154c023@cornell.edu>
Date:	Mon, 21 Mar 2022 11:09:57 -0400
User-Agent:	Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101
	Thunderbird/91.7.0
Subject:	Re: GNU make losing jobserver tokens
To:	cygwin AT cygwin DOT com
References:	<9b9da583-124d-9d5f-4c10-6622602ca8dc AT oracle DOT com>
From:	Ken Brown <kbrown AT cornell DOT edu>
In-Reply-To:	<9b9da583-124d-9d5f-4c10-6622602ca8dc@oracle.com>
X-ClientProxiedBy:	BL1PR13CA0090.namprd13.prod.outlook.com
	(2603:10b6:208:2b8::35) To BN7PR04MB4388.namprd04.prod.outlook.com
	(2603:10b6:406:f8::19)
MIME-Version:	1.0
X-MS-PublicTrafficType:	Email
X-MS-Office365-Filtering-Correlation-Id:	ea45f7b9-b517-4605-9514-08da0b4cdd80
X-MS-TrafficTypeDiagnostic:	BN7PR04MB4291:EE_
X-Microsoft-Antispam-PRVS:	<BN7PR04MB4291FF51CCD6A833A83C1051D8169 AT BN7PR04MB4291 DOT namprd04 DOT prod DOT outlook DOT com>
X-MS-Exchange-SenderADCheck:	1
X-MS-Exchange-AntiSpam-Relay:	0
X-Microsoft-Antispam:	BCL:0;
X-Microsoft-Antispam-Message-Info:	ExcCUfXUKRe18DoFUhjElQBN7wX6iDduppeAehQFDeh0u1VXfbP/NwjXafA75iVs40Wjd2kkj2kjp370Ek07xQ+k79XPlTYSJdzYTaH3W/FTG67h5/vPsPwkzcfbonFWTGQdNUMPYS8OMCBCjWWtMFD+HlzUGyu8YiHMyfc7yb3pQPyGpwICaecy76f+20MscKmGlktG+jH4u3uEgQBX/J19jxncHSh/dpFlIxeRJ4zf8rjlwOYyA8ZX0K/0bqz/mN7taCkxtYLDVtnj3s1WT36xSNCLNcBVAPMdzp0GD8S9/5jzmGqdGa9bCQV7Z77D2N5T3fY1DXVRhP+CKiN5egImk4xULv8N6NS0r7qYAnHLz/tTPP89+TRGw/mkMTM+134wWvuNg/yuu0EwbDBqYJ6k8zb+Cx/oOTZ+S15toS6I+IDL1TaoyUkFsfqYgqin+prKWkd6zDQamXQvDy/HUcodNNomfjNs68LumoQp6c27mNozZs9B+QLjHtjg3kYIUFN/rN6p0iEyteXrz2UCNbNvUAKhlMi7NIouizHrJEG6TMXT1z+8zgQYyyuYC3D9UBKzgTJukvUgzJUCpjdVEcJ1UxDiKgS9/hieEn3f03IsN4pC0RFNnwBWP8HsLUPHqchtoBGd4WXXzgetuXvvsVAdvlGNcZ97Ko78L5Igzhfy5qUPGVDeh8jmMstXzmqscb3eaCCpzacNH31qyZxcs4IIUEeB/OLr5F8H0im27vA=
X-Forefront-Antispam-Report:	CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:;
	IPV:NLI; SFV:NSPM; H:BN7PR04MB4388.namprd04.prod.outlook.com; PTR:; CAT:NONE;
	SFS:(13230001)(4636009)(366004)(186003)(38100700002)(2616005)(8936002)(6916009)(5660300002)(66476007)(66556008)(66946007)(8676002)(31696002)(2906002)(508600001)(53546011)(6506007)(316002)(786003)(75432002)(6512007)(6486002)(36756003)(86362001)(31686004)(43740500002)(45980500001);
	DIR:OUT; SFP:1102;
X-MS-Exchange-AntiSpam-MessageData-ChunkCount:	1
X-MS-Exchange-AntiSpam-MessageData-0:	=?utf-8?B?SUJ3RzRPVHNna0NlNVpwYzBOdW1tTnZ2aUxYbVZFSjlodHFMSWk1RWpoWXdW?=
	=?utf-8?B?OXFaYTc3dUt6dTBJckVQenpUVWtZaVdmMUNDWFNQeWprTWRZeUdhV0phQVRz?=
	=?utf-8?B?bVNMNTB3Q0Vpdi82NnNMWHUrSkhrV05wVExvWE9qMW12c0x3QXpjRG41M1p4?=
	=?utf-8?B?bHpVby9aKzFYSnpRa2Z2andzYXRZWEcxd21NbW9DQjNvZEJHbEdYaWd1TkpN?=
	=?utf-8?B?NG1kYmZxZWx6alZVTXFpSGN6YzBQUE1RZ2RVV0JNQWhZWEJRQmVvMXMyWW00?=
	=?utf-8?B?d0lXdnA2Nm5oOWNtTXlac3g0MGszelZMQVBlYzNqZUdFSmtEb2NTL0t5L1lM?=
	=?utf-8?B?N1VlZlV2amUyUzUvR1VYZEp4R3U3a0lIM3M1Yzl0Z1pGd1djTDQzdGwvc3Z3?=
	=?utf-8?B?Tk91SHJOS2kzYk1zSCt5M3E0MG9paWVmcnlFVGFhOUcrNG1hNjgxSitVcUlt?=
	=?utf-8?B?RVNHMUFFVVBZdzlUQnkwTzFNcXNqVXgydDM3N0JYWDlJR1kvcnNab2YvWmtk?=
	=?utf-8?B?aGFDWlJZb2pKRXBMSk5CT2E5ZnQxdm55VDZzZFAxaTVZaEx5SXBvdHI2M1h0?=
	=?utf-8?B?bWdKcU52bjRvQ256bEJDT3JLZ1YxVkkzeHA4RHR2Z2IvZFh5OUFSMEx1dXJq?=
	=?utf-8?B?bFVzaUJIbm1wSVFqT3pHMnBqalhGb1cweWZldGpac1RET3lSUDhDZUd5Um1n?=
	=?utf-8?B?TFZwNXFwRVdrSFY5bjNTZWszQXpkbEFIYWFhQkFId1VYT0dmYzNVVUZIZjd2?=
	=?utf-8?B?NjhFeTBYaE9IVEhpSSs3NFNmZ0lnM2RGbnBaMlNORGFudmFNY1IwSy9FV25B?=
	=?utf-8?B?b1B5UnhsS3VwUmFsNlN2MWdmdWNKZEZyTjJlVFh6MjBLQzVNS2NOcTlmNHdM?=
	=?utf-8?B?azlLelB6UlhadkVYdHlSUkhkTEROd0RLWjFCdlp5Y0xBdnRFV3ZLRWM3Wk53?=
	=?utf-8?B?bWt3NC9NQnZBanVvcXFHU0JFVGV5MFN0VFZSbFBEZnV0cWJ4bW9BR0tSUzdG?=
	=?utf-8?B?aHNGMXA5dm00OUc0SmNKNU9uN2hVd08rekxXNU5zdG9uWGZBSkJSVW9iZU5o?=
	=?utf-8?B?TW96a0RaMG5qOStrdUlYakRxK3doajI4bi9CV0FySzRoeUFDVUhtSlFyaXRi?=
	=?utf-8?B?bG9IRWpLTTEyeEhtWk9YOGNHNkk5N0l1REgzK05KTXZDQ0R3R1l5RkQrT2dB?=
	=?utf-8?B?WGgyUzcyVVNLWURoTUlpQ1Z6bUxaRDhVNmZ4MnZFOFpUaWZUR0RXTjFSSVFM?=
	=?utf-8?B?eW50SVNpNkhKemVqZnlpdkxIYWd2QVRtQ0p3aWdmaDFET2ljYlcvekUrVHhz?=
	=?utf-8?B?TWRTWTd0N0hVLzJsVUhBcW1mSGtPVGI4bDB2NEh4UXlQN2N2eGZIc25ZWVJB?=
	=?utf-8?B?QVhaV0hyWmwrRHhOQ213RmQycDhySlcxNlZ6NnB2ZzRNd3RwY0p2WDdZelFM?=
	=?utf-8?B?RkRwOWVpU2t6bEExczduVFZyVWhBQW1FeGlZR2JZdGptUmFPRkYxK2NBNWZz?=
	=?utf-8?B?eFV5cTdMVWM5TUM2VXNWREJYZFliMnYzWE9lYlFId0wzM09RWUQzelYrN3Jh?=
	=?utf-8?B?SlpxTzBRUUswdExJMi9ENjlxME9seGpRWktBYk0xN1NIakNKWGNZS0hkVDZT?=
	=?utf-8?B?Z0hNQTV6RTRVNHZvMjl1WkllMkx2UFd5NkE5NnF3MjRNMTE5UUMxOHF5NVZR?=
	=?utf-8?B?bHRKYVJXa0VuTHhrVFM1ZE8vSlU2Yko2a0FHc0tScWV0SkVDYk9oYUVKU0Q3?=
	=?utf-8?B?NFBqMVVQYWJPNUh2SjE3YURTMTNGQlM5eE5VOWY3dWVIOEFEbDlYRTVMWmY1?=
	=?utf-8?B?UEtXUTljL3phOXQzRWJsT2dhYUZvL3pGaWdxUncvT0RaTEZEL3BvL2VHdUNN?=
	=?utf-8?B?WlFQK1VRSGpwN1ZkVVdkVExEd1pLVDlUbVB1cTIrRWVBalZzcUN2SXhSazFt?=
	=?utf-8?B?K2Y2S0N5dFRuSWRVK3A2OE9nSjJXQ1I5TFlDWjBiNi94QVpvUEpyS2V2aURk?=
	=?utf-8?B?ck90NUZyS1ZST3g5ZnZKVlNFZU8yR2Uwa0F5UVc2WnF2UThKaFpxYndkTlZx?=
	=?utf-8?Q?9t0TzY?=
X-OriginatorOrg:	cornell.edu
X-MS-Exchange-CrossTenant-Network-Message-Id:	ea45f7b9-b517-4605-9514-08da0b4cdd80
X-MS-Exchange-CrossTenant-AuthSource:	BN7PR04MB4388.namprd04.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs:	Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime:	21 Mar 2022 15:09:58.9207 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader:	Hosted
X-MS-Exchange-CrossTenant-Id:	5d7e4366-1b9b-45cf-8e79-b14b27df46e1
X-MS-Exchange-CrossTenant-MailboxType:	HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName:	hM3LxGwgyvhJ87CFE4PbPsZddsBObCTKnXHXitfcGv1jMvHRG211dd8QbgiWUxgLmMNnf99WIJf75jBcKQ86qA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped:	BN7PR04MB4291
X-Spam-Status:	No, score=-1.1 required=5.0 tests=BAYES_00, DKIM_SIGNED,
	DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, NICE_REPLY_A, RCVD_IN_SBL_CSS,
	SPF_HELO_PASS, SPF_PASS, TXREP,
	T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.4
X-Spam-Checker-Version:	SpamAssassin 3.4.4 (2020-01-24) on
	server2.sourceware.org
X-BeenThere:	cygwin AT cygwin DOT com
X-Mailman-Version:	2.1.29
List-Id:	General Cygwin discussions and problem reports <cygwin.cygwin.com>
List-Unsubscribe:	<https://cygwin.com/mailman/options/cygwin>,
	<mailto:cygwin-request AT cygwin DOT com?subject=unsubscribe>
List-Archive:	<https://cygwin.com/pipermail/cygwin/>
List-Post:	<mailto:cygwin AT cygwin DOT com>
List-Help:	<mailto:cygwin-request AT cygwin DOT com?subject=help>
List-Subscribe:	<https://cygwin.com/mailman/listinfo/cygwin>,
	<mailto:cygwin-request AT cygwin DOT com?subject=subscribe>
Errors-To:	cygwin-bounces+archive-cygwin=delorie DOT com AT cygwin DOT com
Sender:	"Cygwin" <cygwin-bounces+archive-cygwin=delorie DOT com AT cygwin DOT com>

On 3/21/2022 10:28 AM, Magnus Ihse Bursie wrote:
> Hi,
> 
> I'm working for Oracle on the OpenJDK build team. We're using GNU make to build 
> the JDK on all supported platforms. For Windows, we use Cygwin as our build 
> environment, including the Cygwin version of GNU make.
> 
> We have had a long-standing issue with make losing jobserver tokens. 
> ("long-standing" here means for years, and years, at least since GNU make 4.0, 
> up to and including the current latest version in Cygwin.)
> 
> Most runs end with something like:
> 
> make[2]: INTERNAL: Exiting with 11 jobserver tokens available; should be 12!
> 
> Since the build still succeeds, and it just affects performance (and typically 
> not that much), we have not spend too much time getting to the bottom of this.
> 
> Now, however, I've come across a machine where this happens repeatedly, and on a 
> much worse scale:
> 
> make[2]: INTERNAL: Exiting with 1 jobserver tokens available; should be 24!
> 
> This effectively turns the highly parallelized builds into single-threaded 
> builds, and is absolutely detrimental for performance. On the flip side, this 
> also makes for the perfect testing environment to really get to the bottom of 
> this issue.
> 
> I started out by sending a question to bug-make AT gnu DOT org. The folks over there 
> reported that this was not a known problem with GNU make on Windows in general, 
> and that as far as they knew, the mingw port did not suffer from this problem.
> 
> Instead, they suggested that it was a Cygwin-specific problem, possibly related 
> to issues with emulating Posix pipes and/or signals in Cygwin.
> 
> So, my first question is: Is this a known problem in Cygwin GNU make? Are there 
> any workarounds/fixes to get around it?

No, it's not a known problem.

> Otherwise: Any suggestions on how to go on and debug this? I am willing to build 
> and test an instrumented debug build of make, but I will need assistance to find 
> my way around the source and spot likely candidates for the source of the problem.

For starters, is your Cygwin installation up to date?  Cygwin's internal 
implementation of pipes was overhauled starting with cygwin-3.3.0.

Ken

-- 
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple

- Raw text -