X-Recipient:	archive-cygwin AT delorie DOT com
DKIM-Filter:	OpenDKIM Filter v2.11.0 sourceware.org 51E703861836
DKIM-Signature:	v=1; a=rsa-sha256; c=relaxed/relaxed; d=cygwin.com;
	s=default; t=1617113926;
	bh=iGR6X7Hrp5X0uoy/Iyp0F0ry9t63fM1wIigvKwVnUQc=;
	h=Subject:To:References:Date:In-Reply-To:List-Id:List-Unsubscribe:
	List-Archive:List-Post:List-Help:List-Subscribe:From:Reply-To:Cc:
	From;
	b=rvvF4UV3d4HJYjWAElQP9wLi/ohtcGjPF6u9jEKdvuHi9krczc0W13/llq2E2x5f/
	neU88B+21X5HNN5pNaJViGRa/9W0b081BEi05uL7RRQpdG7I0QZbBGjBfGlBYDAzby
	cgLm6Sd+WHVQYpvJOiFku7AQ4B5XLn9pNCLiXBSc=
X-Original-To:	cygwin AT cygwin DOT com
Delivered-To:	cygwin AT cygwin DOT com
DMARC-Filter:	OpenDMARC Filter v1.3.2 sourceware.org A6C8D3861821
ARC-Seal:	i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none;
	b=Bm8hjXyUHrcHU8RLddARYaBsBpt83XWrDGEicvR7ttJGjToo5mPMEWY64jDyWQeJ8oQy5tqa3fGJdmnj4pZ9FgkzbGlZr+uhc7MeYfImsmuXkoytkCBXo8h2dppA/+6ie23jsXkMx7/KgkycVsFiMGEJ2Sn4K65WMWRCRfUiez95QcYflDsXCMaDAQknrm0SmAgZZUpu2ShKfmnRO9B6y8UH98hT4VeSD7N94kqpaOp+ZjUrGxYPJyaCQSkybvFUECU3tDeA1GsihnFI2ozFb8lDoXJLC78U7raTP7SWE5kwuF+WFCyHuSwXgceLy0SgYZB2wOCEqMCbhrCcOZoC6A==
ARC-Message-Signature:	i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com;
	s=arcselector9901;
	h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
	bh=hILPICSFF6GAvT669/eO5SvzqiATBUnd9GApQx64NhM=;
	b=j9JE1gTB2KwMZpYC0BiLQdsjMK6F7xuKVdN7KFIXc1iZ5H52a0KwvO9k5iEqZdysIGTBYD6l2m6TVwanltwME9BDhAM+Q3cIp0Fr3Pqqu4818pnlZAiUsprIsGjBv/340ZGujAKOWz08vD+9AaZzW1UAmGdnS8UdAATLGD77Df6sD8Z/iE+IrQT9hwVvOVvVUHqA0V/ZFRjUCYIRnzojZ0KXmLAMah/ZKYFPXXmij1eqgDqTGLoKvV+Ioe46d45Fhi3EG4v/tELI2D6qLSqvoN4K2dhnDkjLnYS15CUJo5EPt7sN3ZKjEQK3G6gA7nWdjwSAEpqMoRNdlX23UNJ8Gw==
ARC-Authentication-Results:	i=1; mx.microsoft.com 1; spf=pass
	smtp.mailfrom=cornell.edu; dmarc=pass action=none header.from=cornell.edu;
	dkim=pass header.d=cornell.edu; arc=none
Subject:	Re: AF_UNIX/SOCK_DGRAM is dropping messages
To:	sten DOT kristian DOT ivarsson AT gmail DOT com
References:	<04cc01d71ffa$7d1e6cf0$775b46d0$@gmail.com>
	<YFo/fFC2bITvnVGr AT xps13> <00d901d7208e$97c05c50$c74114f0$@gmail.com>
Message-ID:	<860668bf-8cf9-0969-6a01-7fbf8b782db1@cornell.edu>
Date:	Tue, 30 Mar 2021 10:17:13 -0400
User-Agent:	Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101
	Thunderbird/78.9.0
In-Reply-To:	<00d901d7208e$97c05c50$c74114f0$@gmail.com>
X-Originating-IP:	[24.194.34.31]
X-ClientProxiedBy:	BL0PR01CA0023.prod.exchangelabs.com (2603:10b6:208:71::36)
	To BN7PR04MB4388.namprd04.prod.outlook.com
	(2603:10b6:406:f8::19)
MIME-Version:	1.0
X-MS-Exchange-MessageSentRepresentingType:	1
X-MS-PublicTrafficType:	Email
X-MS-Office365-Filtering-Correlation-Id:	f387f504-8838-4d18-403f-08d8f386b7ef
X-MS-TrafficTypeDiagnostic:	BN8PR04MB6370:
X-Microsoft-Antispam-PRVS:	<BN8PR04MB63708319C64A022B8C45A6A1D87D9 AT BN8PR04MB6370 DOT namprd04 DOT prod DOT outlook DOT com>
X-MS-Oob-TLC-OOBClassifiers:	OLM:9508;
X-MS-Exchange-SenderADCheck:	1
X-Microsoft-Antispam:	BCL:0;
X-Microsoft-Antispam-Message-Info:	rmDyu6emVPbTtxcphiz6tlEkBt5tBPUFC+bwP93rKlV9yFlpDNTj2wq0K3HNMKf7zqauZD0+wRpPSiEQtbaBBgJfhtoUp6UTmg2AZrHLweLrr2Xo6GdEHrDqQgi9M2ARBqt75hAeAPBe65E0136pHHAC9uSvbcM+RJfQhxStDQ/oohHiPGsviQRudGAMWbZsQRSdFd86zXYdCBhQdXEiHnOohivcUVbE0aRZqPqktsj5/hlsR5trRurUV1DL/PhtSbniWZhYL5K24P0yYEU4cQjXv622qJVA3wjikkxKX3jDDJbee+0BWiamxOumi7le/6MekL2S+Tl8As/n0vHBIxMxYWQA3bXdOFO6LksJTEAlPZ5dvwolI9clYDxQSvoPSBqJ6dWkIOxLvqxHgt+b+Z/C1Gl51iTZ5oJeaM1UroMZ3yyVAZoDb1XSoja9ixOv9soPw9S8laFTCQoJcHT/8p4Kqq4GZj+a6u8AIJu5ppWhNQcynO+BKY/2PRSasL0eA0DhZdwEcTb4oHPV1kxDnl39ksRpl+vJQgBubchRJyNnd0lW67gPq8KAzm72UOpHBduG80LACcL/xbNkQrEBqxzsDn+zEjc4ru7m6KzZSVxtOVvbwH6JmINhIo1/AdlOAEjK29Grwi2jS9O88yUFtua6Mmwqb2Q7onlgaHvISswSH9dt5jeu1nfWT+p8fXJ1
X-Forefront-Antispam-Report:	CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:;
	IPV:NLI; SFV:NSPM; H:BN7PR04MB4388.namprd04.prod.outlook.com; PTR:; CAT:NONE;
	SFS:(4636009)(396003)(376002)(136003)(366004)(39860400002)(346002)(31686004)(38100700001)(16526019)(186003)(478600001)(2906002)(15650500001)(4326008)(26005)(16576012)(31696002)(66946007)(6486002)(8676002)(53546011)(6666004)(786003)(86362001)(83380400001)(316002)(8936002)(6916009)(2616005)(36756003)(5660300002)(75432002)(52116002)(956004)(66556008)(66476007)(43740500002);
	DIR:OUT; SFP:1102;
X-MS-Exchange-AntiSpam-MessageData:	=?Windows-1252?Q?/ioICv0JXMKorjetLDHQTVakZLcoP83G9tQNTlpsoVj7pJ65DeN8Oa61?=
	=?Windows-1252?Q?eUrzX01mYQxGgwtOhh0HQhJWk2u/bnVDA4BInMMXkx+2XZzK+++CZA7H?=
	=?Windows-1252?Q?OgtTQkPmr9zfRpLilFu+WyUgWdJrkNjx1JjG1m35DR5wgdlooCMfHQgg?=
	=?Windows-1252?Q?3laRX2ezAzi3Tu1ZxtIxGp+Q0UEz/skvWvhGLyB18Y1urP8EuS+gg5zs?=
	=?Windows-1252?Q?+Xg3Xx09hi9/EiT13nfBfu7xfyNMlP4Xrzh2FmJUG3nL67kVVE47aJ+v?=
	=?Windows-1252?Q?ECqJjCWv678w+dxfQaGevXiDQwoofovcxCOQaT1Lmss/9EJPj5G/Wxpj?=
	=?Windows-1252?Q?fWBevfzPQ0SSEAg+VMWuCBowU1WuTQY4P/Bjj1saf3mNEYA4B2813IOA?=
	=?Windows-1252?Q?OPdlUUmPetiXFzSMwyzPrt4DPG2eRZj58VO4lUQ84WKqW7oRjOfjw6Oe?=
	=?Windows-1252?Q?K8NtmJhG6i5YUWBGKdsnYpxsgRpzaZw4v08gNHFNkkg6mMgqFGH/mV3Y?=
	=?Windows-1252?Q?GEKGmOyPO5lNXAIkHAn6/enxDlIqVIgVXXDx8XSwsQox8FlBv2+XpI8I?=
	=?Windows-1252?Q?T6F/bBytJ3Ve3c1Xnm3YVhjcTwRpDWsvDikdgbz2XN2pi25MlfEb2rTW?=
	=?Windows-1252?Q?zQo2h+238N3mKlvm33cmJzP9Z3q/MUYsiHSoDyWYqJhc2slcaYXUHPjd?=
	=?Windows-1252?Q?WUOzz6/z5z3Nu8ZJph+8dch7SffrmN/yTDhHvGWHDsevXC3jiKTb5mlr?=
	=?Windows-1252?Q?KC0RyHvLXxM8TNpQNa3dsMKlremSPA0OQYIxYhN+DxJr3y3TD4TwErRc?=
	=?Windows-1252?Q?d8lCaUBuOou0Gv24uwLUCNe48refvCrRftgh+KXQsiX8qjxvOAMA47dV?=
	=?Windows-1252?Q?/+XzmURlVQeuejcPH3w6RhRwfhFrDQgb5Tw2L39pj0URr7XpR40A2Koz?=
	=?Windows-1252?Q?WcD7eKN/7lsUB5b1ENyvRyy0lQ90jvvMN769tKBZfJ/ujulKpGWrV4eN?=
	=?Windows-1252?Q?Hay+fHk9Xu8NPAjfLMUTN5O9CffFBySuo+vslZ9l1jdhLgrNVE9tmgsp?=
	=?Windows-1252?Q?E6b9JnbwyVGgD1FAqtmMh6mc/VXfigtWcDmMoLGhSPt0XUUFLq8o9G1S?=
	=?Windows-1252?Q?jsbOU4XK+TIE86RGJKDlkWg/SNxx992xJeCDhM5f7iKZLT05em4CFkS6?=
	=?Windows-1252?Q?kBJf98la9w/W5oVHneHvNkQsg94LooIQAmwRr9AGe3hKnk4PUkrmkhF3?=
	=?Windows-1252?Q?vLT7PAUYYJkrkMRoZPTFCmYw/K+UUX81+dVOwLIX22a5sHYOYayeu/Wu?=
	=?Windows-1252?Q?5p+iJarQeV4JBmRaO+vhLKf11FWPiA0z2hCRp59rLU2/FxI/JXE3ABc0?=
	=?Windows-1252?Q?WcYAISWdAOSkJpgc8B84qW8GvUP+UZmZubLdUegmg11BqA7921N3W+GQ?=
X-OriginatorOrg:	cornell.edu
X-MS-Exchange-CrossTenant-Network-Message-Id:	f387f504-8838-4d18-403f-08d8f386b7ef
X-MS-Exchange-CrossTenant-AuthSource:	BN7PR04MB4388.namprd04.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs:	Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime:	30 Mar 2021 14:18:41.2041 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader:	Hosted
X-MS-Exchange-CrossTenant-Id:	5d7e4366-1b9b-45cf-8e79-b14b27df46e1
X-MS-Exchange-CrossTenant-MailboxType:	HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName:	U3Gyr4ezwJf5C/mA+8gvA6p6/QuYeYvtRp9JutsUYFPHFppzZHTdEZY3QtShOW+0z4JHRoGqQtz//OyRbkXKAw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped:	BN8PR04MB6370
X-Spam-Status:	No, score=-4.0 required=5.0 tests=BAYES_00, DKIM_SIGNED,
	DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, JMQ_SPF_NEUTRAL,
	MSGID_FROM_MTA_HEADER, NICE_REPLY_A, RCVD_IN_DNSWL_LOW, RCVD_IN_MSPIKE_H2,
	SPF_HELO_PASS, SPF_PASS, TXREP autolearn=ham autolearn_force=no version=3.4.2
X-Spam-Checker-Version:	SpamAssassin 3.4.2 (2018-09-13) on
	server2.sourceware.org
X-BeenThere:	cygwin AT cygwin DOT com
X-Mailman-Version:	2.1.29
List-Id:	General Cygwin discussions and problem reports <cygwin.cygwin.com>
List-Unsubscribe:	<https://cygwin.com/mailman/options/cygwin>,
	<mailto:cygwin-request AT cygwin DOT com?subject=unsubscribe>
List-Archive:	<https://cygwin.com/pipermail/cygwin/>
List-Post:	<mailto:cygwin AT cygwin DOT com>
List-Help:	<mailto:cygwin-request AT cygwin DOT com?subject=help>
List-Subscribe:	<https://cygwin.com/mailman/listinfo/cygwin>,
	<mailto:cygwin-request AT cygwin DOT com?subject=subscribe>
From:	Ken Brown via Cygwin <cygwin AT cygwin DOT com>
Reply-To:	Ken Brown <kbrown AT cornell DOT edu>
Cc:	cygwin AT cygwin DOT com
Errors-To:	cygwin-bounces AT cygwin DOT com
Sender:	"Cygwin" <cygwin-bounces AT cygwin DOT com>

On 3/24/2021 5:18 AM, Kristian Ivarsson via Cygwin wrote:
> Hi Glenn
> 
> Thanks for the reply, so more below
> 
>>> Hi all
>>>
>>> Using AF_UNIX/SOCK_DGRAM with current version (3.2.0) seems to drop  messages or at least they are not received in the same order they are  sent
>>>
>>> Attached C:ish (with C++ threads though) sample program that  essentially creates a "client" that writes as much as possible and a  "server" that consumes as much as possible
>>>
>>> It seems like some buffer is filled and then messages are dropped (or at least it appears so) (if someone is about to test this, the "sleep" might need to be adjusted in order to make this happen)
>>>
>>> Hopefully it's just a flaw in our application (and sample), but as far as we can see, this should work
>>>
>>>
>>> Does anyone, perhaps named Ken, have any insightful thoughts about this ?
>>
>>
>>> const int size = BUFSIZ * 2;
>>
>>
>>>      char buffer[size] = {};
>>>
>>>      for( int idx = 0; idx < count; ++idx)
>>>      {
>>>          memcpy( buffer, &idx, sizeof idx);
>>>
>>>          const ssize_t result = sendto( fd, buffer, size, 0, (struct
>>> sockaddr*)&address, sizeof address);
>>
>>
>>>              const ssize_t result = recv( fd, buffer, size, 0);
>> ...
>>>              int index = 0;
>>>              memcpy( &index, buffer, sizeof idx);
>>
>> This appears to be a programming error, unrelated to Cygwin.
>>
>> I know that what you provided was an example test case, but you might want  to check if your app is sending way too much when the actual payload size is much smaller.  In the example you provided, you are sending 16KB instead of 4 bytes for the count.
> 
> To send a larger buffer (in this case 16 KB) is intentional, but just the sizeof int is relevant. The reason is just to send many bytes and verify that they end up on the other side in correct order
> 
> 
>> Is your code handling partial read/recv and partial write/sendto?  (It is definitely a bug in the use of recv() in the sample code.)
> 
> It was not and the updated version does not either, but that is not the issue though but I added a test to verify that the whole chunk is sent/read
> 
>> Partial reads and writes can occur more frequently with non-blocking sockets, but it is still good defensive programming to detect and handle partial read/writes.
> 
> That might be the case, but this is blocking attempts though (or maybe I've misunderstood the flags ?), but regardless of that, the test-case is not about how to handle partial writes/reads though, but to kind of show that messages seems to be lost, but of cource code need not to be flawed so thanx for the feedback
> 
> It almost seems like it is UDP-semantics and that packages can get lost or end up in non sequential order, and of course SOCK_DGRAM tells you that, but the posix description says "UNIX domain datagram sockets are always reliable and don't reorder datagrams"
> 
> It seems like when an internal buffer or so of 64 KB is filled the rest of the packages are dropped until consumed, so in this case the 32 first packages arrive in correct order but after that any random package (with index > 32) seems to end up at the "server"
> 
>> It goes without saying that if your protocol sends a fixed size chunk of data, that you should ensure that you read the entire fixed size, even if only using part of the data.
> 
> That's done in the updated version, or at least verified

Thanks for the test case.  I can confirm the problem.  I'm not familiar enough 
with the current AF_UNIX implementation to debug this easily.  I'd rather spend 
my time on the new implementation (on the topic/af_unix branch).  It turns out 
that your test case fails there too, but in a completely different way, due to a 
bug in sendto for datagrams.  I'll see if I can fix that bug and then try again.

Ken
--
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple

- Raw text -