DMARC-Filter: OpenDMARC Filter v1.3.2 sourceware.org 96EFD3833029
Subject: Re: AF_UNIX/SOCK_DGRAM is dropping messages
To: sten DOT kristian DOT ivarsson AT gmail DOT com, cygwin AT cygwin DOT com
References: <04cc01d71ffa$7d1e6cf0$775b46d0$@gmail.com>
 <YFo/fFC2bITvnVGr AT xps13> <00d901d7208e$97c05c50$c74114f0$@gmail.com>
 <860668bf-8cf9-0969-6a01-7fbf8b782db1 AT cornell DOT edu>
 <000901d72607$55dc5a90$01950fb0$@gmail.com>
 <3346cd1c-b93f-83c4-ff26-553ac95ec692 AT cornell DOT edu>
 <7c21a430-9609-7fd4-1a02-8b7c1978d2f8 AT cornell DOT edu>
 <001901d72af4$4009cd50$c01d67f0$@gmail.com>
 <134074c1-4c0b-0842-b88b-536a1ed4aefe AT cornell DOT edu>
 <000e01d7306e$3c265580$b4730080$@gmail.com>
 <19cf8626-c653-76db-a409-730a5aa5c955 AT cornell DOT edu>
 <4380cdea-c95b-d9dc-50e3-e5adabb73b92 AT cornell DOT edu>
 <000701d73151$9c259660$d470c320$@gmail.com>
 <2e64e918-b28b-753e-8337-c757cc62b9bb AT cornell DOT edu>
 <000001d731f9$58e417c0$0aac4740$@gmail.com>
 <65921e52-af84-3d2f-fd01-28e5c7866a73 AT cornell DOT edu>
Message-ID: <68a8835a-0992-296c-bf4b-28be0ff34818@cornell.edu>
Date: Tue, 27 Apr 2021 10:56:55 -0400
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101
 Thunderbird/78.10.0
In-Reply-To: <65921e52-af84-3d2f-fd01-28e5c7866a73@cornell.edu>
Content-Language: en-US
MIME-Version: 1.0
X-MS-Exchange-MessageSentRepresentingType: 1
Received: from [10.13.22.8] (65.112.130.200) by
 MN2PR16CA0037.namprd16.prod.outlook.com (2603:10b6:208:234::6) with Microsoft
 SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id
 15.20.4087.25 via Frontend Transport; Tue, 27 Apr 2021 14:56:56 +0000
X-MS-PublicTrafficType: Email
X-MS-Office365-Filtering-Correlation-Id: f5a4d486-e2d9-4695-819d-08d9098cb40c
X-MS-TrafficTypeDiagnostic: BN8PR04MB6369:
X-Microsoft-Antispam-PRVS: <BN8PR04MB63690E2D25D9A03849BAA3CBD8419 AT BN8PR04MB6369 DOT namprd04 DOT prod DOT outlook DOT com>
X-MS-Oob-TLC-OOBClassifiers: OLM:7219;
X-MS-Exchange-SenderADCheck: 1
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: jDVu4p0p3bdcf5YQ0uSCcXGF531TF3D0LfMvpTPRKU1EeAPbkGJZBeN4CoNfgtvMDQE5YJSnNJ8Pd1N/hP03/RIeJMJH9pkN5PRiAaub07IHtMTBPFqv3szRgd6FewhRPu7itO1IzbW6sqGVLgDLocyyWmB25vYoEv8Dk/s7cJirdLWbbh7dDnuksMtCs7rZAYU5Y4+74Mowbt+xk/emLuFht7PFAOKFI47j9hHGq4YFyYJEmZ2Pw9qcS6aKkz0TYzO4Jzazpdehwz01sPDI4QiWpQ+6R7261yo40FnYp0xtGWdoHguu0vJCzOWwH+JaCKnCS7X4XkyMHN9ndIFsWT9CcFgpUDe6NXbZO2npQ97vk1QRtHqsZLFNpu+YhqDn847bVwQa05arincV1025XxrwhdD0id5YNJUBPmxnaK70m1afRFYJ9w977IUw5HvqELkc1kL9W7chzF6n0jfXMjvCJwaCJKYhlsboTbsfnlmY3nVWV+pp1iynkJyGSBeGzecPKW7ooW6GvbDw6sur5rHHll/bvpRirXVs5wpXVeHr4Te7ddVg9HNwBOnFd5GUx4cL4dH7aRYD5yksVJgGoiZJVAgD8ohratH17T9/CBmbig9JrGK+MKaKAgf3YAVbpUJvH1HcokoacKBIePGwdpWdM55rTPHvrY7Tn0TlFZIW1IG3gp+q6dz23ZcNKZ4kqutWMQDU90X9xdislWF7Sg==
X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:;
 IPV:NLI; SFV:NSPM; H:BN7PR04MB4388.namprd04.prod.outlook.com; PTR:; CAT:NONE;
 SFS:(4636009)(39860400002)(366004)(136003)(396003)(346002)(376002)(26005)(66476007)(66556008)(38100700002)(36756003)(8936002)(15650500001)(6486002)(478600001)(53546011)(83380400001)(8676002)(5660300002)(16526019)(186003)(2616005)(31696002)(16576012)(786003)(2906002)(52116002)(66946007)(31686004)(316002)(75432002)(956004)(86362001)(38350700002)(43740500002)(45980500001);
 DIR:OUT; SFP:1102; 
X-MS-Exchange-AntiSpam-MessageData: =?Windows-1252?Q?scDwRJhccLuQIikhQ5GihmGNU0QxMzdlXrpUlAVzTRnwG1J/5fDDokx4?=
 =?Windows-1252?Q?qWDA92dA4wSw1i2+KAewh8okZeg387L2SkFNgGA+n2y4IUcvKdLNIuHH?=
 =?Windows-1252?Q?pRguiGMq+Gmvv7RjO5gg1chbLjlQJUez/flyzSAxQAKg7P0qZmIMWCpi?=
 =?Windows-1252?Q?jy8/yf2eZ+qSSRUbt/+mTbRnJangsRQn4cigQGAyxXt8AWaz5EXhcjip?=
 =?Windows-1252?Q?bfGDMgMwxvSxq7I3q3h8/96CPCs0m4w//IvvsYS038BI9P4/YMiVxrZE?=
 =?Windows-1252?Q?t5oGAcxgsi60POHJHM8YWOCPO2qw1NoVdjDuFJKLQIBH13j0jROi1gKg?=
 =?Windows-1252?Q?Neh8vlfTc0V2f3iQIN5+XYYwuVf40kebi0GFTihrabaPZP0vBFCKGE26?=
 =?Windows-1252?Q?rluWgua2BqFZHnLs9B/N2yvOaliTJL9YI58+/Q2Z9jwLTSw47MQGMJyy?=
 =?Windows-1252?Q?1Jxj7SDbSVjTwgnvVxF217669crTXzzXFIrrEo6dZeikOzaPG8tokDsc?=
 =?Windows-1252?Q?ZILG8aIbaOv6rBbH0m5Q17awTzbRx97QbGUaj2+VuV7XjBNJz5YWsrEQ?=
 =?Windows-1252?Q?paJkMI3wSWbg+c5o8xRSbxG51rCu2RJc23fPDhLEv1kuJP/hyHtEvrO3?=
 =?Windows-1252?Q?hLY0as4gqSHgBvptCVTTKd9JVtkxxedZjf962jAW99sMnBlYQVwh9NFD?=
 =?Windows-1252?Q?fkH552OtmCDHvpJh+vsDnbimbcScc9pHY9dNaDLJnnZfW/hEYC913Lqe?=
 =?Windows-1252?Q?xS+HfjI9Z/SpUVxMKSmuMDosBODgG16AkrxCB3k12qg6OImlVEOcwKMV?=
 =?Windows-1252?Q?ocahwzr9/6Beh5/vAZLjSVoYhTG6mK/I4acVylG5cKtVxvK0Vhqz+YXK?=
 =?Windows-1252?Q?b4st5hEdfigsFzSbKA5EHsAPBPvFOOCuHx6NKqtwHaSG6DgzsoK8MQL+?=
 =?Windows-1252?Q?+XHk+p19W4ltJVybAkSE6qEpbmT9HR+TE7YiI5EvlTp82+uM3/TYq/kN?=
 =?Windows-1252?Q?5Bbt1h/+8b41ZbPTpzAhGFhxwZAb41hU0L2r+fK/aqj0vE2HVS/jquvw?=
 =?Windows-1252?Q?9p+gLPZv70J90Y0dkgfm4n23lO0cWsm9/eC1v/ahOMvsCjd6n11jv5P3?=
 =?Windows-1252?Q?A12+IPENE/l08RNRKbxKhX3MkNPGKXI5dTDOK36xDF2ZmltKYUVAYNxN?=
 =?Windows-1252?Q?mx8liKeVVfqZm+8Y2w7olZAj4qjYvTJFKPVeuhZPPrO07bu4tlM7Ke36?=
 =?Windows-1252?Q?r/J4vr3U6kGY5WEEKRPprrKwnVx/yajcuM99pnVePYIA4rwvyN9j49d/?=
 =?Windows-1252?Q?bgpaPwPKMej6ztYu++AcKm1pienXuIykkcYBrWWuY68JIXAhlpM70qrm?=
 =?Windows-1252?Q?R5mk6bE0pz2oG2af8ifS02aUWfJ2cKPC80/P+4VOcWVmdLn8DvbrYDUY?=
X-OriginatorOrg: cornell.edu
X-MS-Exchange-CrossTenant-Network-Message-Id: f5a4d486-e2d9-4695-819d-08d9098cb40c
X-MS-Exchange-CrossTenant-AuthSource: BN7PR04MB4388.namprd04.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 27 Apr 2021 14:56:57.2294 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 5d7e4366-1b9b-45cf-8e79-b14b27df46e1
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: YPRV57q1WPNxb8Wb1iF/zvCsVHBhiGAYUrI0+Egn/rU+DPx8uLn2UUgVOH5c7Jtl1sMQAUsdTUkFqoF6HvzYWQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN8PR04MB6369
X-Spam-Status: No, score=1.2 required=5.0 tests=BAYES_00, DKIM_INVALID,
 DKIM_SIGNED, KAM_DMARC_STATUS, MSGID_FROM_MTA_HEADER, NICE_REPLY_A,
 RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H2, SPF_HELO_PASS, SPF_PASS,
 TXREP autolearn=no autolearn_force=no version=3.4.2
X-Spam-Level: *
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on
 server2.sourceware.org
X-BeenThere: cygwin AT cygwin DOT com
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: General Cygwin discussions and problem reports <cygwin.cygwin.com>
List-Unsubscribe: <https://cygwin.com/mailman/options/cygwin>,
 <mailto:cygwin-request AT cygwin DOT com?subject=unsubscribe>
List-Archive: <https://cygwin.com/pipermail/cygwin/>
List-Post: <mailto:cygwin AT cygwin DOT com>
List-Help: <mailto:cygwin-request AT cygwin DOT com?subject=help>
List-Subscribe: <https://cygwin.com/mailman/listinfo/cygwin>,
 <mailto:cygwin-request AT cygwin DOT com?subject=subscribe>
From: Ken Brown via Cygwin <cygwin AT cygwin DOT com>
Reply-To: Ken Brown <kbrown AT cornell DOT edu>
Content-Type: text/plain; charset="windows-1252"; Format="flowed"
Errors-To: cygwin-bounces AT cygwin DOT com
Sender: "Cygwin" <cygwin-bounces AT cygwin DOT com>
Content-Transfer-Encoding: 8bit
X-MIME-Autoconverted: from quoted-printable to 8bit by delorie.com id 13REv5Cl026700

On 4/15/2021 11:01 AM, Ken Brown via Cygwin wrote:
> On 4/15/2021 9:15 AM, sten DOT kristian DOT ivarsson AT gmail DOT com wrote:
>> [snip]
>>
>>>> I tried SOCK_STREAM (and SOCK_SEQPACKET I think) for CYGWIN 3.2.0 but
>>>> that didn't work at all
>>>>
>>>> As far as I understand, both all types on pretty much all
>>>> implementations preserves message ordering though
>>>>
>>>> I haven't tried SOCK_STREAM and/or SOCK_SEQPACKET with the
>>> topic/af_unix-branch. Is that worth a try ?
>>>
>>> SOCK_STREAM is definitely worth a try.  The implementation of that should be
>>> much more reliable than the implementation of SOCK_DGRAM at the
>>> moment.  We don't implement SOCK_SEQPACKET.
>>
>> It might be a complete rewrite of our semantics though, because it's 
>> connection based and allows just one writer on each "channel" and messages 
>> (chunks) cannot be handled "atomically"
> 
> In that case, let's try to get the DGRAM case to work.

I decided to (finally) dig into the AF_UNIX implementation on the master branch 
and try to understand why DGRAM sockets are unreliable.  I think the answer is 
simply that Cygwin implements AF_UNIX sockets using Windows AF_INET sockets, and 
DGRAM sockets in this setting are documented to be unreliable.  It appears that 
if too much is written without anything being read, the Windows WSASendTo 
function simply drops messages without giving any error.

Unfortunately, switching to native Windows AF_UNIX sockets wouldn't help, 
because they don't support DGRAM sockets.

I'm going to follow up on cygwin-developers.

Ken

-- 
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple