DMARC-Filter: OpenDMARC Filter v1.4.2 delorie.com 55SGEFA11953115
DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 92EA7385E457
To: cygwin@cygwin.com
Subject: Re: readdir() returns inaccessible name if file was created with
 invalid UTF-8
Date: Sat, 28 Jun 2025 12:13:13 -0400
Message-ID: <qe106k9gc8ipgfr8n231mkepp32fd1s52i@4ax.com>
References: <96f2253b-791b-b8a0-97dd-8d257eefb9b1@t-online.de>
 <03c4fae7-7322-572c-ae72-52e300f0b438@t-online.de>
 <aFxRfI4NdZ8y5IlK@calimero.vinschen.de>
 <f78c615c-aefe-b3d0-aada-5f9d0cf73a0a@t-online.de>
 <aF5y15iQ840LxLYJ@calimero.vinschen.de>
In-Reply-To: <aF5y15iQ840LxLYJ@calimero.vinschen.de>
MIME-Version: 1.0
From: Andrew Schulman via Cygwin <cygwin@cygwin.com>
Reply-To: Andrew Schulman <andrex.e.schulman@gmail.com>
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Sender: "Cygwin" <cygwin-bounces~archive-cygwin=delorie.com@cygwin.com>

>> Testcase (attached):
>
>Thanks for the testcase!
>
>I found the problem in the newlib core function creating wchar_t from
>UTF-8 input.  In case of 4 byte UTF-8 sequences, the code created the
>low surrogate already after reading byte 3, without checking if byte 4
>of the UTF-8 sequence is a valid byte. Hilarity ensues.
>
>Fortunately this bug has only been introduced very recently, to wit, on
>2009-03-24, a mere 16 years ago.  And it is my bug and mine alone :}
>
>I'm just prep'ing a fix which I'll push in a minute or two.

Gold star awarded! https://cygwin.com/goldstars/#CV

-- 
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple