X-Recipient:	archive-cygwin AT delorie DOT com
DKIM-Filter:	OpenDKIM Filter v2.11.0 sourceware.org DE3FF39730EA
DKIM-Signature:	v=1; a=rsa-sha256; c=relaxed/relaxed; d=cygwin.com;
	s=default; t=1611613257;
	bh=Rp5mljJyzX/e5Wweo4GGiMfhtpsrWBfLJqn8G+PI8TY=;
	h=References:In-Reply-To:Date:Subject:To:List-Id:List-Unsubscribe:
	List-Archive:List-Post:List-Help:List-Subscribe:From:Reply-To:
	From;
	b=lfIgPzvRarPaK8AxiDt5VM8ZMMgoXdswsWchJP3To4ZoFhIeunbNlQv21oRX3n+FW
	57HWOkoYn4pWYJDqqPxp3cHLWOhSEkijS1k+LHL4c1nNzLb7bSgmXlHELa1QXXR1cr
	y3i9J7uybpp8dLehdNjauaUlr9N57fEhTe1dQ55k=
X-Original-To:	cygwin AT cygwin DOT com
Delivered-To:	cygwin AT cygwin DOT com
DMARC-Filter:	OpenDMARC Filter v1.3.2 sourceware.org C9731385780F
X-Google-DKIM-Signature:	v=1; a=rsa-sha256; c=relaxed/relaxed;
	d=1e100.net; s=20161025;
	h=x-gm-message-state:mime-version:references:in-reply-to:from:date
	:message-id:subject:to;
	bh=kbb5l3x/bqnAANIpwf5bjVNZu8YaL1DZM01AvIvausM=;
	b=oOJlz3nXGql7YIcDXjUn1+ZENl7UnYZQHi1iVOs9t88DHGVlSmim5Q1nkLzlZgT/5/
	A9mFAiZcFJtssgh9CG2Mi2lma85/66236p6jyqgKk/BgYN/aJSMENXU/lMLTa44kov4I
	7xY+ZxA6DPp5C3v7y6/t6YGRvJtMYAu8Zu58Yl0qTIgE2COfc4ohiRr39YOd8yYn8Xyj
	3xEsGW/vnTG9OW1pqZYfgx6inThJqCOb5/yHkMjdFzklp/zj0fcobM1Ps76jnOg5b8B5
	IW0HImKkQcAE2UJuYOKIIVGKzH6a+UYbLSbQm8Dg+2lsy2c3MwTDCJ+2KgcUTrxtBQTm
	+K4A==
X-Gm-Message-State:	AOAM532mQy4jzY0Aq+qPPjXNmmuU3rBZFT773fnY7w9gszHl3J4YgTjF
	OkHKgMfzFDdvufE+zmTwmVD1tLJ+m1JwKfjRj9XnF/s4KbNJGw==
X-Google-Smtp-Source:	ABdhPJyBXdzCRG12Wjx3nFTlLX27JWkzVKjMGY/d2J5w1G7x39GUJ+Az/xm1O6X7ULOcVmWFUKJCsAgXQFYgRvVovs4=
X-Received:	by 2002:a17:907:7252:: with SMTP id
	ds18mr1669482ejc.239.1611613252734;
	Mon, 25 Jan 2021 14:20:52 -0800 (PST)
MIME-Version:	1.0
References:	<CANeJNHoujwZWP9kSKY7dLTUkFxeg3nTx=8bdgmdYqFrOSxmU7g AT mail DOT gmail DOT com>
	<5814fb4b-0074-6e98-ed1a-a55cd899e664 AT SystematicSw DOT ab DOT ca>
	<CANeJNHpFWPecqDoh_bteL2g0jA8xup4wfGOV39C5+kGCRVOUhg AT mail DOT gmail DOT com>
	<39a7025c-4a90-2211-ae58-8e0f8fb17aaa AT SystematicSw DOT ab DOT ca>
In-Reply-To:	<39a7025c-4a90-2211-ae58-8e0f8fb17aaa@SystematicSw.ab.ca>
Date:	Mon, 25 Jan 2021 23:20:41 +0100
Message-ID:	<CANeJNHqS_0JwN9QAykF8zBgcfpuakG2vbYm-VtU+A5QHMoRYjQ@mail.gmail.com>
Subject:	Re: switching to any other than English keyboard layout is not
	handled correctly anymore on the prompt at minimum
To:	cygwin AT cygwin DOT com
X-Spam-Status:	No, score=-0.6 required=5.0 tests=BAYES_00, BODY_8BITS,
	DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, FREEMAIL_FROM,
	HTML_MESSAGE, RCVD_IN_DNSWL_NONE, SPF_HELO_NONE, SPF_PASS,
	TXREP autolearn=ham autolearn_force=no version=3.4.2
X-Spam-Checker-Version:	SpamAssassin 3.4.2 (2018-09-13) on
	server2.sourceware.org
X-Content-Filtered-By:	Mailman/MimeDel 2.1.29
X-BeenThere:	cygwin AT cygwin DOT com
X-Mailman-Version:	2.1.29
List-Id:	General Cygwin discussions and problem reports <cygwin.cygwin.com>
List-Archive:	<https://cygwin.com/pipermail/cygwin/>
List-Post:	<mailto:cygwin AT cygwin DOT com>
List-Help:	<mailto:cygwin-request AT cygwin DOT com?subject=help>
List-Subscribe:	<https://cygwin.com/mailman/listinfo/cygwin>,
	<mailto:cygwin-request AT cygwin DOT com?subject=subscribe>
From:	Ariel Burbaickij via Cygwin <cygwin AT cygwin DOT com>
Reply-To:	Ariel Burbaickij <ariel DOT burbaickij AT gmail DOT com>
Sender:	"Cygwin" <cygwin-bounces AT cygwin DOT com>
X-MIME-Autoconverted:	from base64 to 8bit by delorie.com id 10PMLNZR007989

For Russian and Hebrew keyboard layout I used University of Kansas EGARC
Center foreign languages keyboard layouts:
https://egarc.ku.edu/keyboards
For Arabic, the same idea but different site:
https://arabic.omaralzabir.com/
presumably all done with this Windows Keyboard Layout Creator
BUT for German language I did not use anything -- it is plain vanilla
German in Germany layout, and this is what I get upon attempt to submit
little sweet ö:
 $(__fzf_cd__)Ignoring redcarpet-3.4.0 because its extensions are not
built. Try: gem pristine redcarpet --version 3.4.0
Traceback (most recent call last):
        4: from /usr/bin/fzf:1347:in `<main>'
        3: from /usr/bin/fzf:309:in `start'
        2: from /usr/bin/fzf:1157:in `start_loop'
        1: from /usr/bin/fzf:929:in `get_input'
/usr/bin/fzf:929:in `ord': invalid byte sequence in UTF-8 (ArgumentError)
$
and I mean what I say, pressing ö immediately leads to it, no tricks, no
custom builds, no debugs enabled,  no nothing.

Best Regards
Ariel Burbaickij





On Mon, Jan 25, 2021 at 11:10 PM Brian Inglis <
Brian DOT Inglis AT systematicsw DOT ab DOT ca> wrote:

> On 2021-01-25 14:12, Ariel Burbaickij via Cygwin wrote:
> > On Mon, Jan 25, 2021 at 9:59 PM Brian Inglis wrote:
> >> On 2021-01-25 05:46, Ariel Burbaickij via Cygwin wrote:
> >>> I tried to find some files from the command line prompt which are
> named
> >>> using various non-Latin (Russian, Hebrew, Arabic) and non-default
> Latin
> >>> (German) layouts under Windows 10 Enterprise using recent cygwin
> version
> >>> and the outcome is that instead of representing letters I see control
> >>> characters of the type: \263\320\321  (Unicode numeric value of the
> >>> letters?). Any ideas what happens here and how correct functionality
> can
> >>> be restored?
>
> >> Which command line prompt(s): cmd, mintty, rxvt, xterm, ...?
> >> Where and how did you switch layouts: Windows keyboard mapping, Windows
> >> system locale, Windows user regional settings, chcp, LANG, LC_CTYPE,
> >> LC_ALL, ...?
> >> If you are using a terminal, what are the terminal locale and code page
> >> settings?
> >> Maybe you could explicitly show and tell us what characters you used
> >> (sending in hex please and also in 8bit UTF-8 for maximum readability:
> that
> >> looks like octal which went out with ASCII, ISO-646, SBCS code pages),
> show
> >> us how the filenames appear including the locales and the shell command
> >> lines, and show and tell us what you expect, and what is the difference
> in
> >> what you see.
> >> For details on Cygwin file name special character mappings, see:
> >>          https://cygwin.com/cygwin-ug-net/using-specialnames.html
>  > I used mintty -- default in cygwin installation as I understand.
>  > I switch layouts by switching keyboard mappings, mappings are customized
>  > from the standard ones to what is called "phonetic" for non-Latin
> alphabets
>  > but this is handled just fine everywhere outside Cygwin.
>  > I will be guessing here what you request from me but I attempted to
> type in
>  > UTF-8  август,  basically Russian in  all small letters for August as a
>  > more or less random but valid example. FIlename I was looking for
> contains
>  > this string and filename is presented correctly as all others are with
> ls
>  > but I cannot type this string in cygwin's prompt.
>
> Using what utility/-ies, how and where did you customize and switch
> keyboard
> mappings: Windows keyboard mapping, Windows system locale, Windows user
> regional
> settings, readline {/etc/,~/.}inputrc?
>
> --
> Take care. Thanks, Brian Inglis, Calgary, Alberta, Canada
>
> This email may be disturbing to some readers as it contains
> too much technical detail. Reader discretion is advised.
> [Data in binary units and prefixes, physical quantities in SI.]
> --
> Problem reports:      https://cygwin.com/problems.html
> FAQ:                  https://cygwin.com/faq/
> Documentation:        https://cygwin.com/docs.html
> Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple
>
--
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple

- Raw text -