X-Recipient: archive-cygwin@delorie.com
DomainKey-Signature: a=rsa-sha1; c=nofws; d=sourceware.org; h=list-id
	:list-unsubscribe:list-subscribe:list-archive:list-post
	:list-help:sender:message-id:date:from:subject:to:references
	:content-type; q=dns; s=default; b=TO+cgdeJwR+VT7nefQnD1GR3HkQCY
	bFvRGtV96NY7K/6++sW+VQyb7ZmQ/r8uW+lom5dMBrDKcrnfMYYZlHP0FwEckqVa
	r+vE5YIY5ZAwIRDtq3vOu/qVrvOg4k9DHH0AcgzxsqBDnqK40NYfQHWhSNct2BKP
	/6I1r77KuANxMI=
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=sourceware.org; h=list-id
	:list-unsubscribe:list-subscribe:list-archive:list-post
	:list-help:sender:message-id:date:from:subject:to:references
	:content-type; s=default; bh=yqVHOaERJjLyTcduEczFzk23A0Q=; b=g/Q
	rStl8TZkZuXYqPOiaxDTPvyZLTtH7X4scqOkpV8vMn36HS5h0oTtPMqRf1JZX/q3
	0bRPqP51bfSf8sBFQypZvqYT8aFFxQEjM4OjuJQPOfrpFo42xjTmHAzZyw5f4vYb
	Azb4O8GJnMRP5vECMexP1/o9nQwEl/947wPytVlc=
Mailing-List: contact cygwin-help@cygwin.com; run by ezmlm
List-Id: <cygwin.cygwin.com>
List-Subscribe: <mailto:cygwin-subscribe@cygwin.com>
List-Archive: <http://sourceware.org/ml/cygwin/>
List-Post: <mailto:cygwin@cygwin.com>
List-Help: <mailto:cygwin-help@cygwin.com>, <http://sourceware.org/ml/#faqs>
Sender: cygwin-owner@cygwin.com
Mail-Followup-To: cygwin@cygwin.com
Delivered-To: mailing list cygwin@cygwin.com
Authentication-Results: sourceware.org; auth=none
X-Spam-SWARE-Status: No, score=-1.8 required=5.0 tests=AWL,BAYES_00,FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS autolearn=ham version=3.3.2 spammy=H*M:1c69fb81, H*M:google, HX-Received:Sat, HX-Received:Sep
X-HELO: mail-oi0-f68.google.com
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;        d=gmail.com; s=20161025;        h=message-id:date:from:subject:to:references:user-agent;        bh=Us8mk7WqmYqbrw7AzAWVaxh/0l62CR5xFTddl9Iri1k=;        b=sxiXvka+kdl8jiJDb7meN50McM4VdzkFSo3fVPZnhbo8jCVK5fCWwPAC/OQsksnkdy         ZRWnW5NeaisLsJaBENMU+l63hWP9qcaCCL1x19QaKd0foAszO8UR/weKXp1TRF9FO4he         5d+6qltfIQiRl4hskW2v0vYBXd+weqTDO1FNKzHeug0POyT4qmhDrdNG9L6fRx8T3RL3         EfPezQXpOhOjAI2X0PxbFM9ZvI8ompiJeMMLrKYFbu8JYT1E0wt544QMnXe2VnB7aW5k         rUjZb+SdN7/rQEtrK1G+x6uZwi7kAcVAEXludbLjWpFXw97kVSLBiwG6lAXMAPyR7Zd6         d5iQ==
Message-ID: <5b8ade6a.1c69fb81.e5a2.6ed8@mx.google.com>
Date: Sat, 01 Sep 2018 11:46:02 -0700 (PDT)
From: Steven Penny <svnpenn@gmail.com>
Subject: Re: Cygwin fails to utilize Unicode replacement character
To: cygwin@cygwin.com
References: <b2d0bb2d-94a7-400e-1b4a-eb9dd9e8d101@towo.net>
Content-Type: text/plain; charset=utf8; format=flowed
User-Agent: Tryst/2.8.0 (cup.github.io/tryst)

On Sat, 1 Sep 2018 20:11:15, Thomas Wolff wrote:
> Which terminals are used and what's the output of `locale` and `cat 
> --version` in both cases?

Linux:

    $ echo "$TERM"
    xterm-256color

    $ locale
    LANG=en_US.UTF-8
    LC_CTYPE="en_US.UTF-8"
    LC_NUMERIC="en_US.UTF-8"
    LC_TIME="en_US.UTF-8"
    LC_COLLATE=C
    LC_MONETARY="en_US.UTF-8"
    LC_MESSAGES="en_US.UTF-8"
    LC_PAPER="en_US.UTF-8"
    LC_NAME="en_US.UTF-8"
    LC_ADDRESS="en_US.UTF-8"
    LC_TELEPHONE="en_US.UTF-8"
    LC_MEASUREMENT="en_US.UTF-8"
    LC_IDENTIFICATION="en_US.UTF-8"
    LC_ALL=

    $ cat --version
    cat (GNU coreutils) 8.29

Cygwin:

    $ echo "$TERM"
    cygwin

    $ locale
    LANG=en_US.UTF-8
    LC_CTYPE="en_US.UTF-8"
    LC_NUMERIC="en_US.UTF-8"
    LC_TIME="en_US.UTF-8"
    LC_COLLATE="C"
    LC_MONETARY="en_US.UTF-8"
    LC_MESSAGES="en_US.UTF-8"
    LC_ALL=

    $ cat --version
    cat (GNU coreutils) 8.26

Note that in addition to Linux, Windows PowerShell also gives correct output:

    $ pwsh -c '[system.text.encoding]::UTF8.getString(0xEB)'
    �

compare again with Cygwin:

    $ printf '\xEB'
    ▒


--
Problem reports:       http://cygwin.com/problems.html
FAQ:                   http://cygwin.com/faq/
Documentation:         http://cygwin.com/docs.html
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple

