X-Recipient:	archive-cygwin AT delorie DOT com
DomainKey-Signature:	a=rsa-sha1; c=nofws; d=sourceware.org; h=list-id
	:list-unsubscribe:list-subscribe:list-archive:list-post
	:list-help:sender:subject:to:references:from:message-id:date
	:mime-version:in-reply-to:content-type
	:content-transfer-encoding; q=dns; s=default; b=SmfoECollVt1ppKT
	iK56E4b5ceZ853yKcUWO9Mb28p2qNtMervyuJTrJT37qmZU3rB42UAb5Pjntatma
	zgJ6CXLIVWoKccmhCPJlz+W4IHWY5xh9oUBnQWf/nvfIub7x6xM3umKG1/rP0mk3
	AltS/yva8rpnTsSas2qrk8ItNjc=
DKIM-Signature:	v=1; a=rsa-sha1; c=relaxed; d=sourceware.org; h=list-id
	:list-unsubscribe:list-subscribe:list-archive:list-post
	:list-help:sender:subject:to:references:from:message-id:date
	:mime-version:in-reply-to:content-type
	:content-transfer-encoding; s=default; bh=GJgP7GzguLFoABP3kvJ2w+
	3llPQ=; b=iSx7DGaWO/6kYTpkuBmC2YwuhUpcYVxQc+yb0Ie8iqcbFTvLCoinBe
	FsValUjYcCTpCcJ91Xzp8VP9n5K30RhH0r5ytaI0bw8Y+KSWRWqqeFDfAQHXZdSb
	wT0iHP03DC0yBkiDdaRZ8nWv/oPG5Hr2VUZhzF+9xR5yjxzLCOR3E=
Mailing-List:	contact cygwin-help AT cygwin DOT com; run by ezmlm
List-Id:	<cygwin.cygwin.com>
List-Subscribe:	<mailto:cygwin-subscribe AT cygwin DOT com>
List-Archive:	<http://sourceware.org/ml/cygwin/>
List-Post:	<mailto:cygwin AT cygwin DOT com>
List-Help:	<mailto:cygwin-help AT cygwin DOT com>, <http://sourceware.org/ml/#faqs>
Sender:	cygwin-owner AT cygwin DOT com
Mail-Followup-To:	cygwin AT cygwin DOT com
Delivered-To:	mailing list cygwin AT cygwin DOT com
Authentication-Results:	sourceware.org; auth=none
X-Virus-Found:	No
X-Spam-SWARE-Status:	No, score=-2.5 required=5.0 tests=AWL,BAYES_00,FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS autolearn=ham version=3.3.2 spammy=dear, Dear, night, products
X-HELO:	mail-it0-f53.google.com
X-Google-DKIM-Signature:	v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=Kf3sckjHy4WpJU+koCAftqIshCCjMHhZALVu1IEKPQ4=; b=NtL1B1mGOHQNSBHFCMci1Ri4S0REe3RQmKAbJdmejM5mb2x2G4xlBD8R0Mr06ZrVC0 IGXMlrPmkmNPHIPRlhsHsDEO6WqzenWqm2A3QO+7rNhvMOzLkalnwaHawRSz8xMoQJZA MvgmF98RHblyS41pY6AY8bAeX7s3R/8lE2Dwcgf71SB4CXckEqWd0DhKF7bId7zpsKW1 BhGwRNOBm4O1mewMQWTxfDEwaK1sM/6AbJpk07NJulE/v9tJ7dT2tqKw27pWpnsKRRIw HZIPu/k0YupCjZJYoGGT+aYj/eKssTI1r872VWG9hgaGyUtRc9rQNRFrjq69SPKNp/xk DrFQ==
X-Gm-Message-State:	AODbwcCxv3V1K/olDTPb7YFr5pVPUG5PLtWL3xrdpwt6wknKPRQYbnZM 1uLwL1hb0LghsvjU
X-Received:	by 10.36.64.141 with SMTP id n135mr5780458ita.105.1497017217937; Fri, 09 Jun 2017 07:06:57 -0700 (PDT)
Subject:	Re: CR-LF handling behavior of SED changed recently - this breaks a lot of MinGW cross build scripts
To:	cygwin AT cygwin DOT com
References:	<0F7D3B1B3C4B894D824F5B822E3E5A175B2636E4 AT IRSMSX103 DOT ger DOT corp DOT intel DOT com> <a53282b6-d00c-aad8-76a6-26b4089a9623 AT redhat DOT com> <0F7D3B1B3C4B894D824F5B822E3E5A175B26CE47 AT IRSMSX102 DOT ger DOT corp DOT intel DOT com> <59399CC5 DOT 60900 AT tlinx DOT org> <417f84ac-5d9f-dc50-e912-973e90b8a128 AT redhat DOT com> <0F7D3B1B3C4B894D824F5B822E3E5A175B26F278 AT IRSMSX102 DOT ger DOT corp DOT intel DOT com>
From:	cyg Simple <cygsimple AT gmail DOT com>
Message-ID:	<34b26965-34c2-b5f0-a3f2-b2c3df344b08@gmail.com>
Date:	Fri, 9 Jun 2017 10:06:56 -0400
User-Agent:	Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.1.1
MIME-Version:	1.0
In-Reply-To:	<0F7D3B1B3C4B894D824F5B822E3E5A175B26F278@IRSMSX102.ger.corp.intel.com>
X-IsSubscribed:	yes

On 6/9/2017 4:06 AM, Soegtrop, Michael wrote:
> Dear Blake,
> 
>> External products were being lazy by relying on cygwin to strip CR when they
>> should have stripped it themselves.  But 'sed -b' does NOT strip CR (it is the
>> exact opposite, of keeping CR unstripped).
> 
> I think that there are more people who use sed for text processing in a MinGW cygwin cross environment than there are people using sed for binary data - but looking at the mailing list this might be a subjective view. The maintainers of the Linux centric SW could insert dos2unix in all stuff piped into sed, but this would only be required in this very specific build configuration, and Linux SW maintainers frequently argue why they should care about Windows at all. It can take all sorts of philosophical discussions to get such a change in. And I cannot blame them for a "we are free SW people, if you Windowers can make use of our SW without bothering us - go ahead, but please don't drag us into your mud" attitude. In the end one usually gets it done, but the effort is not negligible.
> 

They have every right and I would most likely do the same if I were in
their positions.  As already explained by Erik the CR needs to be
preserved during the pipe and redirect of data.  Otherwise you corrupt
the data being used.

> I think that sed, grep and awk are in the end text processing tools, and that they should at least have an environment option to behave like text processing tools in a mixed cygwin MinGW environment. With sed I have several 100 issues building a single application, with grep it was just one in my scripts which I fixed. awk no issues so far.
> 

They may have been derived by the need to process text but they were
also derived as *nix software where the CR wasn't an issue.  Dealing
with the data is the end users responsibility and if the data contains a
character that isn't required then the end user needs to remove it with
other tools. This isn't anything new, dealing with Windows produced
files in any *nix environment requires the conversion from and to
Windows formats.

> Btw.: I don't think that it will be easy or even possible to build detection for MinGW generated output into the cygwin dll as you suggested in a previous post. How should the receiving part of a pipe know what kind of DLLs the sending part has loaded? One could have obscure heuristics to detect "text with cr-lf line endings", but this sounds more like a night mare than a solution. The only entity who could detect this is the shell, but then you have more than one shell (and more philosophers). As I said, I think on cygwin sed, grep and awk should have an environment option to be MinGW friendly text processors (as they used to be). Other less text centric SW should be unaffected.
> 

No, there should be no such option.

> Honestly my solution to the problem is to build sed from sources with CR stripping. I thought about it a day and came to the conclusion that everything else is a waste of time.
> 

That is your choice, you could even build sed as a Windows binary
instead of a Cygwin binary; but it would be most beneficial if you
caused the stdio of your Windows applications to be in binary format
instead of text format.  Then the CR wouldn't be an issue during the
pipe process.  Why does your applications stdio need to be in text
format instead of binary format?

-- 
cyg Simple

--
Problem reports:       http://cygwin.com/problems.html
FAQ:                   http://cygwin.com/faq/
Documentation:         http://cygwin.com/docs.html
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple

- Raw text -