X-Recipient:	archive-cygwin AT delorie DOT com
DomainKey-Signature:	a=rsa-sha1; c=nofws; d=sourceware.org; h=list-id
	:list-unsubscribe:list-subscribe:list-archive:list-post
	:list-help:sender:subject:to:references:from:reply-to:message-id
	:date:mime-version:in-reply-to:content-type
	:content-transfer-encoding; q=dns; s=default; b=so+R2kRR3ohz0Ghc
	NkdBI5FC+GmNRq5g02xW9KU28CKVsFJJQ3Px+x6jmJaVkJFxAIKj8PBW0GtRJ3Uv
	hCoE8lQrPjKBnC5lMhZTHucXotrKrsxfTTpyiqsicS3hINSPw9Hb2Z25bL+9VcWB
	E+TNv8xnFF0qgBm6Sqf07JLXqjA=
DKIM-Signature:	v=1; a=rsa-sha1; c=relaxed; d=sourceware.org; h=list-id
	:list-unsubscribe:list-subscribe:list-archive:list-post
	:list-help:sender:subject:to:references:from:reply-to:message-id
	:date:mime-version:in-reply-to:content-type
	:content-transfer-encoding; s=default; bh=5shZoanlh6/ZIyr5VZ7CYo
	L5cPQ=; b=RoIyPGPEYWYrLzcr+9jlkdI3WckxM+xvUljyi0S3IKW0ssLRYp89wC
	lbFfrM8tndwRv1f80M2e++P4PZUIuZ8kDdJGyb+D/yxqhzXHIuQhtF3snOFpKSet
	fCyMRBtd6Dh5chaJvmMK+ed/urUhUvp7lehCAx3kPznuSYInOoR8g=
Mailing-List:	contact cygwin-help AT cygwin DOT com; run by ezmlm
List-Id:	<cygwin.cygwin.com>
List-Subscribe:	<mailto:cygwin-subscribe AT cygwin DOT com>
List-Archive:	<http://sourceware.org/ml/cygwin/>
List-Post:	<mailto:cygwin AT cygwin DOT com>
List-Help:	<mailto:cygwin-help AT cygwin DOT com>, <http://sourceware.org/ml/#faqs>
Sender:	cygwin-owner AT cygwin DOT com
Mail-Followup-To:	cygwin AT cygwin DOT com
Delivered-To:	mailing list cygwin AT cygwin DOT com
Authentication-Results:	sourceware.org; auth=none
X-Virus-Found:	No
X-Spam-SWARE-Status:	No, score=-5.8 required=5.0 tests=AWL,BAYES_00,FREEMAIL_FROM,GIT_PATCH_2,KB_WAM_FROM_NAME_SINGLEWORD,RCVD_IN_DNSWL_NONE,RP_MATCHES_RCVD,SPF_PASS autolearn=ham version=3.3.2 spammy=Tetsuji, H*M:df13, music, all
X-HELO:	sonic310-15.consmr.mail.bf2.yahoo.com
X-Yahoo-SMTP:	dVDJiUaswBCvpsZkKGwUdudVizsY.1VK
Subject:	Re: xz archiver has a problem compressing a large volume in multithread mode
To:	L A Walsh <cygwin AT tlinx DOT org>, "cygwin AT cygwin DOT com" <cygwin AT cygwin DOT com>
References:	<98f358c1-2869-3c99-b233-3b295dfa7edd AT yahoo DOT com> <5A0A6513 DOT 7030808 AT tlinx DOT org>
From:	"Tetsuji Rai via cygwin" <cygwin AT cygwin DOT com>
Reply-To:	Tetsuji Rai <tetsuji_rai AT yahoo DOT com>
Message-ID:	<d99fd1dd-e013-0aa5-df13-51a2634921f2@yahoo.com>
Date:	Wed, 15 Nov 2017 14:40:29 +0900
User-Agent:	Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.4.0
MIME-Version:	1.0
In-Reply-To:	<5A0A6513.7030808@tlinx.org>
Note-from-DJ:	This may be spam

On 11/14/2017 12:37, L A Walsh wrote:

> Tetsuji Rai via cygwin wrote:
>> Hi all,
>>
>> I have many music files, so I often archive music directory with "tar
>> -cJvf music.tar.xz music" with environment variable XZ_OPTS="-T 3" (I
>> have 4 threaded first generation i7).    The archive is about 30GB.
>> Until some weeks ago it worked fine.   However since I updated to the
>> latest version of cygwin64 some weeks ago, I have a trouble extracting
>> from that archive at some point.  "tar -xJvf music.tar.xz" says "archive
>> file is corrupt" or something and quits.   T
> ---
>    Have you tried it with one xz thread?...
>
> BTW to compress/decompress w/xz, I usually use
>   tar caf /tmp/archive.txz /music_archive   to compress and
>   tar xaf /tmp/archive.txz                  to uncompress
>
> (but those should be unrelated to your problem).
>
> I just tried "-T 3" on my version of tar and with "xz"
> and it doesn't make a difference in time, but does result
> in slightly larger file sizes -- which is characteristic
> of it using multiple threads.  However, tar only produces
> 1 thread, so it never gets a chance to run things in multiple
> threads.
>
> Also --
>
> Besides, music isn't "real compressible"  -- especially
> if you are compressing mp3 or flac, but the general purpose
> compression algorithms don't do a great job of compressing
> music.
>
> Compressing mp3->mp3+xz saved about 2.8%
> Compressing flac->flac+xz saved about 0.82% (<less than 1%)
>
> Compressing raw waves:
> xz files were 32% LARGER than flac.
>
> So what type of music are you compressing?
>
> BTW -- sending this to you in addition to list, since
> the list has been flakey for me recently -- seems to
> have a bug rejecting my domain.
>
>
>
Now I found single compression doesn't harm at all.  Multithreaded
compression is the problem.   Actually, compression of mp3 files doesn't
mean anything.....so I will just use tar for archive.    It's much faster :)

--
Problem reports:       http://cygwin.com/problems.html
FAQ:                   http://cygwin.com/faq/
Documentation:         http://cygwin.com/docs.html
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple

- Raw text -