delorie.com/archives/browse.cgi   search  
Mail Archives: cygwin/2023/12/18/06:10:51

X-Recipient: archive-cygwin AT delorie DOT com
DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 011A23857C46
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cygwin.com;
s=default; t=1702897851;
bh=bwtTGIyzFn2nq4lHcvNWtMZ1PI4g1e5vp9+1DkEVMqA=;
h=References:In-Reply-To:Date:Subject:To:List-Id:List-Unsubscribe:
List-Archive:List-Post:List-Help:List-Subscribe:From:Reply-To:
From;
b=i57OxKQ4K+GdpPfDwEmiwYuuqvaG1cQXfVoGqy/yZPzKKhiU0j/u/eeuxCKDA9AGx
RkCFHS78xUkHlOQuhuMRY1xXn3cQUonZTEXtFwqhAFHiHrv2vEsuV3l9KZJc6rsMCG
ah3w1sKzoeY+elLAXAECyfs+FJSuH90cWwIdLvHc=
X-Original-To: cygwin AT cygwin DOT com
Delivered-To: cygwin AT cygwin DOT com
DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org B8E55385828F
ARC-Filter: OpenARC Filter v1.0.0 sourceware.org B8E55385828F
ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1702897836; cv=none;
b=VdGrRcDSsM8yA9V7UQMIMO5cFHxeXOz4XdgcB/q1/xi7rqVXJf24lMvZ6rwGPCzpFoJCNUDbVZBW/NC2CuvGBTMgLKfEpbFqAUEjMhDkufKearoOkplvpP57wGJpHQiR1p/Usk9hycdi96Ya7056e8re7nMnimOh0rJLq3M9dGY=
ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key;
t=1702897836; c=relaxed/simple;
bh=Hdlshq17p64jVAQxrMdRIyt7bnSulvwAArWvN7amb/4=;
h=DKIM-Signature:MIME-Version:From:Date:Message-ID:Subject:To;
b=M9z9xqhErX4i+I9gD/+b+TXW4CpJJ3PDjhEc1jg0xjbIx6aDxM30dnvicdg0+XihiHkDRnF0rlwnjwCSp27QJ/+JCD5GmNajrWLboKcCv43m5WD4XJDl2d0qPYiN0FAJy4fXmk8j9ycVQcgdMWTw1o72OGPYomuNQiOh4f/k6Hs=
ARC-Authentication-Results: i=1; server2.sourceware.org
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20230601; t=1702897831; x=1703502631;
h=to:subject:message-id:date:from:in-reply-to:references:mime-version
:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
bh=w8Gh9v+vN4pM8Q+zRqbMOyUUcYoFQBJBT+XO5vmhGkA=;
b=M1c5ZM/+YBSBdfxsCy/rCkeHqOahs7H6R3pXN9IeiloK55qeAHwhDJ4z4FnnoDykw/
+OzTtXQj7fiBGWwngXPglWF/KiuVGocwsg2XX1KHppX30xT00DemurT2BvaXz2HbUH+t
vDwIqaNTgPxzkrdG4q3iIrYriSE/0bAfHHXi8fjlbl/swqgFD6UFjJKIe/eekYtRWs86
hhOlwydxR5tBQWO1huteXxLLf3Pk8ASRi2sfbyXwX4ED2nQntoilEZd1SC/2NSKTLHJJ
X2S7Nbssn/QMvG7VO2HbmDmzXM7+D4Fs25Da9M95/khmbztrBj6jpJh8yKB78IYwsXq7
QG2g==
X-Gm-Message-State: AOJu0YxNA/UbQOhGdFd53SoG6anXHmvtgn0OjCYoAuFnEL4M7a50Ozw8
Rnb5HcWiOtQH25NGdFrVikhzn13440mEZinsC02dZBet
X-Google-Smtp-Source: AGHT+IHvur7oRFkkBLqBQqGZH6nXzmO6cghcHCCeLm+ePZkT2a8fuVoRmMsa9riso7Kwr9lk4IconBQbOtLx9qBA3Q4=
X-Received: by 2002:a50:cd97:0:b0:553:d69:9059 with SMTP id
p23-20020a50cd97000000b005530d699059mr3246600edi.4.1702897830777; Mon, 18 Dec
2023 03:10:30 -0800 (PST)
MIME-Version: 1.0
References: <CALXu0Udckh5XVXr23yaz1Fg1DoJ_12jE+XKo-jukDPoeL_vdZA AT mail DOT gmail DOT com>
<ZWm4xf0yfNjYqL-V AT calimero DOT vinschen DOT de>
<CALXu0Ue3LjqdZKgK46=E-TgXBunUn6=LHqKi1Y5-N1hoAA_Fcg AT mail DOT gmail DOT com>
<ZXBBJJ18Q3y4CSBx AT calimero DOT vinschen DOT de>
In-Reply-To: <ZXBBJJ18Q3y4CSBx@calimero.vinschen.de>
Date: Mon, 18 Dec 2023 12:10:00 +0100
Message-ID: <CALXu0Uczsr4pPE1Z2bhZavStXQVDFchCeAX3TAr9FFyVmOOmQA@mail.gmail.com>
Subject: Re: Sparse file support for SMB by default? Re: Comment about
"Cygwin: sparse support: enable automatic sparsifying of files on SSDs",
extend feature to VMware/qemu disks?
To: cygwin AT cygwin DOT com
X-Spam-Status: No, score=-0.5 required=5.0 tests=BAYES_00, DKIM_SIGNED,
DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, FREEMAIL_FROM, RCVD_IN_DNSWL_NONE,
SPF_HELO_NONE, SPF_PASS, TXREP,
T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
server2.sourceware.org
X-BeenThere: cygwin AT cygwin DOT com
X-Mailman-Version: 2.1.30
List-Id: General Cygwin discussions and problem reports <cygwin.cygwin.com>
List-Archive: <https://cygwin.com/pipermail/cygwin/>
List-Post: <mailto:cygwin AT cygwin DOT com>
List-Help: <mailto:cygwin-request AT cygwin DOT com?subject=help>
List-Subscribe: <https://cygwin.com/mailman/listinfo/cygwin>,
<mailto:cygwin-request AT cygwin DOT com?subject=subscribe>
From: Cedric Blancher via Cygwin <cygwin AT cygwin DOT com>
Reply-To: Cedric Blancher <cedric DOT blancher AT gmail DOT com>
Sender: "Cygwin" <cygwin-bounces+archive-cygwin=delorie DOT com AT cygwin DOT com>

On Wed, 6 Dec 2023 at 10:39, Corinna Vinschen via Cygwin
<cygwin AT cygwin DOT com> wrote:
>
> On Dec  6 09:49, Cedric Blancher via Cygwin wrote:
> > On Fri, 1 Dec 2023 at 11:43, Corinna Vinschen via Cygwin
> > VMware emulates NVME SSD these days, so this should work, yes?
>
> It doesn't matter, see below.
>
> > Primary concern is how to detect whether sparse file support is ON in
> > Cygwin for a specific filesystem? Maybe /sbin/mount without options
> > should have a sparse/nosparse mount flag to reflect what is used?
>
> What concern?  I explained exactly what happens, and it all revolves
> around the fact that a filesystem sets the FILE_SUPPORTS_SPARSE_FILES
> flag or not.  This is the only interesting fact.  Nothing else
> matters.
>
> If you want to see if a filesystem supports that flag, just use the
> /usr/lib/csih/getVolInfo tool:
>
>   $ /usr/lib/csih/getVolInfo .
>   Device Type        : 7
>   Characteristics    : 20020
>   Volume Name        : <root>
>   Serial Number      : 2292001085
>   Max Filenamelength : 255
>   Filesystemname     : <NTFS>
>   Flags              : 3e72eff
>     FILE_CASE_SENSITIVE_SEARCH        : TRUE
>     FILE_CASE_PRESERVED_NAMES         : TRUE
>     FILE_UNICODE_ON_DISK              : TRUE
>     FILE_PERSISTENT_ACLS              : TRUE
>     FILE_FILE_COMPRESSION             : TRUE
>     FILE_VOLUME_QUOTAS                : TRUE
>     FILE_SUPPORTS_SPARSE_FILES        : TRUE
>     FILE_SUPPORTS_REPARSE_POINTS      : TRUE
>     FILE_SUPPORTS_REMOTE_STORAGE      : FALSE
>     FILE_RETURNS_CLEANUP_RESULT_INFO  : TRUE
>     FILE_SUPPORTS_POSIX_UNLINK_RENAME : TRUE
>     FILE_VOLUME_IS_COMPRESSED         : FALSE
>     FILE_SUPPORTS_OBJECT_IDS          : TRUE
>     FILE_SUPPORTS_ENCRYPTION          : TRUE
>     FILE_NAMED_STREAMS                : TRUE
>     FILE_READ_ONLY_VOLUME             : FALSE
>     FILE_SEQUENTIAL_WRITE_ONCE        : FALSE
>     FILE_SUPPORTS_TRANSACTIONS        : TRUE
>     FILE_SUPPORTS_HARD_LINKS          : TRUE
>     FILE_SUPPORTS_EXTENDED_ATTRIBUTES : TRUE
>     FILE_SUPPORTS_OPEN_BY_FILE_ID     : TRUE
>     FILE_SUPPORTS_USN_JOURNAL         : TRUE
>     FILE_SUPPORTS_INTEGRITY_STREAMS   : FALSE
>     FILE_SUPPORTS_BLOCK_REFCOUNTING   : FALSE
>     FILE_SUPPORTS_SPARSE_VDL          : FALSE
>     FILE_DAX_VOLUME                   : FALSE
>     FILE_SUPPORTS_GHOSTING            : FALSE
>
> > >   What Cygwin gets to see is that you want to access a file on some
> > >   disk.  It opens the file and fetches volume information.  So it finds:
> > >
> > >   - The filesystem returns the FILE_SUPPORTS_SPARSE_FILES
> > >
> > >     So we can create sparse files.
> > >
> > >   - The volume returns the SSINFO_FLAGS_NO_SEEK_PENALTY flag.
> > >
> > >     So we're on a drive having no seek penalty.  This is *probably*
> > >     an SSD, but may be some other type of drive.
> >
> > What about SMB? SMB supports sparse files, and should certainly use
> > this by DEFAULT, as it makes many HPC apps operate much faster.
> > BUT: SSINFO_FLAGS_NO_SEEK_PENALTY is only for filesystems with a
> > drive, and not for network filesystem.
> >
> > Same applies to the NFSv4.1 filesystem driver, I'm going to pester
> > Roland Mainz to add FILE_SUPPORTS_SPARSE_FILES support, so same issue
> > as SMB here.
>
> Again, the filesystem doesn't matter.  It either sets the
> FILE_SUPPORTS_SPARSE_FILES flag or not, as simple as that.
>
> If it does, you can create sparse files with chattr +S, or you can rely
> on the lseek/ftruncate/posix_fallocate automatism, or you stamp a hole
> into the file with fallocate(FALLOC_FL_PUNCH_HOLE).
>
> The *only* difference is if you have to use the "sparse" mount option or
> not.
>
> Basically, with 3.4, you always have to set the "sparse" mount option,
> with 3.5, on local SSDs you don't.  I don't see a problem here.

How can I remount the existing C: mount with the "sparse" option in
Cygwin 3.4? I cannot get it working, or I am too stupid.

Ced
-- 
Cedric Blancher <cedric DOT blancher AT gmail DOT com>
[https://plus.google.com/u/0/+CedricBlancher/]
Institute Pasteur

-- 
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple

- Raw text -


  webmaster     delorie software   privacy  
  Copyright © 2019   by DJ Delorie     Updated Jul 2019