Mail Archives: cygwin/2024/01/29/01:44:05

Cedric Blancher via Cygwin <cygwin AT cygwin DOT com> · Mon, 29 Jan 2024 07:41:00 +0100

For your consideration - we need FEEDBACK, please!

Ced

---------- Forwarded message ---------
From: Roland Mainz <roland DOT mainz AT nrubsig DOT org>
Date: Sun, 28 Jan 2024 at 23:54
Subject: [Ms-nfs41-client-devel] NFSv4.1 filesystem client Windows
driver binaries for Windows 10/11 for testing, 2024-01-28 ...
To: <ms-nfs41-client-devel AT lists DOT sourceforge DOT net>

Hi!

----

I've created a set of test binaries for the NFSv4.1 filesystem client
driver for Windows 10/11, based on
https://github.com/kofemann/ms-nfs41-client (commit id
#38817b806bc146316c193954bfbfdc2209a7b3c6, git bundle in tarball), for
testing and feedback (download URL in "Installation" section below).

Please send comments, bugs, test reports, complaints etc. to the
MailMan mailing list at
https://sourceforge.net/projects/ms-nfs41-client/lists/ms-nfs41-client-devel

# 1. What is this ?
NFSv4.1 filesystem client driver for Windows 10/11

# 2. Features:
- Full NFSv4.1 protocol support
- idmapper (mapping usernames and uid/gid values between server and
    client)
- Support for custom ports (NFSv4 defaults to TCP port 2049, this
    client can use different ports per mount)
- Support for nfs://-URL, including custom ports and raw IPv6
    addresses
- Support ssh forwarding, e.g. mounting NFSv4 filesystems via ssh
    tunnel
- Support for long paths (up to 4096 bytes), no Windows MAXPATH limit
- Unicode support
- UNC paths
    - IPv6 support in UNC paths
- IPv6 support
    - IPv6 address within '[', ']'
      (will be converted to *.ipv6-literal.net)
- Windows ACLs
- SFU/Cygwin support, including:
    - uid/gid
    - Cygwin symlinks
- Software compatibility:
    - Any NFSv4.1 server (Linux, Solaris, Illumos, FreeBSD, nfs4j,
        ...)
    - All tools from Cygwin/MinGW
    - Visual Studio
    - VMware Workstation (can use VMs hosted on NFSv4.1 filesystem)

# 3. Requirements:
- Windows 10 or Windows 11
- Cygwin 3.5.0
    - Packages:
        cygwin
        cygwin-devel
        cygrunsrv
        cygutils
        cygutils-extra
        bash
        bzip2
        coreutils
        getent
        gdb
        grep
        hostname
        less
        pax
        pbzip2
        procps-ng
        sed
        tar
        time
        util-linux
        wget

# 4. Installation (as "Administrator"):
$ mkdir -p ~/download
$ cd ~/download
$ wget 'http://www.nrubsig.org/people/gisburn/work/msnfs41client/releases/testing/msnfs41client_cygwin_binaries_20240128_17h08m_git38817b8.tar.bz2'
$ openssl sha256
msnfs41client_cygwin_binaries_20240128_17h08m_git38817b8.tar.bz2
SHA2-256(msnfs41client_cygwin_binaries_20240128_17h08m_git38817b8.tar.bz2)=
e449955c1ea9c99d30ec02b9126047f587b2780c47753f3286bc5f2b5f9e6164
$ (cd / && tar -xf
~/download/msnfs41client_cygwin_binaries_20240128_17h08m_git38817b8.tar.bz2
)
$ /sbin/msnfs41client install

# 5. Deinstallation:
$ (set -x ; cd / && tar -tf
~/download/msnfs41client_cygwin_binaries_20240128_17h08m_git38817b8.tar.bz2
| while read i ; do [[ -f "$i" ]] && rm "$i" ; done)

# 6. Usage:

# Run the NFSv4 client daemon:
# - run this preferably as "Administrator", but this is not a requirement
# - requires separate terminal
$ /sbin/msnfs41client run_daemon

# Mount a filesystem and use it
# - requires that NFSv4 server accepts connections from a TCP port
# number > 1024, which can be archived on Linux with the "insecure"
# export option in /etc/exports, or "resvport" on Solaris/Illumos
# (see nfs(5))
$ /sbin/nfs_mount -o rw N 10.49.20.110:/net_tmpfs2
Successfully mounted '10 DOT 49 DOT 20 DOT 110 AT 2049' to drive 'N:'
$ cd /cygdrive/n/
$ ls -la
total 4
drwxrwxrwt 5 Unix_User+0      Unix_Group+0      100 Dec  7 14:17 .
dr-xr-xr-x 1 roland_mainz     Kein                0 Dec 14 13:48 ..
drwxr-xr-x 3 Unix_User+197608 Unix_Group+197121  80 Dec 12 16:24 10492030
drwxr-xr-x 3 Unix_User+197608 Unix_Group+197121  60 Dec 13 17:58 directory_t
drwxr-xr-x 3 Unix_User+197608 Unix_Group+197121  60 Dec  7 11:01 test2

# Unmount filesystem:
$ cd ~ && /sbin/nfs_mount -d N:
# OR
$ cd ~
$ net use N: /delete

# List mounted NFSv4.1 filesystems:
$ /sbin/nfs_mount

# 7. Notes:
- Idmapping (including uid/gid mapping) between NFSv4 client and
  NFSv4 server works via /lib/msnfs41client/cygwin_idmapper.ksh,
  which either uses builtin static data, or /usr/bin/getent passwd
  and /usr/bin/getent group.
  As getent uses the configured name services it should work with
  LDAP too.
  This is still work-in-progress, with the goal that both NFSv4
  client and server can use different uid/gid numeric values for
  client and server side.

- UNC paths are supported, after successful mounting /sbin/nfs_mount
  will list the paths in Cygwin UNC format.

- SIDs work, users with valid Windows accounts (see Cygwin idmapping
  above get their SIDs, unknown users with valid uid/gid values get
  Unix_User+id/Unix_Group+id SIDs, and all others are mapped
  to nobody/nogroup SIDs.

- Cygwin symlinks are supported, but might require
  $ fsutil behavior set SymlinkEvaluation L2L:1 R2R:1 L2R:1 R2L:1 #.
  This includes symlinks to UNC paths, e.g. as Admin
  $ cmd /c 'mklink /d c:\home\rmainz
\\derfwpc5131_ipv6 AT 2049\nfs4\export\home2\rmainz' #
  and then $ cd /cygdrive/c/home/rmainz/ # should work

- performance: All binaries are build without any optimisation, so
  the filesystem is much slower than it could be.

- bad performance due to Windows Defender AntiVirus:
  Option 1:
  # disable Windows defender realtime monitoring
  # (requires Admin shell)
  powershell -Command 'Set-MpPreference -DisableRealtimeMonitoring 1'
  Option 2:
  Add "nfsd.exe", "nfsd_debug.exe", "ksh93.exe", "bash.exe",
  "git.exe" and other offending commands to the process name
  whitelist.

- performance: Use vmxnet3 in VMware to improve performance

- ACLs are supported via the normal Windows ACL tools, but on
  Linux require the nfs4_getfacl/nfs4_setfacl utilities to see the
  data.
  Example (assuming that Windows, Linux NFSv4 client and NFSv4
  server have a user "siegfried_wulsch"):
  - On Windows on a NFSv4 filesystem, :
  $ icacls myhorribledata.txt /grant "siegfried_wulsch:WD" #
  - On Linux NFSv4 clients you will then see this:
  ---- snip ----
  $ nfs4_getfacl myhorribledata.txt
  A::OWNER@:rwatTcCy
  A::siegfried_wulsch AT global DOT loc:rwatcy
  A::GROUP@:rtcy
  A::EVERYONE@:rtcy
  ---- snip ----

- nfs_mount only works when the NFSv4 server allows connections from
  ports >= 1024, as Windows does not allow the Windows NFSv4 client
  to use a "privileged port" (i.e. TCP port number < 1024)).
  By default the NFSv4 server on Solaris, Illumos, Linux
  etc. only accepts connections if the NFSv4 client uses a
  "privileged (TCP) port", i.e. a port number < 1024.
  This can be worked around by using the "insecure" export option in
  Linux /etc/exports, which allows connections from ports >= 1024,
  and for Solaris/Illumos see nfs(5), option "resvport".

# 8. Known issues:
- The kernel driver ("nfs41_driver.sys") does not yet have a
  cryptographic signature for SecureBoot - which means it will only
  work if SecureBoot is turned off (otherwise
  $ /sbin/msnfs41client install # will FAIL!)

- If nfsd_debug.exe crashes or gets killed, the only safe way
  to run it again requires a reboot

- LDAP support does not work yet

- Attribute caching is too aggressive

- Caching in the kernel does not always work. For example
  $ tail -f ... # does not not see new data.
  Workaround: Use GNU tail'S $ tail --follow=name ... #
  Working theory is that this is related to FCB caching, see
  |FCB_STATE_FILESIZECACHEING_ENABLED|, as the nfs41_driver.sys
  kernel module does not see the |stat()| syscalls. But $ tail -f ... #
  always works for a momemnt if something else opens the same file.

- Unmounting and then mounting the same filesystem causes issues
  as the name cache in nfsd*.exe is not flushed on umount, including
  leftover delegations.

- krb5p security with AES keys do not work against the linux server,
  as it does not support gss krb5 v2 tokens with rotated data.

- When recovering opens and locks outside of the server's grace
  period, client does not check whether the file has been modified
  by another client.

- If nfsd.exe is restarted while a drive is mapped, that drive needs
  to be remounted before further use.

- Does not allow renaming a file on top of an existing open file.
  Connectathon's special test op_ren has been commented out.

- Extended attributes are supported with some limitations:
  a) the server must support NFS Named Attributes,
  b) the order of listings cannot be guaranteed by NFS, and
  c) the EaSize field cannot be reported for directory queries of
  FileBothDirInformation, FileFullDirInfo, or FileIdFullDirInfo.

# 9. Notes for troubleshooting && finding bugs/debugging:
- nfsd_debug.exe has the -d option to set a level for debug
  output.
  Edit /sbin/msnfs41client to set the "-d" option.

- The "msnfs41client" script has the option "watch_kernel_debuglog"
  to get the debug output of the kernel module.

  Run as Admin: $ /sbin/msnfs41client watch_kernel_debuglog #

  Currently requires DebugView
  (https://learn.microsoft.com/en-gb/sysinternals/downloads/debugview)
  to be installed.

- Watching network traffic:
  WireShark has a command line tool called "tshark", which can be used
  to see NFSv4 traffic. As NFSv4 uses RPC you have to filter for RPC,
  and the RPC filter automatically identifies NFSv4 traffic on it's RPC
  id.
  Example for Windows:
  (for NFSv4 default TCP port "2049", replace "2049" with the
  desired port if you use a custom port ; use "ipconfig" to find the
  correct interface name, in this case "Ethernet0"):
  ---- snip ----
  $ nfsv4port=2049 ; /cygdrive/c/Program\ Files/Wireshark/tshark \
    -f "port $nfsv4port" -d "tcp.port==${nfsv4port},rpc" -i Ethernet0
  ---- snip ----

  If you are running inside a VMware VM on a Linux host it
  might require $ chmod a+rw /dev/vmnet0 # on VMware host, so that
  the VM can use "Promiscuous Mode".

# EOF.

----

Bye,
Roland
--
  __ .  . __
 (o.\ \/ /.o) roland DOT mainz AT nrubsig DOT org
  \__\/\/__/  MPEG specialist, C&&JAVA&&Sun&&Unix programmer
  /O /==\ O\  TEL +49 641 3992797
 (;O/ \/ \O;)

--
  __ .  . __
 (o.\ \/ /.o) roland DOT mainz AT nrubsig DOT org
  \__\/\/__/  MPEG specialist, C&&JAVA&&Sun&&Unix programmer
  /O /==\ O\  TEL +49 641 3992797
 (;O/ \/ \O;)

_______________________________________________
Ms-nfs41-client-devel mailing list
Ms-nfs41-client-devel AT lists DOT sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/ms-nfs41-client-devel

-- 
Cedric Blancher <cedric DOT blancher AT gmail DOT com>
[https://plus.google.com/u/0/+CedricBlancher/]
Institute Pasteur

-- 
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple

X-Recipient:	archive-cygwin AT delorie DOT com
DKIM-Filter:	OpenDKIM Filter v2.11.0 sourceware.org B60E23858D20
DKIM-Signature:	v=1; a=rsa-sha256; c=relaxed/relaxed; d=cygwin.com;
	s=default; t=1706510643;
	bh=yvGQDwVO1TW+0yjcC7G1mdDd4Dq9DmmKNJdmVQGvs0s=;
	h=References:In-Reply-To:Date:Subject:To:List-Id:List-Unsubscribe:
	List-Archive:List-Post:List-Help:List-Subscribe:From:Reply-To:
	From;
	b=b3It/SGH2+IW+aRHTfmI43u4f7GYNI9gaylRQK67YXon7R7glu7VHGsIev4TrmCSi
	DreEs3y576p9lWwmQukSEnNXqE0az1OcfnDK/XrxAgWjDJ0wBLGER4/wToJNYgF4Vt
	3BfYiqc4LU//UsIL0iUjyUnhH93rYdRiBFjeUAX4=
X-Original-To:	cygwin AT cygwin DOT com
Delivered-To:	cygwin AT cygwin DOT com
DMARC-Filter:	OpenDMARC Filter v1.4.2 sourceware.org 093613858D20
ARC-Filter:	OpenARC Filter v1.0.0 sourceware.org 093613858D20
ARC-Seal:	i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1706510573; cv=none;
	b=b06RjvnNgpJcUltM7sVioqOwdZCWblnI3c6/U534YVD8+vDTHx1/ooH5aHhhn3BI6C7wrVIn9EY4SB4AKxNNJH7XGXMGltRGjJ/qw2o8PG6zMgOiRyfgnCSlYYnoc0iV0F128ddAMVwiTcTMyyA+A4VCXl7cwkup/pXmsZvSdmE=
ARC-Message-Signature:	i=1; a=rsa-sha256; d=sourceware.org; s=key;
	t=1706510573; c=relaxed/simple;
	bh=rtOpRRw6bjNOCzJORszGww2PVYPJl36b9n7n7TcSxAU=;
	h=DKIM-Signature:MIME-Version:From:Date:Message-ID:Subject:To;
	b=kqNp63o6u+ODtu9mC4dVbduVjktJdLbKSidyaPMOii2DoueoSbfadrtRZJ+Hml/MrsVAiE4gfi8FIlOoP9WYicWEDoKJFGiBa2lcOKPXHr5x0fB0K8zM3aQJFX8ncvA9F3R5d58lGKqFTsVw89RGCpYYYpgeyXy4pIrEkQJOskE=
ARC-Authentication-Results:	i=1; server2.sourceware.org
X-Google-DKIM-Signature:	v=1; a=rsa-sha256; c=relaxed/relaxed;
	d=1e100.net; s=20230601; t=1706510569; x=1707115369;
	h=to:subject:message-id:date:from:in-reply-to:references:mime-version
	:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
	bh=j/F40QsPo5Cm/seZKhkfKlgJi6oxvdP5ZlTWmE4FiDQ=;
	b=XwrW5Q2HONy+C+KOuhYD3xQ0Gxg0DFB1b8U2SV1px+b6ZVU4zGNGa1eFYFmyTuw7oa
	zuFmWQXfKp9w1X45HRDfQyKV+5vpNDOdUveR1JnvbDK9XX8Eg4SJO1lZV4KaWfu6/6ZB
	mEvh4XxjSDRgQ1yFcLfn0tnJp+8Y6ZjfZZTVEKCM7q+bYLNHjE7E21tEI2EHtnReNDU5
	bHRYX0EPq80e+j1G4d8B2o/O8oUaMyNLdDKXrCv228tmGQiO+ubD+OurWrP2OH7e6F06
	/9ghyWf0f4BFy8ExbCYpM20mvS5YO2VgeQC6GVjh4abtTrL4ey7tCw9VUXa1C8/BctXv
	fyyg==
X-Gm-Message-State:	AOJu0Yzbeni3p6iKIaD/6TxfNBflS2TVfoH30uvwCzuSbiON9oLEjDmk
	r8/xbXnRRx5Rf3LApfkazEW9YYcs+wko9ZLuf0hefahtBo/Hgcfz2Edettm4p+QHEq5ZFJeLcMR
	i00LheSQFIw4KeZLsrHK/qEdSb7Iidl2HDYdUNA==
X-Google-Smtp-Source:	AGHT+IE0f4I7ZU+i+lS+hqd7RONeGot3L5thBJdC/RaS+/JgwTJGqyC++MsldZ5ZRkIWM8q4I3ANVgUY2TsNjJTpa4M=
X-Received:	by 2002:a05:6402:2792:b0:55e:f52d:97d with SMTP id
	b18-20020a056402279200b0055ef52d097dmr1605441ede.20.1706510569254; Sun, 28
	Jan 2024 22:42:49 -0800 (PST)
MIME-Version:	1.0
References:	<CAKAoaQmF2_iQtSdyTvk0ayLPqSXpLt0d_NFNHUwL90hGrYRgSA AT mail DOT gmail DOT com>
	<CAKAoaQnsgn+wE02qReVqq5NtwL6t-GdAkfv-EU5zoGZfQb1LjQ AT mail DOT gmail DOT com>
In-Reply-To:	<CAKAoaQnsgn+wE02qReVqq5NtwL6t-GdAkfv-EU5zoGZfQb1LjQ@mail.gmail.com>
Date:	Mon, 29 Jan 2024 07:41:00 +0100
Message-ID:	<CALXu0UcXbb9WUfkF6dVHSCF_CkSrLO4EZzyyezjLATrpm+wDmw@mail.gmail.com>
Subject:	Fwd: [Ms-nfs41-client-devel] NFSv4.1 filesystem client Windows driver
	binaries for Windows 10/11 for testing, 2024-01-28 ...
To:	cygwin AT cygwin DOT com
X-Spam-Status:	No, score=-0.5 required=5.0 tests=BAYES_00, DKIM_SIGNED,
	DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, FREEMAIL_FROM, RCVD_IN_DNSWL_NONE,
	SPF_HELO_NONE, SPF_PASS, TXREP,
	T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version:	SpamAssassin 3.4.6 (2021-04-09) on
	server2.sourceware.org
X-BeenThere:	cygwin AT cygwin DOT com
X-Mailman-Version:	2.1.30
List-Id:	General Cygwin discussions and problem reports <cygwin.cygwin.com>
List-Archive:	<https://cygwin.com/pipermail/cygwin/>
List-Post:	<mailto:cygwin AT cygwin DOT com>
List-Help:	<mailto:cygwin-request AT cygwin DOT com?subject=help>
List-Subscribe:	<https://cygwin.com/mailman/listinfo/cygwin>,
	<mailto:cygwin-request AT cygwin DOT com?subject=subscribe>
From:	Cedric Blancher via Cygwin <cygwin AT cygwin DOT com>
Reply-To:	Cedric Blancher <cedric DOT blancher AT gmail DOT com>
Sender:	"Cygwin" <cygwin-bounces+archive-cygwin=delorie DOT com AT cygwin DOT com>

webmaster	delorie software privacy
Copyright � 2019 by DJ Delorie	Updated Jul 2019