Mailing-List: contact cygwin-help@cygwin.com; run by ezmlm
Sender: cygwin-owner@cygwin.com
Mail-Followup-To: cygwin@cygwin.com
MIME-Version: 1.0
Sender: livio@bertacco.it
From: Livio Bertacco <lbertacco@tiscali.it>
Date: Fri, 17 Aug 2018 16:05:09 +0200
Message-ID: <CAL0dvtiDxdcN2qUG2MEG0vrpkr=R2LkopK7ECV8YamWyo7K=ng@mail.gmail.com>
Subject: memory reported in /proc/pid/status is wrongly scaled
To: cygwin@cygwin.com
Content-Type: text/plain; charset="UTF-8"

 Hi,
While playing with reading process memory usage in Linux and cygwin, I
found that cygwin reports too large values in /proc/self/status (in 2.10.0
and earlier).
Whenever I was allocating a few kB in my test program, the VmSize line in
/proc/self/status was growing several times faster.

Small bash script to show the issue:
#!/bin/bash
pid=$$
vmsizesplit=($(grep VmSize /proc/$pid/status))
vmsize1="${vmsizesplit[1]}"
echo Initial memory reported in status: $vmsize1 kB
echo Allocating a 1000 kB string (bash can use more memory)
eat=$(printf '%1024000s')
vmsizesplit=($(grep VmSize /proc/$pid/status))
vmsize2="${vmsizesplit[1]}"
echo Current memory reported in status: $vmsize2 kB
echo Difference is $[$vmsize2-$vmsize1] kB

Running this in cygwin on my laptop I get:
Initial memory reported in status: 84928 kB
Allocating a 1000 kB string (bash can use more memory)
Current memory reported in status: 106880 kB
Difference is 21952 kB

While bash may use quite more than 1000 kb in this case, 22x times larger
doesn't seem right.

Checking source file fhandler_process.cc, the
function format_process_status which writes the "status" proc file
retrieves memory usage via get_mem_values. Get_mem_values obtains that info
from NtQueryInformationProcess/PagefileUsage which is in bytes, then it
scales it to pages dividing by wincap.page_size:
1515: *vmsize = vmc.PagefileUsage / wincap.page_size ();

Then format_process_status scales it back, in theory to bytes, and shifts
it by 10 bits in order to print it out in kB:
1219:  unsigned page_size = wincap.allocation_granularity ();
1220:  vmsize *= page_size;

The first observation is that scaling and unscaling are using different
factors, causing the issue. Same for the other memory amounts reported in
the "status" file (VmLck, VmRSS, etc....). Memory reported in the "stat"
file seems ok, and regarding the "statm" file, I'm not really sure (since
I'm not sure about what the correct page size should be in cygwin).
A second observation is that the same struct that contains PagefileUsage
also contains PeakPagefileUsage, so it would be very easy to also add the
VmPeak line to the "status" file (as in Linux).

Regards,
Livio

--
Problem reports:       http://cygwin.com/problems.html
FAQ:                   http://cygwin.com/faq/
Documentation:         http://cygwin.com/docs.html
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple