X-Recipient: archive-cygwin AT delorie DOT com DomainKey-Signature: a=rsa-sha1; c=nofws; d=sourceware.org; h=list-id :list-unsubscribe:list-subscribe:list-archive:list-post :list-help:sender:subject:to:references:from:message-id:date :mime-version:in-reply-to:content-type :content-transfer-encoding; q=dns; s=default; b=CbjQdsfTm3M/Q2mi zoSQUxHDzCl4LkkMHurw0lMVMNMINSaE4ypmneqZeoG+KDP0rJy26Kmfx/URAymw LHxXtn6BjrqpllWCUMeaWtfqaYT7owuWcRu0QXzRsxlsIx6L4mfRPQUZ0N65fXqH D4ceD3/rRdacEB8b+E85pxb2f7k= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=sourceware.org; h=list-id :list-unsubscribe:list-subscribe:list-archive:list-post :list-help:sender:subject:to:references:from:message-id:date :mime-version:in-reply-to:content-type :content-transfer-encoding; s=default; bh=N1yxJoEb6NN2LRjof0xvgT NBEq8=; b=sA3dWmFAVLUhBgVyYepgR2b4sxmpuBzXEFSytwHFec5lXILqoJVpPu me6erf1XfW3qQb2qRRrjRcdKmvr7bc9z1ybIXeNvjFesndZ4neGfDj77IxjssZAz 8Zuu4lI6d16CaaKrbP/4mfCBCQ5DRkTlJjIdIo8tZD3cqqAFeQ8oQ= Mailing-List: contact cygwin-help AT cygwin DOT com; run by ezmlm List-Id: List-Subscribe: List-Archive: List-Post: List-Help: , Sender: cygwin-owner AT cygwin DOT com Mail-Followup-To: cygwin AT cygwin DOT com Delivered-To: mailing list cygwin AT cygwin DOT com Authentication-Results: sourceware.org; auth=none X-Virus-Found: No X-Spam-SWARE-Status: No, score=-0.7 required=5.0 tests=AWL,BAYES_00,KAM_LAZY_DOMAIN_SECURITY autolearn=no version=3.3.2 spammy=H*Ad:U*mark, H*r:ip*192.168.1.100, Hx-spam-relays-external:!192.168.1.100!, H*RU:!192.168.1.100! X-HELO: m0.truegem.net Subject: Re: Problem with zombie processes To: cygwin AT cygwin DOT com References: <58A3598F DOT 2020405 AT maxrnd DOT com> <58A773C9 DOT 1080905 AT maxrnd DOT com> From: Mark Geisert Message-ID: <58AACADF.6080101@maxrnd.com> Date: Mon, 20 Feb 2017 02:54:23 -0800 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:43.0) Gecko/20100101 Firefox/43.0 SeaMonkey/2.40 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Erik Bray wrote: > On Fri, Feb 17, 2017 at 11:06 PM, Mark Geisert wrote: >> Erik Bray wrote: >>> >>> On Tue, Feb 14, 2017 at 8:25 PM, Mark Geisert wrote: >> >> >> Please don't quote raw email addresses. We try to avoid feeding spammers. > > Sorry--normally replies on this ML are just back to the ML itself (my > preference as well) so I wasn't expecting it. Reiterating this: Please manually remove quoted email addresses from your replies. >>>> Erik Bray wrote: >>>>> >>>>> >>>>> The attached Python script >>>> >>>> >>>> ?? >>> >>> >>> D'oh! Here is the script. It at least demonstrates the problem. >>> >> [...] >> >> Thanks! Running this script repeatedly on my system (Win7, 2 cores / 4 HT >> threads) showed no differences between your Test 1 and Test 2. Each Test >> concludes in one of three ways, seemingly randomly: (1) read of >> /proc//stat succeeds and process status is displayed, (2) read fails >> with Python IOError, (3) read apparently succeeds but there's no process >> data displayed. >> >> An strace of your script shows Python itself is calling wait4() to reap the >> child process. So, as Doug suggested on another thread, the script's >> actions are just subject to the whims of process scheduling and vary from >> run to run. > > You're right. The first time I was testing this, for whatever reason, > I was getting *very* consistent results. Test 1 *always* succeeded > and test 2 always fails. But trying it now, I am getting similar > results. > > What I was going by was the docs for ExitProcess [1] which states: > > "Exiting a process does not necessarily remove the process object from > the operating system. A process object is deleted when the last handle > to the process is closed." > > So my guess was that Cygwin might try to hold on to a handle to a > child process at least until it's been explicitly wait()ed. But that > does not seem to be the case after all. You might have missed a subtlety in what I said above. The Python interpreter itself is calling wait4() to reap your child process. Cygwin has told Python one of its children has died. You won't get the chance to wait() for it yourself. Cygwin *does* have a handle to the process, but it gets closed as part of Python calling wait4(). > Anyways, I think it would be nicer if /proc returned at least partial > information on zombie processes, rather than an error. I have a patch > to this effect for /proc//stat, and will add a few more as well. > To me /proc//stat was the most important because that's the > easiest way to check the process's state in the first place! Now I > also have to catch EINVAL as well and assume that means a zombie > process. The file /proc//stat is there until Cygwin finishes cleanup of the child due to Python having wait()ed for it. When you run your test script, pay attention to the process state character in those cases where you successfully read the stat file. It's often S (stopped, I think) or R (running) but I also see Z (zombie) sometimes. Your script is in a race with Cygwin, and you cannot guarantee you'll see a killed process's state before Cygwin cleans it up. One way around this *might* be to install a SIGCHLD handler in your Python script. If that's possible, that should tell you when your child exits. ..mark -- Problem reports: http://cygwin.com/problems.html FAQ: http://cygwin.com/faq/ Documentation: http://cygwin.com/docs.html Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple