delorie.com/archives/browse.cgi   search  
Mail Archives: cygwin/2004/03/09/10:29:23

Mailing-List: contact cygwin-help AT cygwin DOT com; run by ezmlm
List-Subscribe: <mailto:cygwin-subscribe AT cygwin DOT com>
List-Archive: <http://sources.redhat.com/ml/cygwin/>
List-Post: <mailto:cygwin AT cygwin DOT com>
List-Help: <mailto:cygwin-help AT cygwin DOT com>, <http://sources.redhat.com/ml/#faqs>
Sender: cygwin-owner AT cygwin DOT com
Mail-Followup-To: cygwin AT cygwin DOT com
Delivered-To: mailing list cygwin AT cygwin DOT com
Message-ID: <20040309152842.40194.qmail@web60303.mail.yahoo.com>
Date: Tue, 9 Mar 2004 07:28:42 -0800 (PST)
From: Patrick Samson <p_samson AT yahoo DOT com>
Subject: Backend doesn't catch the next command, after SIGUSR2
To: cygwin AT cygwin DOT com
MIME-Version: 1.0
X-IsSubscribed: yes
Note-from-DJ: This may be spam

--0-388215251-1078846122=:39253
Content-Type: text/plain; charset=us-ascii
Content-Id: 
Content-Disposition: inline

If I run a test script enough time, it eventually
freezes in this deadlock situation:

The client sends a command to a backend and waits
for an answer. It will wait forever because the
backend
is not aware of the arrival of the request and waits
for a next command.

What happens in the loop is:
 SIInsertDataEntry: table is 70% full,
 signaling postmaster

 In reaction, the postmaster sends to its children:
 SignalChildren: sending signal 31 to process <pid>

Most of the time, it works. But at an unpredictable
iteration, it freezes.

This problem appeared first in a replication
machinery, so I reduced the number of components
involved, to get a simpler test case:
A pgtcl script, running a loop with:
 create table from another-table
 copy table to file
 drop table

The 'create table' regularly fires the '70% full'
event, and at some point, the 'copy' never gets
answered.

I attached these files:
- test.tcl: the script to run.
  Change these values to meet your context:

 set srctable pgr_qryengine_log
 set dbname euronetUsers

  The source table can be anything empty.
  In my case, it's:
CREATE TABLE public.pgr_qryengine_log
(
  pgr_sid int4 NOT NULL,
  tablename varchar(50),
  pgr_gfid int8 NOT NULL,
  pgr_grid int8 NOT NULL,
  pgr_optype varchar(2),
  pgr_when timestamp,
  pgr_username varchar(30),
  qry_result text
) WITH OIDS;

- postmaster-ok.log
 The traces of a successful iteration.
- postmaster-ko.log
 The traces of the forever waiting iteration.
 EOF is received on a ctrl/c on the client side.

Comparison of the traces shows that the signals
are processed, but the backend doesn't start a
StartTransactionCommand for the expected 'copy'.

I don't know the exact conditions for the freeze to
arise. I just noticed that chances are higher if
there is a lot of postgres.exe processes alive.
I could run 10000 runs without any extra backends.
So I opened a pgAdmin III session to have many
connexions (on multiple db, with different accounts).
With 7 to 10 processes, I reached the freeze at
3392, 2027, 6729, 272, 1871 runs.

I tried to strace the postmaster, but never managed
to have the problem. I guess strace slow down the
system too much.
I just have a strace of a correct iteration.

Done on:
- postgres 7.3.5, W2000 SP2, cygwin 1.5.5-1
- postgres 7.3.5, NT SP6, cygwin 1.5.7-1

I can't tell if the source of the problem is in
cygwin or in postgres, so I post in the two lists.

Would be helpful if anybody can reproduce the
problem, or provide advices to progress on the
debugging work.

Patrick




__________________________________
Do you Yahoo!?
Yahoo! Search - Find what you’re looking for faster
http://search.yahoo.com
--0-388215251-1078846122=:39253
Content-Type: application/octet-stream; name="test.tcl"
Content-Transfer-Encoding: base64
Content-Description: test.tcl
Content-Disposition: attachment; filename="test.tcl"

IyEvYmluL3NoDQojIHRoZSBuZXh0IGxpbmUgcmVzdGFydCB1c2luZyBwZ3Rj
bHNoIFwNCmV4ZWMgcGd0Y2xzaCAiJDAiICIkQCINCg0KcHJvYyBxdWVyeV9l
eGVjIHtxdWVyeX0gew0KZ2xvYmFsIGNueA0KIHNldCBub3cgW2Nsb2NrIGZv
cm1hdCBbY2xvY2sgc2Vjb25kXSAtZm9ybWF0ICVUXQ0KIHB1dHMgIiRub3cg
W2Nsb2NrIGNsaWNrc10gJHF1ZXJ5Li4uIg0KDQogc2V0IHJlcyBbcGdfZXhl
YyAkY254ICRxdWVyeV0NCiBzZXQgc3RhdHVzIFtwZ19yZXN1bHQgJHJlcyAt
c3RhdHVzXQ0KIHNldCBlcnIgICAgW3BnX3Jlc3VsdCAkcmVzIC1lcnJvcl0N
CiBwZ19yZXN1bHQgJHJlcyAtY2xlYXINCiBpZiB7W3N0cmluZyBsZW5ndGgg
JGVycl0hPTB9IHsNCiAgIHB1dHMgIiAgICAgICAgIFtjbG9jayBjbGlja3Nd
IC4uLiRlcnIiDQogICByZXR1cm4gLWNvZGUgZXJyb3IgIiRlcnIiDQogfSBl
bHNlIHsNCiAgIHB1dHMgIiAgICAgICAgIFtjbG9jayBjbGlja3NdIC4uLiRz
dGF0dXMiDQogICByZXR1cm4gJHN0YXR1cw0KIH0NCn0NCg0KcHJvYyBmbHVz
aG91dCB7fSB7DQogc2V0IGVycnRhYmxlIHBncl9xcnllbmdpbmVfZXJyDQog
c2V0IHNyY3RhYmxlIHBncl9xcnllbmdpbmVfbG9nDQogc2V0IGFic2ZuYW1l
IFtmaWxlIGpvaW4gL3Zhci90bXAgZXJyb3JzXQ0KDQogc2V0IHF1ZXJ5ICJj
cmVhdGUgdGFibGUgJGVycnRhYmxlIGFzIHNlbGVjdCAqIGZyb20gJHNyY3Rh
YmxlIg0KIGlmIHtbY2F0Y2gge3F1ZXJ5X2V4ZWMgJHF1ZXJ5fSByZXRdfSB7
DQogICByZXR1cm4gLWNvZGUgZXJyb3IgIiRyZXQiDQogfQ0KIHNldCBxdWVy
eSAiY29weSAkZXJydGFibGUgdG8gXCckYWJzZm5hbWVcJyINCiBpZiB7W2Nh
dGNoIHtxdWVyeV9leGVjICRxdWVyeX0gcmV0XX0gew0KICAgcmV0dXJuIC1j
b2RlIGVycm9yICIkcmV0Ig0KIH0NCiBzZXQgcXVlcnkgImRyb3AgdGFibGUg
JGVycnRhYmxlIg0KIGlmIHtbY2F0Y2gge3F1ZXJ5X2V4ZWMgJHF1ZXJ5fSBy
ZXRdfSB7DQogICByZXR1cm4gLWNvZGUgZXJyb3IgIiRyZXQiDQogfQ0KfQ0K
DQpzZXQgZGJuYW1lIGV1cm9uZXRVc2Vycw0KZ2xvYmFsIGNueA0KaWYgW2Nh
dGNoIHtwZ19jb25uZWN0IC1jb25uaW5mbyAiZGJuYW1lPSRkYm5hbWUgaG9z
dD1sb2NhbGhvc3QgdXNlcj1wb3N0Z3JlcyJ9IGNueF0gew0KICBwdXRzICRj
bngNCiAgZXhpdA0KfQ0Kc2V0IHggMA0Kd2hpbGUgeyR4IDwgMzAwMDB9IHsN
CiAgaWYgW2NhdGNoIHtmbHVzaG91dH0gZXJybXNnXSB7ZXhpdH0NCiAgaW5j
ciB4DQogIHB1dHMgInJ1biAkeCINCiMgIGFmdGVyIDMwMA0KfQ0KDQpwZ19k
aXNjb25uZWN0ICRjbngNCmV4aXQ=

--0-388215251-1078846122=:39253
Content-Type: application/octet-stream; name="postmaster-ok.log"
Content-Transfer-Encoding: base64
Content-Description: postmaster-ok.log
Content-Disposition: attachment; filename="postmaster-ok.log"

MjAwNC0wMy0wOSAxMToyMzoxNyBbNDI3XSAgICBERUJVRzogIFN0YXJ0VHJh
bnNhY3Rpb25Db21tYW5kDQoyMDA0LTAzLTA5IDExOjIzOjE3IFs0MjddICAg
IExPRzogIHF1ZXJ5OiBjcmVhdGUgdGFibGUgcGdyX3FyeWVuZ2luZV9lcnIg
YXMgc2VsZWN0ICogZnJvbSBwZ3JfcXJ5ZW5naW5lX2xvZyB3aGVyZSBxcnlf
cmVzdWx0ICE9JycNCjIwMDQtMDMtMDkgMTE6MjM6MTcgWzQyN10gICAgREVC
VUc6ICBQcm9jZXNzUXVlcnkNCjIwMDQtMDMtMDkgMTE6MjM6MTggWzQyN10g
ICAgREVCVUc6ICBDb21taXRUcmFuc2FjdGlvbkNvbW1hbmQNCjIwMDQtMDMt
MDkgMTE6MjM6MTggWzQyN10gICAgREVCVUc6ICBTdGFydFRyYW5zYWN0aW9u
Q29tbWFuZA0KMjAwNC0wMy0wOSAxMToyMzoxOCBbNDI3XSAgICBMT0c6ICBx
dWVyeTogY29weSBwZ3JfcXJ5ZW5naW5lX2VyciB0byAnL3Zhci90bXAvZXJy
b3JzJw0KMjAwNC0wMy0wOSAxMToyMzoxOCBbNDI3XSAgICBERUJVRzogIFBy
b2Nlc3NVdGlsaXR5DQoyMDA0LTAzLTA5IDExOjIzOjE4IFs0MjddICAgIERF
QlVHOiAgQ29tbWl0VHJhbnNhY3Rpb25Db21tYW5kDQoyMDA0LTAzLTA5IDEx
OjIzOjE4IFs0MjddICAgIERFQlVHOiAgU3RhcnRUcmFuc2FjdGlvbkNvbW1h
bmQNCjIwMDQtMDMtMDkgMTE6MjM6MTggWzQyN10gICAgTE9HOiAgcXVlcnk6
ICBkcm9wIHRhYmxlIHBncl9xcnllbmdpbmVfZXJyIA0KMjAwNC0wMy0wOSAx
MToyMzoxOCBbNDI3XSAgICBERUJVRzogIFByb2Nlc3NVdGlsaXR5DQoyMDA0
LTAzLTA5IDExOjIzOjE4IFs0MjddICAgIERFQlVHOiAgRHJvcCBhdXRvLWNh
c2NhZGVzIHRvIHRvYXN0IHRhYmxlIHBnX3RvYXN0LnBnX3RvYXN0XzU0OTc3
Mw0KMjAwNC0wMy0wOSAxMToyMzoxOCBbNDI3XSAgICBERUJVRzogIERyb3Ag
YXV0by1jYXNjYWRlcyB0byB0eXBlIHBnX3RvYXN0LnBnX3RvYXN0XzU0OTc3
Mw0KMjAwNC0wMy0wOSAxMToyMzoxOCBbNDI3XSAgICBERUJVRzogIERyb3Ag
YXV0by1jYXNjYWRlcyB0byBpbmRleCBwZ190b2FzdC5wZ190b2FzdF81NDk3
NzNfaW5kZXgNCjIwMDQtMDMtMDkgMTE6MjM6MTggWzQyN10gICAgREVCVUc6
ICBEcm9wIGF1dG8tY2FzY2FkZXMgdG8gdHlwZSBwZ3JfcXJ5ZW5naW5lX2Vy
cg0KMjAwNC0wMy0wOSAxMToyMzoxOCBbNDI3XSAgICBERUJVRzogIENvbW1p
dFRyYW5zYWN0aW9uQ29tbWFuZA0KMjAwNC0wMy0wOSAxMToyMzoxOCBbNDI3
XSAgICBERUJVRzogIFNJSW5zZXJ0RGF0YUVudHJ5OiB0YWJsZSBpcyA3MCUg
ZnVsbCwgc2lnbmFsaW5nIHBvc3RtYXN0ZXINCjIwMDQtMDMtMDkgMTE6MjM6
MTggWzIwMl0gICAgREVCVUc6ICBTaWduYWxDaGlsZHJlbjogc2VuZGluZyBz
aWduYWwgMzEgdG8gcHJvY2VzcyA0MjcNCjIwMDQtMDMtMDkgMTE6MjM6MTgg
WzIwMl0gICAgREVCVUc6ICBTaWduYWxDaGlsZHJlbjogc2VuZGluZyBzaWdu
YWwgMzEgdG8gcHJvY2VzcyAzNjgNCjIwMDQtMDMtMDkgMTE6MjM6MTggWzIw
Ml0gICAgREVCVUc6ICBTaWduYWxDaGlsZHJlbjogc2VuZGluZyBzaWduYWwg
MzEgdG8gcHJvY2VzcyAxMjgNCjIwMDQtMDMtMDkgMTE6MjM6MTggWzIwMl0g
ICAgREVCVUc6ICBTaWduYWxDaGlsZHJlbjogc2VuZGluZyBzaWduYWwgMzEg
dG8gcHJvY2VzcyAyODINCjIwMDQtMDMtMDkgMTE6MjM6MTggWzIwMl0gICAg
REVCVUc6ICBTaWduYWxDaGlsZHJlbjogc2VuZGluZyBzaWduYWwgMzEgdG8g
cHJvY2VzcyAxNTQNCjIwMDQtMDMtMDkgMTE6MjM6MTggWzIwMl0gICAgREVC
VUc6ICBTaWduYWxDaGlsZHJlbjogc2VuZGluZyBzaWduYWwgMzEgdG8gcHJv
Y2VzcyAzMDENCjIwMDQtMDMtMDkgMTE6MjM6MTggWzIwMl0gICAgREVCVUc6
ICBTaWduYWxDaGlsZHJlbjogc2VuZGluZyBzaWduYWwgMzEgdG8gcHJvY2Vz
cyAyOTgNCjIwMDQtMDMtMDkgMTE6MjM6MTggWzQyN10gICAgTE9HOiAgQXN5
bmNfTm90aWZ5SGFuZGxlcjogcGVyZm9ybSBhc3luYyBub3RpZnkNCjIwMDQt
MDMtMDkgMTE6MjM6MTggWzQyN10gICAgTE9HOiAgUHJvY2Vzc0luY29taW5n
Tm90aWZ5DQoyMDA0LTAzLTA5IDExOjIzOjE4IFs0MjddICAgIExPRzogIFBy
b2Nlc3NJbmNvbWluZ05vdGlmeTogZG9uZQ0KMjAwNC0wMy0wOSAxMToyMzox
OCBbNDI3XSAgICBMT0c6ICBBc3luY19Ob3RpZnlIYW5kbGVyOiBkb25lDQoy
MDA0LTAzLTA5IDExOjIzOjE4IFszNjhdICAgIExPRzogIEFzeW5jX05vdGlm
eUhhbmRsZXI6IHBlcmZvcm0gYXN5bmMgbm90aWZ5DQoyMDA0LTAzLTA5IDEx
OjIzOjE4IFszNjhdICAgIExPRzogIFByb2Nlc3NJbmNvbWluZ05vdGlmeQ0K
MjAwNC0wMy0wOSAxMToyMzoxOCBbMzY4XSAgICBMT0c6ICBQcm9jZXNzSW5j
b21pbmdOb3RpZnk6IGRvbmUNCjIwMDQtMDMtMDkgMTE6MjM6MTggWzM2OF0g
ICAgTE9HOiAgQXN5bmNfTm90aWZ5SGFuZGxlcjogZG9uZQ0KMjAwNC0wMy0w
OSAxMToyMzoxOCBbMTI4XSAgICBMT0c6ICBBc3luY19Ob3RpZnlIYW5kbGVy
OiBwZXJmb3JtIGFzeW5jIG5vdGlmeQ0KMjAwNC0wMy0wOSAxMToyMzoxOCBb
MTI4XSAgICBMT0c6ICBQcm9jZXNzSW5jb21pbmdOb3RpZnkNCjIwMDQtMDMt
MDkgMTE6MjM6MTggWzEyOF0gICAgTE9HOiAgUHJvY2Vzc0luY29taW5nTm90
aWZ5OiBkb25lDQoyMDA0LTAzLTA5IDExOjIzOjE4IFsxMjhdICAgIExPRzog
IEFzeW5jX05vdGlmeUhhbmRsZXI6IGRvbmUNCjIwMDQtMDMtMDkgMTE6MjM6
MTggWzI4Ml0gICAgTE9HOiAgQXN5bmNfTm90aWZ5SGFuZGxlcjogcGVyZm9y
bSBhc3luYyBub3RpZnkNCjIwMDQtMDMtMDkgMTE6MjM6MTggWzI4Ml0gICAg
TE9HOiAgUHJvY2Vzc0luY29taW5nTm90aWZ5DQoyMDA0LTAzLTA5IDExOjIz
OjE4IFsyODJdICAgIExPRzogIFByb2Nlc3NJbmNvbWluZ05vdGlmeTogZG9u
ZQ0KMjAwNC0wMy0wOSAxMToyMzoxOCBbMjgyXSAgICBMT0c6ICBBc3luY19O
b3RpZnlIYW5kbGVyOiBkb25lDQoyMDA0LTAzLTA5IDExOjIzOjE4IFsxNTRd
ICAgIExPRzogIEFzeW5jX05vdGlmeUhhbmRsZXI6IHBlcmZvcm0gYXN5bmMg
bm90aWZ5DQoyMDA0LTAzLTA5IDExOjIzOjE4IFsxNTRdICAgIExPRzogIFBy
b2Nlc3NJbmNvbWluZ05vdGlmeQ0KMjAwNC0wMy0wOSAxMToyMzoxOCBbMTU0
XSAgICBMT0c6ICBQcm9jZXNzSW5jb21pbmdOb3RpZnk6IGRvbmUNCjIwMDQt
MDMtMDkgMTE6MjM6MTggWzE1NF0gICAgTE9HOiAgQXN5bmNfTm90aWZ5SGFu
ZGxlcjogZG9uZQ0KMjAwNC0wMy0wOSAxMToyMzoxOCBbMzAxXSAgICBMT0c6
ICBBc3luY19Ob3RpZnlIYW5kbGVyOiBwZXJmb3JtIGFzeW5jIG5vdGlmeQ0K
MjAwNC0wMy0wOSAxMToyMzoxOCBbMzAxXSAgICBMT0c6ICBQcm9jZXNzSW5j
b21pbmdOb3RpZnkNCjIwMDQtMDMtMDkgMTE6MjM6MTggWzMwMV0gICAgTE9H
OiAgUHJvY2Vzc0luY29taW5nTm90aWZ5OiBkb25lDQoyMDA0LTAzLTA5IDEx
OjIzOjE4IFszMDFdICAgIExPRzogIEFzeW5jX05vdGlmeUhhbmRsZXI6IGRv
bmUNCjIwMDQtMDMtMDkgMTE6MjM6MTggWzI5OF0gICAgTE9HOiAgQXN5bmNf
Tm90aWZ5SGFuZGxlcjogcGVyZm9ybSBhc3luYyBub3RpZnkNCjIwMDQtMDMt
MDkgMTE6MjM6MTggWzI5OF0gICAgTE9HOiAgUHJvY2Vzc0luY29taW5nTm90
aWZ5DQoyMDA0LTAzLTA5IDExOjIzOjE4IFsyOThdICAgIExPRzogIFByb2Nl
c3NJbmNvbWluZ05vdGlmeTogZG9uZQ0KMjAwNC0wMy0wOSAxMToyMzoxOCBb
Mjk4XSAgICBMT0c6ICBBc3luY19Ob3RpZnlIYW5kbGVyOiBkb25lDQoyMDA0
LTAzLTA5IDExOjIzOjE4IFs0MjddICAgIERFQlVHOiAgU3RhcnRUcmFuc2Fj
dGlvbkNvbW1hbmQNCjIwMDQtMDMtMDkgMTE6MjM6MTggWzQyN10gICAgTE9H
OiAgcXVlcnk6IGNyZWF0ZSB0YWJsZSBwZ3JfcXJ5ZW5naW5lX2VyciBhcyBz
ZWxlY3QgKiBmcm9tIHBncl9xcnllbmdpbmVfbG9nIHdoZXJlIHFyeV9yZXN1
bHQgIT0nJw0KMjAwNC0wMy0wOSAxMToyMzoxOCBbNDI3XSAgICBERUJVRzog
IFByb2Nlc3NRdWVyeQ0KMjAwNC0wMy0wOSAxMToyMzoxOCBbNDI3XSAgICBE
RUJVRzogIENvbW1pdFRyYW5zYWN0aW9uQ29tbWFuZA0KMjAwNC0wMy0wOSAx
MToyMzoxOSBbNDI3XSAgICBERUJVRzogIFN0YXJ0VHJhbnNhY3Rpb25Db21t
YW5kDQoyMDA0LTAzLTA5IDExOjIzOjE5IFs0MjddICAgIExPRzogIHF1ZXJ5
OiBjb3B5IHBncl9xcnllbmdpbmVfZXJyIHRvICcvdmFyL3RtcC9lcnJvcnMn
DQoyMDA0LTAzLTA5IDExOjIzOjE5IFs0MjddICAgIERFQlVHOiAgUHJvY2Vz
c1V0aWxpdHkNCjIwMDQtMDMtMDkgMTE6MjM6MTkgWzQyN10gICAgREVCVUc6
ICBDb21taXRUcmFuc2FjdGlvbkNvbW1hbmQNCjIwMDQtMDMtMDkgMTE6MjM6
MTkgWzQyN10gICAgREVCVUc6ICBTdGFydFRyYW5zYWN0aW9uQ29tbWFuZA0K
MjAwNC0wMy0wOSAxMToyMzoxOSBbNDI3XSAgICBMT0c6ICBxdWVyeTogIGRy
b3AgdGFibGUgcGdyX3FyeWVuZ2luZV9lcnIgDQoyMDA0LTAzLTA5IDExOjIz
OjE5IFs0MjddICAgIERFQlVHOiAgUHJvY2Vzc1V0aWxpdHkNCjIwMDQtMDMt
MDkgMTE6MjM6MTkgWzQyN10gICAgREVCVUc6ICBEcm9wIGF1dG8tY2FzY2Fk
ZXMgdG8gdG9hc3QgdGFibGUgcGdfdG9hc3QucGdfdG9hc3RfNTQ5Nzc4DQoy
MDA0LTAzLTA5IDExOjIzOjE5IFs0MjddICAgIERFQlVHOiAgRHJvcCBhdXRv
LWNhc2NhZGVzIHRvIHR5cGUgcGdfdG9hc3QucGdfdG9hc3RfNTQ5Nzc4DQoy
MDA0LTAzLTA5IDExOjIzOjE5IFs0MjddICAgIERFQlVHOiAgRHJvcCBhdXRv
LWNhc2NhZGVzIHRvIGluZGV4IHBnX3RvYXN0LnBnX3RvYXN0XzU0OTc3OF9p
bmRleA0KMjAwNC0wMy0wOSAxMToyMzoxOSBbNDI3XSAgICBERUJVRzogIERy
b3AgYXV0by1jYXNjYWRlcyB0byB0eXBlIHBncl9xcnllbmdpbmVfZXJyDQoy
MDA0LTAzLTA5IDExOjIzOjE5IFs0MjddICAgIERFQlVHOiAgQ29tbWl0VHJh
bnNhY3Rpb25Db21tYW5kDQo=

--0-388215251-1078846122=:39253
Content-Type: application/octet-stream; name="postmaster-ko.log"
Content-Transfer-Encoding: base64
Content-Description: postmaster-ko.log
Content-Disposition: attachment; filename="postmaster-ko.log"

MjAwNC0wMy0wOSAxMToyMzozNiBbNDI3XSAgICBERUJVRzogIFN0YXJ0VHJh
bnNhY3Rpb25Db21tYW5kDQoyMDA0LTAzLTA5IDExOjIzOjM2IFs0MjddICAg
IExPRzogIHF1ZXJ5OiBjcmVhdGUgdGFibGUgcGdyX3FyeWVuZ2luZV9lcnIg
YXMgc2VsZWN0ICogZnJvbSBwZ3JfcXJ5ZW5naW5lX2xvZyB3aGVyZSBxcnlf
cmVzdWx0ICE9JycNCjIwMDQtMDMtMDkgMTE6MjM6MzYgWzQyN10gICAgREVC
VUc6ICBQcm9jZXNzUXVlcnkNCjIwMDQtMDMtMDkgMTE6MjM6MzYgWzQyN10g
ICAgREVCVUc6ICBDb21taXRUcmFuc2FjdGlvbkNvbW1hbmQNCjIwMDQtMDMt
MDkgMTE6MjM6MzYgWzQyN10gICAgREVCVUc6ICBTSUluc2VydERhdGFFbnRy
eTogdGFibGUgaXMgNzAlIGZ1bGwsIHNpZ25hbGluZyBwb3N0bWFzdGVyDQoy
MDA0LTAzLTA5IDExOjIzOjM2IFsyMDJdICAgIERFQlVHOiAgU2lnbmFsQ2hp
bGRyZW46IHNlbmRpbmcgc2lnbmFsIDMxIHRvIHByb2Nlc3MgNDI3DQoyMDA0
LTAzLTA5IDExOjIzOjM2IFsyMDJdICAgIERFQlVHOiAgU2lnbmFsQ2hpbGRy
ZW46IHNlbmRpbmcgc2lnbmFsIDMxIHRvIHByb2Nlc3MgMzY4DQoyMDA0LTAz
LTA5IDExOjIzOjM2IFsyMDJdICAgIERFQlVHOiAgU2lnbmFsQ2hpbGRyZW46
IHNlbmRpbmcgc2lnbmFsIDMxIHRvIHByb2Nlc3MgMTI4DQoyMDA0LTAzLTA5
IDExOjIzOjM2IFsyMDJdICAgIERFQlVHOiAgU2lnbmFsQ2hpbGRyZW46IHNl
bmRpbmcgc2lnbmFsIDMxIHRvIHByb2Nlc3MgMjgyDQoyMDA0LTAzLTA5IDEx
OjIzOjM2IFsyMDJdICAgIERFQlVHOiAgU2lnbmFsQ2hpbGRyZW46IHNlbmRp
bmcgc2lnbmFsIDMxIHRvIHByb2Nlc3MgMTU0DQoyMDA0LTAzLTA5IDExOjIz
OjM2IFsyMDJdICAgIERFQlVHOiAgU2lnbmFsQ2hpbGRyZW46IHNlbmRpbmcg
c2lnbmFsIDMxIHRvIHByb2Nlc3MgMzAxDQoyMDA0LTAzLTA5IDExOjIzOjM2
IFsyMDJdICAgIERFQlVHOiAgU2lnbmFsQ2hpbGRyZW46IHNlbmRpbmcgc2ln
bmFsIDMxIHRvIHByb2Nlc3MgMjk4DQoyMDA0LTAzLTA5IDExOjIzOjM2IFs0
MjddICAgIExPRzogIEFzeW5jX05vdGlmeUhhbmRsZXI6IHBlcmZvcm0gYXN5
bmMgbm90aWZ5DQoyMDA0LTAzLTA5IDExOjIzOjM2IFs0MjddICAgIExPRzog
IFByb2Nlc3NJbmNvbWluZ05vdGlmeQ0KMjAwNC0wMy0wOSAxMToyMzozNiBb
NDI3XSAgICBMT0c6ICBQcm9jZXNzSW5jb21pbmdOb3RpZnk6IGRvbmUNCjIw
MDQtMDMtMDkgMTE6MjM6MzYgWzQyN10gICAgTE9HOiAgQXN5bmNfTm90aWZ5
SGFuZGxlcjogZG9uZQ0KMjAwNC0wMy0wOSAxMToyMzozNiBbMzY4XSAgICBM
T0c6ICBBc3luY19Ob3RpZnlIYW5kbGVyOiBwZXJmb3JtIGFzeW5jIG5vdGlm
eQ0KMjAwNC0wMy0wOSAxMToyMzozNiBbMzY4XSAgICBMT0c6ICBQcm9jZXNz
SW5jb21pbmdOb3RpZnkNCjIwMDQtMDMtMDkgMTE6MjM6MzYgWzM2OF0gICAg
TE9HOiAgUHJvY2Vzc0luY29taW5nTm90aWZ5OiBkb25lDQoyMDA0LTAzLTA5
IDExOjIzOjM2IFszNjhdICAgIExPRzogIEFzeW5jX05vdGlmeUhhbmRsZXI6
IGRvbmUNCjIwMDQtMDMtMDkgMTE6MjM6MzYgWzEyOF0gICAgTE9HOiAgQXN5
bmNfTm90aWZ5SGFuZGxlcjogcGVyZm9ybSBhc3luYyBub3RpZnkNCjIwMDQt
MDMtMDkgMTE6MjM6MzYgWzEyOF0gICAgTE9HOiAgUHJvY2Vzc0luY29taW5n
Tm90aWZ5DQoyMDA0LTAzLTA5IDExOjIzOjM2IFsxMjhdICAgIExPRzogIFBy
b2Nlc3NJbmNvbWluZ05vdGlmeTogZG9uZQ0KMjAwNC0wMy0wOSAxMToyMzoz
NiBbMTI4XSAgICBMT0c6ICBBc3luY19Ob3RpZnlIYW5kbGVyOiBkb25lDQoy
MDA0LTAzLTA5IDExOjIzOjM2IFsyODJdICAgIExPRzogIEFzeW5jX05vdGlm
eUhhbmRsZXI6IHBlcmZvcm0gYXN5bmMgbm90aWZ5DQoyMDA0LTAzLTA5IDEx
OjIzOjM2IFsyODJdICAgIExPRzogIFByb2Nlc3NJbmNvbWluZ05vdGlmeQ0K
MjAwNC0wMy0wOSAxMToyMzozNiBbMjgyXSAgICBMT0c6ICBQcm9jZXNzSW5j
b21pbmdOb3RpZnk6IGRvbmUNCjIwMDQtMDMtMDkgMTE6MjM6MzYgWzI4Ml0g
ICAgTE9HOiAgQXN5bmNfTm90aWZ5SGFuZGxlcjogZG9uZQ0KMjAwNC0wMy0w
OSAxMToyMzozNiBbMTU0XSAgICBMT0c6ICBBc3luY19Ob3RpZnlIYW5kbGVy
OiBwZXJmb3JtIGFzeW5jIG5vdGlmeQ0KMjAwNC0wMy0wOSAxMToyMzozNiBb
MTU0XSAgICBMT0c6ICBQcm9jZXNzSW5jb21pbmdOb3RpZnkNCjIwMDQtMDMt
MDkgMTE6MjM6MzYgWzE1NF0gICAgTE9HOiAgUHJvY2Vzc0luY29taW5nTm90
aWZ5OiBkb25lDQoyMDA0LTAzLTA5IDExOjIzOjM2IFsxNTRdICAgIExPRzog
IEFzeW5jX05vdGlmeUhhbmRsZXI6IGRvbmUNCjIwMDQtMDMtMDkgMTE6MjM6
MzYgWzMwMV0gICAgTE9HOiAgQXN5bmNfTm90aWZ5SGFuZGxlcjogcGVyZm9y
bSBhc3luYyBub3RpZnkNCjIwMDQtMDMtMDkgMTE6MjM6MzYgWzMwMV0gICAg
TE9HOiAgUHJvY2Vzc0luY29taW5nTm90aWZ5DQoyMDA0LTAzLTA5IDExOjIz
OjM2IFszMDFdICAgIExPRzogIFByb2Nlc3NJbmNvbWluZ05vdGlmeTogZG9u
ZQ0KMjAwNC0wMy0wOSAxMToyMzozNiBbMzAxXSAgICBMT0c6ICBBc3luY19O
b3RpZnlIYW5kbGVyOiBkb25lDQoyMDA0LTAzLTA5IDExOjIzOjM2IFsyOThd
ICAgIExPRzogIEFzeW5jX05vdGlmeUhhbmRsZXI6IHBlcmZvcm0gYXN5bmMg
bm90aWZ5DQoyMDA0LTAzLTA5IDExOjIzOjM2IFsyOThdICAgIExPRzogIFBy
b2Nlc3NJbmNvbWluZ05vdGlmeQ0KMjAwNC0wMy0wOSAxMToyMzozNiBbMjk4
XSAgICBMT0c6ICBQcm9jZXNzSW5jb21pbmdOb3RpZnk6IGRvbmUNCjIwMDQt
MDMtMDkgMTE6MjM6MzYgWzI5OF0gICAgTE9HOiAgQXN5bmNfTm90aWZ5SGFu
ZGxlcjogZG9uZQ0KMjAwNC0wMy0wOSAxMToyNDozNiBbNDI3XSAgICBMT0c6
ICBwcV9yZWN2YnVmOiB1bmV4cGVjdGVkIEVPRiBvbiBjbGllbnQgY29ubmVj
dGlvbg0KMjAwNC0wMy0wOSAxMToyNDozNiBbNDI3XSAgICBERUJVRzogIHBy
b2NfZXhpdCgwKQ0KMjAwNC0wMy0wOSAxMToyNDozNiBbNDI3XSAgICBERUJV
RzogIHNobWVtX2V4aXQoMCkNCjIwMDQtMDMtMDkgMTE6MjQ6MzYgWzQyN10g
ICAgREVCVUc6ICBleGl0KDApDQoyMDA0LTAzLTA5IDExOjI0OjM3IFsyMDJd
ICAgIERFQlVHOiAgcmVhcGluZyBkZWFkIHByb2Nlc3Nlcw0KMjAwNC0wMy0w
OSAxMToyNDozNyBbMjAyXSAgICBERUJVRzogIGNoaWxkIHByb2Nlc3MgKHBp
ZCA0MjcpIGV4aXRlZCB3aXRoIGV4aXQgY29kZSAwDQo=


--0-388215251-1078846122=:39253
Content-Type: text/plain; charset=us-ascii

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/
--0-388215251-1078846122=:39253--

- Raw text -


  webmaster     delorie software   privacy  
  Copyright © 2019   by DJ Delorie     Updated Jul 2019