Mailing-List: contact cygwin-help AT sourceware DOT cygnus DOT com; run by ezmlm List-Subscribe: List-Archive: List-Post: List-Help: , Sender: cygwin-owner AT sources DOT redhat DOT com Delivered-To: mailing list cygwin AT sources DOT redhat DOT com Date: Tue, 7 Aug 2001 16:10:42 -0400 From: Jason Tishler To: "Gerrit P. Haase" Cc: Cygwin , Olaf Foellinger Subject: Re: Transient fetchmail corruption problem under Windows 2000 Message-ID: <20010807161042.A576@dothill.com> Mail-Followup-To: "Gerrit P. Haase" , Cygwin , Olaf Foellinger Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="bfXbWnd9KoPDiCug" Content-Disposition: inline In-Reply-To: <3B705CEB.5417.1F137AC@localhost> User-Agent: Mutt/1.3.18i Organization: Dot Hill Systems Corp. --bfXbWnd9KoPDiCug Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Gerrit, [This message was received corrupted... I have attached it for perusal by the curious.] On Tue, Aug 07, 2001 at 09:26:03PM +0100, Gerrit P. Haase wrote: > What are the types of the binary attachments? Actually, after further investigation it appears that even plain text attachments are affected too. > Is it various or are there only some files corrupted or are all=20 > attachment=00 destroyed? ^^ Note the null character above, this is part of the corruption. If I send the same message (which includes an attachment) to myself repeatedly, most of the time to it is corrupted when fetched via POP by fetchmail. > Sorry, I don't know enough to help you out of this misere since i=20 > never used procmail, but io have some more questions. Thanks for the sympathy and yes, this is misery! > Jason, do you use also use ssmtp as Olaf mentioned? Yes. > Anyway, since it only happens on NT5 and not on NT4 as you reported, > it seems not to be a problem with Fetchmail. I'm not so sure. Maybe Windows 2000 tickles a buffer overrun problem that does occur under NT 4.0? > Since Fetchmail does=20 > nothing else but retrieve and send out to a smtp server i could not=20 > think of big problems with this. Or is it an option to pipe directly=20 > from fetchmail to procmail? I have fetchmail configured to pipe directly into procmail. Note that this is a very typical configuration and IIRC, fetchmail attempts to pipe into procmail when it can't find a SMTP listener. > Are the files stored to disk between retrieving and sending out? I don't know. > Does Procmail store to disk before delivering? I don't know. > Are your mounts of binary type? Yes. > Please report if you track down the source of the problems, maybe a=20 > problem with the pipes? After further experimentation, I believe that I have ruled out procmail as a potential culprit. I replaced procmail with a shell script that just cats stdin to a file. Even without procmail in the picture, I'm still getting corrupted messages. Hence, the problem is with fetchmail (or Cygwin itself). > Olaf could you please report exactely what you do to send out a=20 > corrupt message? Is it a known issue? I never heard before of=20 > problems with mailing through ssmtp on win2k. > I will try tomorrow to send some mail with ssmtp and binaries=20 > attached. I have not had any problems sending email (without or with attachments) with ssmtp under Windows 2000. Thanks, Jason --=20 Jason Tishler Director, Software Engineering Phone: 732.264.8770 x235 Dot Hill Systems Corp. Fax: 732.264.8798 82 Bethany Road, Suite 7 Email: jason AT tishler DOT net Hazlet, NJ 07730 USA WWW: http://www.dothill.com --bfXbWnd9KoPDiCug Content-Type: message/rfc822 Content-Disposition: inline Return-Path: Received: from mh3-sfba.mail.home.com ([24.0.95.134]) by femail22.sdc1.sfba.home.com (InterMail vM.4.01.03.20 201-229-121-120-20010223) with ESMTP id <20010807192452 DOT UXSZ9561 DOT femail22 DOT sdc1 DOT sfba DOT home DOT com AT mh3-sfba DOT mail DOT home DOT com> for ; Tue, 7 Aug 2001 12:24:52 -0700 Received: from mx3-sfba.mail.home.com (mx3-sfba.mail.home.com [24.0.95.138]) by mh3-sfba.mail.home.com (8.9.3/8.9.0) with ESMTP id MAA04430 for ; Tue, 7 Aug 2001 12:24:51 -0700 (PDT) Received: from lmg03.affinity.com (lmg.ahnet.net [207.150.192.13]) by mx3-sfba.mail.home.com (8.11.1/8.11.1) with ESMTP id f77JOpx28535 for ; Tue, 7 Aug 2001 12:24:51 -0700 (PDT) Received: from mail.ahnet.net ([207.150.192.80]) by lmg.ahnet.net with ESMTP id <290661-20165>; Tue, 7 Aug 2001 12:24:26 -0700 Received: from lmg02.affinity.com (lmg.ahnet.net [207.150.192.13]) by mail.ahnet.net (Postfix) with ESMTP id AB2D7AB8C for ; Tue, 7 Aug 2001 12:23:56 -0700 (PDT) Received: from mailout04.sul.t-online.de ([194.25.134.18]) by lmg.ahnet.net with ESMTP id <290807-18356>; Tue, 7 Aug 2001 12:23:53 -0700 Received: from fwd07.sul.t-online.de by mailout04.sul.t-online.de with smtp id 15UCSC-0002pj-08; Tue, 07 Aug 2001 21:23:48 +0200 Received: from brunhilde (320081107336-0001@[193.159.109.78]) by fmrl07.sul.t-online.com with esmtp id 15UCS7-0SW8TQC; Tue, 7 Aug 2001 21:23:43 +0200 From: "Gerrit P. Haase" To: Cygwin Date: Tue, 7 Aug 2001 21:26:03 +0100 Subject: Re: Transient fetchmail corruption problem under Windows 2000 Cc: Olaf Foellinger , Jason Tishler Message-ID: <3B705CEB DOT 5417 DOT 1F137AC AT localhost> Priority: normal In-reply-to: <20010807153939 DOT N1172 AT NBOF> Illegal-Object: Syntax error in References: value found on lmg.ahnet.net: References: <20010807113110 DOT A1412 AT dothill DOT com>; from jason@ tishler. net on Tue, Aug 07, 2001 at 11: 31: 10AM -0400 ^ ^ ^ ^ ^ ^ ^-illegal reference separator | | | | | \-illegal reference separator | | | | \-illegal reference separator | | | \-illegal reference separator | | \-illegal reference separator | \-illegal reference separator \-illegal reference separator X-mailer: Pegasus Mail for Win32 (v3.12cDE) X-Sender: 320081107336-0001 AT t-dialin DOT net Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline; filename=mutt-ALTHEA-576-12 Content-Transfer-Encoding: quoted-printable Am 7 Aug 2001, um 15:39 hat Olaf Foellinger geschrieben: > On Tue, Aug 07, 2001 at 11:31:10AM -0400, Jason Tishler wrote: > > [I normally would not post such a vague bug report but since this > > problem significantly impacts my mail delivery I hope that I will be > > allowed some latitude...] > >=20 > > I am using fetchmail/procmail/mutt to retrieve, process, and read my > > email. I recently changed from using a Windows NT 4.0 SP5 to a > > Windows 2000 SP1 machine. Shortly thereafter, I started to notice > > that some of the emails that I received with binary attachments were > > corrupted. What are the types of the binary attachments? Is it various or are there only some files corrupted or are all=20 attachment=00 destroyed? > > After sending the same message to myself repeatedly and examining > > the raw message in an mbox file, I began to see the following > > pattern. The corrupted messages are always larger than they should > > be and there are chunks of garbage characters in them. Sometimes > > the MIME separators are repeated as if fetchmail shuttered when > > writing to down the pipe to procmail (this is probably just a > > special case of the garbage characters). > >=20 > > Not all messages get corrupted. A little more half were corrupted > > -- the others were fine. IA little more half were corrupted > > -- the others were fine. Iwere corrupted > > -- the others were fine. I Irs were fine. Iupted. A little more half= were corrupted > > -- the others were fine. Ited. A little more half were corrupted > > -- the others were fine. I. A little more half were corrupted > > -- the others were fine. Iupted. A little more half were corrupted > > -- the others were fine. Ine. I> > -- the others were fine. Iupted. = A little more half were corrupted > > -- the others were fine. Ied. A little more half were corrupted > > -- the others were fine. IA little more half were corrupted > > -- the others were fine. I I more half were corrupted > > -- the others were fine. I -- the others were fine. Ire corrupted > > -- the others were fine. Irrupted > > -- the others were fine. I were corrupted > > -- the others were fine. Imore half were corrupted > > -- the others were fine. Ittle more half were corrupted > > -- the others were fine. I A little more half were corrupted > > -- the others were fine. I>> food.what() I a> food.__class__.__bases__ =3D (Eggs, Spam) >>> food.what() I a> food.__class__.__bases__ =3D (Eggs, Spam) >>> food.what() I a >>> food.__class__.__bases__ =3D (Eggs, Spam) >>> food.what() I a>> food.__class__.__bases__ =3D (Eggs, Spam) >>> food.what() I a aases__ =3D (Eggs, Spam) >>> food.what() I a >>> food.__class__.__bases__ =3D (Eggs, Spam) >>> food.what() I aw=B0#=F8w=FF=FF=FF=FF=C0=C2F=02=00=A1=FCwX=0CG=02=A4=C5F=02=EE=00=00=00= =00=00=00=00=F0"=F8w=FF=FF=FF=FF=E0=C1F=02=E0=A5=FCw|=C1F=02=1F=00=00=00q#= =F8wX=0CG=02=00=00G=02=1F=00=00=00`=F4G=02=01=00=00=00=FC=01=00=00=0C=C3F= =02E=90=FBw=B0#=F8w=FF=FF=FF=FF=1C=C3F=02=00=A1=FCwX=0CG=02=DC=C5F=02=EE=00= =00=00=00=00=00=00=C4=C1F=02=00=00=00=00=D2"=F8w=00=00G=02H[G=02=00=00=00= =00=A0=C1F=02=88=06G=02T=C2F=02E=90=FBw=F0"=F8w=FF=FF=FF=FFd=C2F=02=E0=A5= =FCw=D8 G=02P[G=02=98=C2F=02=F4=C2=01=00=00=00=FC=01=00=00=F8w=01=00=00=00=FC=01=00= =00=1C=C2F=02=00=00=00=00=D2"=F8w=00=00G=02X=F4G=02=04=00=00=00=08=00=00=00= =9C=C2F=02.x=F8w=12=C3F=02t=C2F=02=08=00=00=00=12=C3F=02=F4=C4F=02=04=00=02= =00`=F4G=02=A4=C5F=02=17o=F8w=00=00=00=00=00=9F=B4t=15%=AFG=E8=03=00=00=01y= =F8wx=C2F=02=F4=C2F=02=10=00=00=00=80=C2F=02=9At=F8w=D8=F4G=02=90=9A=DBw=10= =00=00=001=002=000=002=006=006=001=000=000=000=00=00=00=00=00=00=00=00=00= =1C=C2F=02=D7=00=00=00=CC=CFF=02E=90=FBwXx=F8w\=00=00=00=F4=C4F=02=05=00=02= =00=D0=C4F=02pw=F8wn[G=02=C8=C4F=02=00=00=00=00=80=C5F=02=19=00=02=00S=00-= =001=00-=005=00-=002=001=00-=008=003=009=005=002=002=001=001=005=00-=001=00= 9=005=007=009=009=004=004=008=008=00-=001=002=000=002=006=006=000=006=002= =009=00-=001=000=000=000=00=00=00=B0#=F8w=FF=FF=FF=FF=01=00=00=00=FC=01=00= =00=D8 G=02=00=00=00=00=80=C5F=02=19=00=02=00E=00G=00I=00S=00T=00R=00Y=00=01=00=00= =00=04=02=00=00H=00I=00N=00E=00=01=00=00=00=04=02=00=00T=00W=00A=00R=00E=00= \=00C=00L=00A=00S=00S=00E=00S=00\=00W=00i=00n=00N=00T=00N=00a=00m=00e=00s= =00p=00a=00c=00e=00\=00C=00L=00S=00I=00D=00=00=00=00=00N=00E=00\=00S=00O=00= F=00T=00W=00A=00R=00E=00\=00C=00L=00A=00S=00S=00E=00S=00\=00W=00i=00n=00N= =00T=00N=00a=00m=00e=00s=00p=00a=00c=00e=00\=00=BC=C5F=02=00=00=00=00=00=00= =C1w=D8=00=C1w=F0=C3F=02L=C5F=02=DC=C4F=02=00=00=00=000=C4F=02~/=F8w=00=00= =C1w=01=00=00=00=02=00=00=00=BC=C4F=02=D8=00=C1w=00=10=C6w@=12=C6w=01=00=00= =00=BCh=F8w =04=00=00=00=10=C6w=00=00=00=00=00=00=C1w=00=00=C1w=D8=00=C1wD= =C4F=02=F8=C4F=02=F8=C4F=02=00=00=C1w=84=C4F=02~/=F8w=00=00=C1w=01=00=00=00= =02=00=00=00=E4=C4F=02=D8=00=C1w=00=00=C1w=08=C5F=02=D7j=F8w=00=00=C1w=01= =00=00=00=02=00=00=00=E4=C4F=02=BC=C5F=02*=00=00=00=00=00=00=00 =04=00=00= =C8=10=C6w =04=00=00=00=00=00=00=18=14=C6w=E0q=00=00@=12=C6w=00=00=00=00.j= =F8w=00=00=8Ewp=CEF=02.j=F8w=00=005w|=CEF=02=01=00=00=00=01=00=00=00=FC=01= =00=00=00=10=C6w=9C=C4F=02=CC=CFF=02=10=00=00=00=E6=05=C6w=E6=05=C6w=02=00= =00=00X=C5F=02=F1}=E2w=E6=05=C6w=EA=05=C6w;~=E2w=E6=05=C6w=E8=05=C6w=C8=FF= =C5w=B1h=E1w=BCR=E8w=00=00=00=00=01=00=00=00=00=00=00=000=00=00=00=00=00=00= =00=A2=00=00=00=00=00=00=00=FC=FF=FF=FF=A4=C5F=02=DA=03=00=00 =CDF=02=F9z= =E2w=FF=FF=FF=FF=1A{=C1w=02=00=00=00=C0t=C1w=A0=05=C6w=B4z=C1w=AC=8E75?h=00= =00=D2=11=00=00=A8=00=00=00=9A=00=00=00=00=00=00=00=C0=00=00=00O=00=00=00= =BB=00=00=00=CF=00=00=00=A2=00=00=00us=C1w=A8=F1=C5w=A0=05=C6w=00=00=00=00P= =CFF=02=00=00=00=00T=00e=00m=00p=00=00=00r=00y=00=00=00y=00 =00I=00n=00t=00= e=00r=00n=00e=00t=00 =00F=00i=00l=00e=00s=00=00=00s=00=00=00=00=00=01=00=00= =00=00=00=00=00B=C6F=02=05@=00=80D=C8F=02;=9F=01=00=00=00=04=02=00=00=00=00= =A8=CAF=02=8C=A1=A5w@=C6F=02=E8=CBG=02=00=00=00=00=A8=CAF=02[=A2=A5wQ=AD=FC= w=FF=FF=FF=FFl=C6F=02=00=00=00=00=8C=C6F=02=00=10=00=00=04=00=01=00=00=00= =04=02=00=00G=020 H=02=00=00=00=00@=06G=02=94=C6F=02E=00=00=00q#=F8wx=13G=02=00=00G=02E=00=00= =00=D8!G=02l=C6F=02=00=02=00=00$=C8F=02E=90=FBw=B0#=F8w=FF=FF=FF=FF4=C8F=02= =00=A1=FCwx=13G=02 =02=00=00=1A=02=00=00=00=00=00=00=08=02=00=00=00=00=00=00=A8=C6F=02=88=06G= =02\=C7F=02E=90=FBw=F0"=F8wx=01G=02x=01G=02=E0=A5=FCw=04=C7F=02X=C8F=02=EC= =C6F=02`=C8F=02=14G=F8w=1A=00=00=800=C8F=02=C4=A1=DBw=1A=00=00=80=D4=CEF=02= =00=00=00=00=00=00=00=00=B8=C6F=02=0C=00=00=00=00=00=00=00|=C6F=02PGe=04=B0= =B2G=02=EC=B2G=02=F8=C9F=02=E0=E0=FCw)A=F8w=18=00=00=00=00=00=00=00=00=00= =00=00=00=00=00=00\=C7F=02(=00 =00=00=00=00=00=00=00=00=00=00=00=00=00=00= =00=00=00=00=00=00=00$=00=02=00=00=00=00=00=00=00=00=00=00=00=00=00=A4=CEF= =026=008=00=F0+=F8wp=E1=FCwx>=F8w^>=F8w=08=02=00=00=1A=02=00=00=D8!G=02=88= =02=C7w=F8=EB=FD=7F=00=00=00=00=F0)=B3w=01=C7F=02=1B=00=00=00=02=00=00=00= =9C=B3G=02=84=CAF=02=00=00=00=00=99q=F8w=12=EC=FD=7F=8C=B3G=02=00=00=00=00C= =02Sw=9C=C8F=026=00=00=00=A0=02=D4w=03=00=00=00=00=00=00=006=00=08=02T9G=02= 6=008=00=A4=CEF=02=00q=F8wC=00=00=00=9E=C8F=02=00=00=00=00=00=00=00=006=00= =00=00=00=00=00=00x=02=DBw=F8=EB=FD=7F=00=E0=FD=7F=00=E0=FD=7F=C8=CAF=02E= =90=FBw=80>=F8w=FF=FF=FF=FF=D8=CAF=02=1A=02=00=00=08=00=00=00=D8=CAF=02=F0+= =F8wp=E1=FCw|@=F8wT@=F8w=A4=CEF=02=12=02=00=00=00=00=00=00=00=00$=C7F=02E= =00=00=00q#=F8w0=C7F=02=07=00=00=00q#=F8w=D8=07G=02=00=00G=02=07=00=00=00= =B8=D7G=02=08=C7F=02=00=02=00=00=C0=C8F=02E=90=FBw=B0#=F8w=FF=FF=FF=FF=D0= =C8F=02=00=A1=FCw=D8=07G=02=00=00=00=00 =00=00=00=00=00=00=00=00=00=00=00= =00=00=00=00=00=00=00=88=C7F=02 s destroyed? > > After sending the same message to myself repeatedly and examining > > the raw message in an mbox file, I began to see the following > > pattern. The corrupted messages are always larger than they should > > be and there are chunks of garbage characters in them. Sometimes > > the MIME separators are repeated as if fetchmail shuttered when > > writing to down the pipe to procmail (this is probably just a > > special case of the garbage characters). > >=20 > > Not all messages get corrupted. A little more half were corrupted > > -- the others were fine. I also POP-ed directly into the mail > > server and verified that the messages were not corrupt and only > > became so when I used fetchmail to retrieve them. > >=20 > > I tried various versions of fetchmail (5.8.12, 5.8.14, 5.8.16) and > > Cygwin (1.3.2, my CVS build, latest snapshot). All exhibit the same > > transient binary attachment corruption problem. > >=20 > > When I repeat the same experiments on my old Windows NT 4.0 SP5 > > machine, I have not received any corrupted email (yet). > >=20 > > Is anyone using fetchmail under Windows 2000? If so, are you > > experience any problems? >=20 > I don't use fetchmail, but with mutt and ssmtp all my sent binary > attachments get corrupted on W2000SP1. Don't know why, didn't try it > under NT. Sorry, I don't know enough to help you out of this misere since i=20 never used procmail, but io have some more questions. Jason, do you use also use ssmtp as Olaf mentioned? Anyway, since it only happens on NT5 and not on NT4 as you reported, it seems not to be a problem with Fetchmail. Since Fetchmail does=20 nothing else but retrieve and send out to a smtp server i could not=20 think of big problems with this. Or is it an option to pipe directly=20 from fetchmail to procmail? Are the files stored to disk between retrieving and sending out? Does Procmail store to disk before delivering? Are your mounts of binary type? Please report if you track down the source of the problems, maybe a=20 problem with the pipes? Olaf could you please report exactely what you do to send out a=20 corrupt message? Is it a known issue? I never heard before of=20 problems with mailing through ssmtp on win2k. I will try tomorrow to send some mail with ssmtp and binaries=20 attached. Gerrit --=20 =3D^..^=3D --bfXbWnd9KoPDiCug Content-Type: text/plain; charset=us-ascii -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Bug reporting: http://cygwin.com/bugs.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/ --bfXbWnd9KoPDiCug--