X-Authentication-Warning: delorie.com: mail set sender to djgpp-bounces using -f
From: "Bill Cunningham" <nospam AT nspam DOT net>
Newsgroups: comp.os.msdos.djgpp
Subject: Tokenizing
Date: Sat, 15 May 2004 06:47:12 -0400
Organization: Posted via Supernews, http://www.supernews.com
Message-ID: <10abt7pn4699h2a@corp.supernews.com>
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1409
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1409
X-Complaints-To: abuse AT supernews DOT com
Lines: 6
To: djgpp AT delorie DOT com
DJ-Gateway: from newsgroup comp.os.msdos.djgpp
Reply-To: djgpp AT delorie DOT com

    I've just learned of something new called tokenizing. Is this done by
djgpp before parsing?

    Bill