cpython-lru_cache-weakref: Doc/lib/libtokenize.tex history

Add \exception markup

Sat, 13 May 2006 06:53:31 +0000

Add \exception markup

fix typo. \var vs \variable

Sat, 11 Jun 2005 08:16:04 +0000

fix typo. \var vs \variable

Add untokenize() function to allow full round-trip tokenization.

Fri, 10 Jun 2005 11:05:19 +0000

Add untokenize() function to allow full round-trip tokenization.

Should significantly enhance the utility of the module by supporting
the creation of tools that modify the token stream and writeback the
modified result.

Turns out Neil didn't intend for all of his gen-branch work to get

Fri, 29 Jun 2001 23:51:08 +0000

Turns out Neil didn't intend for *all* of his gen-branch work to get
committed.

tokenize.py: I like these changes, and have tested them extensively
without even realizing it, so I just updated the docstring and the docs.

tabnanny.py: Also liked this, but did a little code fiddling. I should
really rewrite this to *exploit* generators, but that's near the bottom
of my effort/benefit scale so doubt I'll get to it anytime soon (it
would be most useful as a non-trivial example of ideal use of generators;
but test_generators.py has already grown plenty of food-for-thought
examples).

inspect.py: I'm sure Ping intended for this to continue running even
under 1.5.2, so I reverted this to the last pre-gen-branch version. The
"bugfix" I checked in in-between was actually repairing a bug *introduced*
by the conversion to generators, so it's OK that the reverted version
doesn't reflect that checkin.

Explain the difference between NL and NEWLINE.

Fri, 23 Mar 2001 05:22:12 +0000

Explain the difference between NL and NEWLINE.

added description of NL token

Wed, 28 Feb 2001 22:05:41 +0000

added description of NL token

Fix a couple of grammatical errors reported by Detlef Lannert

Fri, 23 Apr 1999 20:00:53 +0000

Fix a couple of grammatical errors reported by Detlef Lannert

Documentation for pyclbr and tokenize modules.

Thu, 18 Feb 1999 21:06:50 +0000

Documentation for pyclbr and tokenize modules.