log Lib/tokenize.py @ 51749:1408feec0084 3.0

age author description
Fri, 12 Dec 2008 01:40:00 +0000 Benjamin Peterson Merged revisions 67711 via svnmerge from 3.0
Tue, 19 Aug 2008 17:56:33 +0000 Antoine Pitrou #2834: Change re module semantics, so that str and bytes mixing is forbidden,
Thu, 05 Jun 2008 23:07:42 +0000 Benjamin Peterson use the more idomatic (and Py3k faster) while True
Fri, 28 Mar 2008 00:55:15 +0000 Christian Heimes Merged revisions 61964-61979 via svnmerge from
Tue, 18 Mar 2008 22:41:35 +0000 Trent Nelson - Issue #719888: Updated tokenize to use a bytes API. generate_tokens has been
Sat, 19 Jan 2008 20:08:23 +0000 Georg Brandl Merged revisions 60080-60089,60091-60093 via svnmerge from
Mon, 12 Nov 2007 17:40:10 +0000 Guido van Rossum Patch 1420 by Ron Adam.
Thu, 30 Aug 2007 01:19:48 +0000 Collin Winter Raise statement normalization in Lib/.
Wed, 13 Jun 2007 18:07:49 +0000 Guido van Rossum Merged revisions 55817-55961 via svnmerge from
Tue, 15 May 2007 18:46:22 +0000 Guido van Rossum Merged revisions 55328-55341 via svnmerge from
Sat, 21 Apr 2007 15:47:16 +0000 Georg Brandl PEP 3114: rename .next() to .__next__() and add next() builtin.
Sun, 15 Apr 2007 12:05:43 +0000 Nick Coghlan Hide list comp variables and support set comprehensions
Sun, 18 Mar 2007 19:01:53 +0000 Georg Brandl Make ELLIPSIS a separate token. This makes it a syntax error to write ". . ." for Ellipsis.
Fri, 09 Feb 2007 05:37:30 +0000 Guido van Rossum Fix most trivially-findable print statements.
Thu, 28 Dec 2006 06:47:50 +0000 Neal Norwitz PEP 3107 - Function Annotations thanks to Tony Lownds
Wed, 13 Dec 2006 04:49:30 +0000 Thomas Wouters Four months of trunk changes (including a few releases...)
Fri, 25 Aug 2006 04:28:18 +0000 Brett Cannon Remove support for backticks from the grammar and compiler.
Thu, 24 Aug 2006 03:53:23 +0000 Guido van Rossum Killed the <> operator. You must now use !=.
Mon, 25 Nov 2013 05:14:51 +0200 Ezio Melotti #19620: Fix typo in docstring (noticed by Christopher Welborn). 2.7
Sat, 03 Nov 2012 17:30:51 +0200 Ezio Melotti #16152: fix tokenize to ignore whitespace at the end of the code when no newline is found. Patch by Ned Batchelder. 2.7
Sat, 16 Jun 2012 21:05:50 -0500 Meador Inge Issue #15054: Fix incorrect tokenization of 'b' and 'br' string literals. 2.7
Sat, 05 Mar 2011 15:15:07 +0100 Georg Brandl Dummy-merge 2.6 branch into 2.7 branch. 2.7
Thu, 15 Oct 2009 03:05:39 +0000 Benjamin Peterson some cleanups legacy-trunk
Thu, 15 Oct 2009 01:49:37 +0000 Benjamin Peterson use floor division and add a test that exercises the tabsize codepath legacy-trunk
Thu, 15 Oct 2009 01:47:28 +0000 Benjamin Peterson pep8ify if blocks legacy-trunk
Sat, 05 Mar 2011 15:13:50 +0100 Georg Brandl Dummy-merge 2.5 branch into 2.6 branch. 2.6
Sat, 02 Aug 2008 03:15:20 +0000 Brett Cannon Remove a tuple unpacking in a parameter list to remove a SyntaxWarning raised legacy-trunk
Thu, 05 Jun 2008 23:02:33 +0000 Benjamin Peterson revert 63965 for preformance reasons legacy-trunk
Thu, 05 Jun 2008 22:39:34 +0000 Benjamin Peterson use the more idomatic while True legacy-trunk
Thu, 27 Mar 2008 23:23:54 +0000 Amaury Forgeot d'Arc Issue2495: tokenize.untokenize did not insert space between two consecutive string literals: legacy-trunk
Mon, 17 Mar 2008 19:43:40 +0000 Eric Smith Added PEP 3127 support to tokenize (with tests); added PEP 3127 to NEWS. legacy-trunk
Sat, 19 Jan 2008 19:27:05 +0000 Georg Brandl Fix #1679: "0x" was taken as a valid integer literal. legacy-trunk
Fri, 18 Jan 2008 18:24:07 +0000 Christian Heimes Added bytes and b'' as aliases for str and '' legacy-trunk
Sat, 02 Dec 2006 02:00:39 +0000 Raymond Hettinger Add name to credits (for untokenize). legacy-trunk
Wed, 23 Aug 2006 21:26:46 +0000 Jeremy Hylton Replace dead code with an assert. legacy-trunk
Wed, 23 Aug 2006 21:14:03 +0000 Jeremy Hylton Bug fixes large and small for tokenize. legacy-trunk
Thu, 27 Mar 2008 23:41:59 +0000 Amaury Forgeot d'Arc Issue2495: tokenize.untokenize did not insert space between two consecutive string literals: 2.5
Mon, 14 Aug 2006 21:34:08 +0000 Georg Brandl Make tabnanny recognize IndentationErrors raised by tokenize. legacy-trunk
Thu, 30 Mar 2006 21:43:35 +0000 Guido van Rossum Insert a safety space after numbers as well as names in untokenize(). legacy-trunk
Tue, 21 Jun 2005 07:43:58 +0000 Raymond Hettinger SF bug #1224621: tokenize module does not detect inconsistent dedents legacy-trunk
Fri, 10 Jun 2005 11:05:19 +0000 Raymond Hettinger Add untokenize() function to allow full round-trip tokenization. legacy-trunk
Tue, 21 Jun 2005 07:53:56 +0000 Raymond Hettinger SF bug #1224621: tokenize module does not detect inconsistent dedents 2.4
Mon, 02 Aug 2004 06:10:11 +0000 Anthony Baxter PEP-0318, @decorator-style. In Guido's words: legacy-trunk
Thu, 27 Feb 2003 20:14:51 +0000 Guido van Rossum Get rid of many apply() calls. legacy-trunk
Tue, 05 Nov 2002 06:06:02 +0000 Raymond Hettinger SF 633560: tokenize.__all__ needs "generate_tokens" legacy-trunk
Sat, 24 Aug 2002 06:54:19 +0000 Guido van Rossum Speed up the most egregious "if token in (long tuple)" cases by using legacy-trunk
Thu, 23 May 2002 15:15:30 +0000 Tim Peters Whitespace normalization. legacy-trunk
Wed, 15 May 2002 02:56:03 +0000 Raymond Hettinger Added docstrings excerpted from Python Library Reference. legacy-trunk
Mon, 01 Apr 2002 00:28:59 +0000 Tim Peters Remove some now-obsolete generator future statements. legacy-trunk
Tue, 26 Mar 2002 16:20:26 +0000 Neal Norwitz Cleanup x so it is not left in module legacy-trunk
Tue, 05 Nov 2002 06:08:11 +0000 Raymond Hettinger SF 633560: tokenize.__all__ needs "generate_tokens" 2.2
Mon, 07 Oct 2002 01:18:17 +0000 Tim Peters Whitespace normalization. 2.2
Wed, 15 May 2002 03:50:31 +0000 Raymond Hettinger Add docstrings excerpted from the library reference. 2.2
Thu, 30 Aug 2001 20:51:59 +0000 Tim Peters SF patch #455966: Allow leading 0 in float/imag literals. legacy-trunk
Wed, 08 Aug 2001 05:04:07 +0000 Guido van Rossum Add new tokens // and //=, in support of PEP 238. legacy-trunk
Fri, 20 Jul 2001 19:05:50 +0000 Fred Drake Use string.ascii_letters instead of string.letters (SF bug #226706). legacy-trunk
Sun, 15 Jul 2001 21:08:29 +0000 Guido van Rossum Preliminary support for "from __future__ import generators" to enable legacy-trunk
Fri, 29 Jun 2001 23:51:08 +0000 Tim Peters Turns out Neil didn't intend for *all* of his gen-branch work to get legacy-trunk
Mon, 18 Jun 2001 22:08:13 +0000 Tim Peters Merging the gen-branch into the main line, at Guido's direction. Yay! legacy-trunk
Fri, 23 Mar 2001 05:22:49 +0000 Ka-Ping Yee Provide a StopTokenizing exception for conveniently exiting the loop. legacy-trunk