| Sat, 05 Mar 2011 15:15:55 +0100 |
Georg Brandl |
Dummy-merge 3.1 branch into 3.2 branch.
3.2
|
| Tue, 22 Feb 2011 03:25:12 +0000 |
Brett Cannon |
Issue #11074: Make 'tokenize' so it can be reloaded.
|
| Thu, 11 Nov 2010 14:07:41 +0000 |
Alexander Belopolsky |
Issue #10386: Added __all__ to token module; this simplifies importing
|
| Tue, 09 Nov 2010 01:08:59 +0000 |
Victor Stinner |
Issue #10335: Add tokenize.open(), detect the file encoding using
|
| Thu, 09 Sep 2010 08:29:05 +0000 |
Raymond Hettinger |
A little bit more readable repr method.
|
| Thu, 09 Sep 2010 07:15:18 +0000 |
Raymond Hettinger |
Experiment: Let collections.namedtuple() do the work. This should work now that _collections is pre-built. The buildbots will tell us shortly.
|
| Thu, 09 Sep 2010 04:32:39 +0000 |
Raymond Hettinger |
Improve the repr for the TokenInfo named tuple.
|
| Fri, 03 Sep 2010 19:54:02 +0000 |
Florent Xicluna |
Remove unused import, fix typo and rewrap docstrings.
|
| Mon, 30 Aug 2010 14:41:20 +0000 |
Benjamin Peterson |
handle names starting with non-ascii characters correctly #9712
|
| Thu, 18 Mar 2010 22:34:15 +0000 |
Benjamin Peterson |
fix for files with coding cookies and BOMs
|
| Thu, 18 Mar 2010 22:29:52 +0000 |
Benjamin Peterson |
in tokenize.detect_encoding(), return utf-8-sig when a BOM is found
|
| Sat, 14 Nov 2009 18:09:17 +0000 |
Benjamin Peterson |
use some more itertools magic to make '' be yielded after readline is done
|
| Sat, 14 Nov 2009 16:27:26 +0000 |
Benjamin Peterson |
simply by using itertools.chain()
|
| Mon, 30 Aug 2010 14:44:53 +0000 |
Benjamin Peterson |
Merged revisions 84364 via svnmerge from
3.1
|
| Fri, 13 Nov 2009 02:29:35 +0000 |
Benjamin Peterson |
Merged revisions 76235 via svnmerge from
3.1
|
| Fri, 09 Oct 2009 21:53:27 +0000 |
Benjamin Peterson |
Merged revisions 75299 via svnmerge from
3.1
|
| Wed, 29 Apr 2009 14:21:25 +0000 |
Raymond Hettinger |
Remove dependency on the collections module.
|
| Wed, 29 Apr 2009 00:34:27 +0000 |
Raymond Hettinger |
Issue #5857: tokenize.tokenize() now returns named tuples.
|
| Tue, 24 Mar 2009 22:30:15 +0000 |
Benjamin Peterson |
reuse tokenize.detect_encoding in linecache instead of a custom solution
|
| Fri, 12 Dec 2008 01:40:00 +0000 |
Benjamin Peterson |
Merged revisions 67711 via svnmerge from
3.0
|
| Tue, 19 Aug 2008 17:56:33 +0000 |
Antoine Pitrou |
#2834: Change re module semantics, so that str and bytes mixing is forbidden,
|
| Thu, 05 Jun 2008 23:07:42 +0000 |
Benjamin Peterson |
use the more idomatic (and Py3k faster) while True
|
| Fri, 28 Mar 2008 00:55:15 +0000 |
Christian Heimes |
Merged revisions 61964-61979 via svnmerge from
|
| Tue, 18 Mar 2008 22:41:35 +0000 |
Trent Nelson |
- Issue #719888: Updated tokenize to use a bytes API. generate_tokens has been
|
| Sat, 19 Jan 2008 20:08:23 +0000 |
Georg Brandl |
Merged revisions 60080-60089,60091-60093 via svnmerge from
|
| Mon, 12 Nov 2007 17:40:10 +0000 |
Guido van Rossum |
Patch 1420 by Ron Adam.
|
| Thu, 30 Aug 2007 01:19:48 +0000 |
Collin Winter |
Raise statement normalization in Lib/.
|
| Wed, 13 Jun 2007 18:07:49 +0000 |
Guido van Rossum |
Merged revisions 55817-55961 via svnmerge from
|
| Tue, 15 May 2007 18:46:22 +0000 |
Guido van Rossum |
Merged revisions 55328-55341 via svnmerge from
|
| Sat, 21 Apr 2007 15:47:16 +0000 |
Georg Brandl |
PEP 3114: rename .next() to .__next__() and add next() builtin.
|
| Sun, 15 Apr 2007 12:05:43 +0000 |
Nick Coghlan |
Hide list comp variables and support set comprehensions
|
| Sun, 18 Mar 2007 19:01:53 +0000 |
Georg Brandl |
Make ELLIPSIS a separate token. This makes it a syntax error to write ". . ." for Ellipsis.
|
| Fri, 09 Feb 2007 05:37:30 +0000 |
Guido van Rossum |
Fix most trivially-findable print statements.
|
| Thu, 28 Dec 2006 06:47:50 +0000 |
Neal Norwitz |
PEP 3107 - Function Annotations thanks to Tony Lownds
|
| Wed, 13 Dec 2006 04:49:30 +0000 |
Thomas Wouters |
Four months of trunk changes (including a few releases...)
|
| Fri, 25 Aug 2006 04:28:18 +0000 |
Brett Cannon |
Remove support for backticks from the grammar and compiler.
|
| Thu, 24 Aug 2006 03:53:23 +0000 |
Guido van Rossum |
Killed the <> operator. You must now use !=.
|
| Mon, 25 Nov 2013 05:14:51 +0200 |
Ezio Melotti |
#19620: Fix typo in docstring (noticed by Christopher Welborn).
2.7
|
| Sat, 03 Nov 2012 17:30:51 +0200 |
Ezio Melotti |
#16152: fix tokenize to ignore whitespace at the end of the code when no newline is found. Patch by Ned Batchelder.
2.7
|
| Sat, 16 Jun 2012 21:05:50 -0500 |
Meador Inge |
Issue #15054: Fix incorrect tokenization of 'b' and 'br' string literals.
2.7
|
| Sat, 05 Mar 2011 15:15:07 +0100 |
Georg Brandl |
Dummy-merge 2.6 branch into 2.7 branch.
2.7
|
| Thu, 15 Oct 2009 03:05:39 +0000 |
Benjamin Peterson |
some cleanups
legacy-trunk
|
| Thu, 15 Oct 2009 01:49:37 +0000 |
Benjamin Peterson |
use floor division and add a test that exercises the tabsize codepath
legacy-trunk
|
| Thu, 15 Oct 2009 01:47:28 +0000 |
Benjamin Peterson |
pep8ify if blocks
legacy-trunk
|
| Sat, 05 Mar 2011 15:13:50 +0100 |
Georg Brandl |
Dummy-merge 2.5 branch into 2.6 branch.
2.6
|
| Sat, 02 Aug 2008 03:15:20 +0000 |
Brett Cannon |
Remove a tuple unpacking in a parameter list to remove a SyntaxWarning raised
legacy-trunk
|
| Thu, 05 Jun 2008 23:02:33 +0000 |
Benjamin Peterson |
revert 63965 for preformance reasons
legacy-trunk
|
| Thu, 05 Jun 2008 22:39:34 +0000 |
Benjamin Peterson |
use the more idomatic while True
legacy-trunk
|
| Thu, 27 Mar 2008 23:23:54 +0000 |
Amaury Forgeot d'Arc |
Issue2495: tokenize.untokenize did not insert space between two consecutive string literals:
legacy-trunk
|
| Mon, 17 Mar 2008 19:43:40 +0000 |
Eric Smith |
Added PEP 3127 support to tokenize (with tests); added PEP 3127 to NEWS.
legacy-trunk
|
| Sat, 19 Jan 2008 19:27:05 +0000 |
Georg Brandl |
Fix #1679: "0x" was taken as a valid integer literal.
legacy-trunk
|
| Fri, 18 Jan 2008 18:24:07 +0000 |
Christian Heimes |
Added bytes and b'' as aliases for str and ''
legacy-trunk
|
| Sat, 02 Dec 2006 02:00:39 +0000 |
Raymond Hettinger |
Add name to credits (for untokenize).
legacy-trunk
|
| Wed, 23 Aug 2006 21:26:46 +0000 |
Jeremy Hylton |
Replace dead code with an assert.
legacy-trunk
|
| Wed, 23 Aug 2006 21:14:03 +0000 |
Jeremy Hylton |
Bug fixes large and small for tokenize.
legacy-trunk
|
| Thu, 27 Mar 2008 23:41:59 +0000 |
Amaury Forgeot d'Arc |
Issue2495: tokenize.untokenize did not insert space between two consecutive string literals:
2.5
|
| Mon, 14 Aug 2006 21:34:08 +0000 |
Georg Brandl |
Make tabnanny recognize IndentationErrors raised by tokenize.
legacy-trunk
|
| Thu, 30 Mar 2006 21:43:35 +0000 |
Guido van Rossum |
Insert a safety space after numbers as well as names in untokenize().
legacy-trunk
|
| Tue, 21 Jun 2005 07:43:58 +0000 |
Raymond Hettinger |
SF bug #1224621: tokenize module does not detect inconsistent dedents
legacy-trunk
|
| Fri, 10 Jun 2005 11:05:19 +0000 |
Raymond Hettinger |
Add untokenize() function to allow full round-trip tokenization.
legacy-trunk
|
