cpython-lru_cache-weakref: Lib/email/_header_value_parser.py history

Merge: #18431: Decode encoded words in atoms in new email parser.

Fri, 12 Jul 2013 16:01:10 -0400

Merge: #18431: Decode encoded words in atoms in new email parser.

Merge: #18044: Fix parsing of encoded words of the form =?utf8?q?=XX...?=

Thu, 11 Jul 2013 15:58:07 -0400

Merge: #18044: Fix parsing of encoded words of the form =?utf8?q?=XX...?=

Issue #17516: use comment syntax for comments, instead of multiline string

Tue, 26 Mar 2013 01:11:54 +0100

Issue #17516: use comment syntax for comments, instead of multiline string

Merge with 3.3, issue #17047: remove doubled words added in 3.3,

Mon, 11 Mar 2013 18:36:38 -0400

Merge with 3.3, issue #17047: remove doubled words added in 3.3,
as reported by Serhiy Storchaka and Matthew Barnett.

utilize yield from

Mon, 01 Oct 2012 12:53:43 -0700

utilize yield from

#18431: Decode encoded words in atoms in new email parser.

Fri, 12 Jul 2013 16:00:28 -0400

#18431: Decode encoded words in atoms in new email parser.

There is more to be done here in terms of accepting RFC invalid
input that some mailers accept, but this covers the valid
RFC places where encoded words can occur in structured headers.

#18044: Fix parsing of encoded words of the form =?utf8?q?=XX...?=

Thu, 11 Jul 2013 15:52:57 -0400

#18044: Fix parsing of encoded words of the form =?utf8?q?=XX...?=

The problem was I was only checking for decimal digits after the third '?',
not for *hex* digits :(.

This changeset also fixes a couple of comment typos, deletes an unused
function relating to encoded word parsing, and removed an invalid
'if' test from the folding function that was revealed by the tests
written to validate this issue.

Issue #17047: remove doubled words added in 3.3

Mon, 11 Mar 2013 18:34:00 -0400

Issue #17047: remove doubled words added in 3.3
as reported by Serhiy Storchaka and Matthew Barnett.

#15160: Extend the new email parser to handle MIME headers.

Sun, 24 Jun 2012 05:03:27 -0400

#15160: Extend the new email parser to handle MIME headers.

This code passes all the same tests that the existing RFC mime header
parser passes, plus a bunch of additional ones.

There are a couple of commented out tests where there are issues with the
folding. The folding doesn't normally get invoked for headers parsed from
source, and the cases are marginal anyway (headers with invalid binary data)
so I'm not worried about them, but will fix them after the beta.

There are things that can be done to make this API even more convenient, but I
think this is a solid foundation worth having. And the parser is a full RFC
parser, so it handles cases that the current parser doesn't. (There are also
probably cases where it fails when the current parser doesn't, but I haven't
found them yet ;)

Oh, yeah, and there are some really ugly bits in the parser for handling some
'postel' cases that are unfortunately common.

I hope/plan to to eventually refactor a lot of the code in the parser which
should reduce the line count...but there is no escaping the fact that the
error recovery is welter of special cases.

Recognize '<>' as a special case of an angle-addr in header_value_parser.

Sat, 26 May 2012 14:31:12 -0400

Recognize '<>' as a special case of an angle-addr in header_value_parser.

Although '<>' is invalid according to RFC 5322, SMTP uses it for various
things, and it sometimes ends up in email headers. This patch changes
get_angle_addr to recognize it and just register a Defect instead of raising a
parsing error.

#12586: add provisional email policy with new header parsing and folding.

Fri, 25 May 2012 18:42:14 -0400

#12586: add provisional email policy with new header parsing and folding.

When the new policies are used (and only when the new policies are explicitly
used) headers turn into objects that have attributes based on their parsed
values, and can be set using objects that encapsulate the values, as well as
set directly from unicode strings. The folding algorithm then takes care of
encoding unicode where needed, and folding according to the highest level
syntactic objects.

With this patch only date and time headers are parsed as anything other than
unstructured, but that is all the helper methods in the existing API handle.
I do plan to add more parsers, and complete the set specified in the RFC
before the package becomes stable.