Mercurial > cpython-lru_cache-weakref

annotate Tools/unicode/comparecodecs.py @ 58765:2ba7677bfa95 legacy-trunk

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
testCopysign was defined twice in test_math; combine the definitions
author Mark Dickinson <dickinsm@gmail.com>
date Sat, 06 Feb 2010 23:11:25 +0000
parents 7a5ac203154a
children 6b18a095c2e7
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
35761
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
1 #!/usr/bin/env python
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
2
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
3 """ Compare the output of two codecs.
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
4
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
5 (c) Copyright 2005, Marc-Andre Lemburg (mal@lemburg.com).
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
6
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
7 Licensed to PSF under a Contributor Agreement.
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
8
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
9 """
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
10 import sys
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
11
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
12 def compare_codecs(encoding1, encoding2):
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
13
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
14 print 'Comparing encoding/decoding of %r and %r' % (encoding1, encoding2)
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
15 mismatch = 0
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
16 # Check encoding
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
17 for i in range(sys.maxunicode):
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
18 u = unichr(i)
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
19 try:
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
20 c1 = u.encode(encoding1)
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
21 except UnicodeError, reason:
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
22 c1 = '<undefined>'
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
23 try:
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
24 c2 = u.encode(encoding2)
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
25 except UnicodeError, reason:
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
26 c2 = '<undefined>'
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
27 if c1 != c2:
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
28 print ' * encoding mismatch for 0x%04X: %-14r != %r' % \
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
29 (i, c1, c2)
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
30 mismatch += 1
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
31 # Check decoding
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
32 for i in range(256):
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
33 c = chr(i)
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
34 try:
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
35 u1 = c.decode(encoding1)
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
36 except UnicodeError:
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
37 u1 = u'<undefined>'
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
38 try:
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
39 u2 = c.decode(encoding2)
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
40 except UnicodeError:
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
41 u2 = u'<undefined>'
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
42 if u1 != u2:
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
43 print ' * decoding mismatch for 0x%04X: %-14r != %r' % \
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
44 (i, u1, u2)
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
45 mismatch += 1
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
46 if mismatch:
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
47 print
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
48 print 'Found %i mismatches' % mismatch
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
49 else:
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
50 print '-> Codecs are identical.'
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
51
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
52 if __name__ == '__main__':
7a5ac203154a Add two new tools to compare codecs and show differences and to
Marc-André Lemburg <mal@egenix.com>
parents:
diff changeset
53 compare_codecs(sys.argv[1], sys.argv[2])