Mercurial > cpython-lru_cache-weakref

annotate Lib/test/test_csv.py @ 80661:94de77bd0b4b 2.7

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Issue #16194: document imp.load_dynamic problems when read several extension modules from the same binary object file.
author Andrew Svetlov <andrew.svetlov@gmail.com>
date Thu, 29 Nov 2012 19:51:28 +0200
parents 5f0465d0e91e
children 0e1d538d36dc
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
28991
ce6c3cc422ab add not-yet-supported Unicode test just so it doesn't get lost.
Skip Montanaro <skip@pobox.com>
parents: 28917
diff changeset
1 # -*- coding: iso-8859-1 -*-
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
2 # Copyright (C) 2001,2002 Python Software Foundation
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
3 # csv package unit tests
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
4
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
5 import sys
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
6 import os
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
7 import unittest
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
8 from StringIO import StringIO
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
9 import tempfile
28570
bfc7a9fa34d6 hoist contents of csv submodule up to the package level
Skip Montanaro <skip@pobox.com>
parents: 28348
diff changeset
10 import csv
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
11 import gc
59337
02aefc4257de Try to fix buildbot breakage from r78384.
Dirkjan Ochtman <dirkjan@ochtman.nl>
parents: 59078
diff changeset
12 import io
28917
1741af48fd9f Combine the functionality of test_support.run_unittest()
Walter Dörwald <walter@livinglogic.de>
parents: 28827
diff changeset
13 from test import test_support
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
14
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
15 class Test_Csv(unittest.TestCase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
16 """
28774
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
17 Test the underlying C csv parser in ways that are not appropriate
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
18 from the high level interface. Further tests of this nature are done
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
19 in TestDialectRegistry.
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
20 """
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
21 def _test_arg_valid(self, ctor, arg):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
22 self.assertRaises(TypeError, ctor)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
23 self.assertRaises(TypeError, ctor, None)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
24 self.assertRaises(TypeError, ctor, arg, bad_attr = 0)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
25 self.assertRaises(TypeError, ctor, arg, delimiter = 0)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
26 self.assertRaises(TypeError, ctor, arg, delimiter = 'XX')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
27 self.assertRaises(csv.Error, ctor, arg, 'foo')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
28 self.assertRaises(TypeError, ctor, arg, delimiter=None)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
29 self.assertRaises(TypeError, ctor, arg, delimiter=1)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
30 self.assertRaises(TypeError, ctor, arg, quotechar=1)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
31 self.assertRaises(TypeError, ctor, arg, lineterminator=None)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
32 self.assertRaises(TypeError, ctor, arg, lineterminator=1)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
33 self.assertRaises(TypeError, ctor, arg, quoting=None)
34419
652b85d35a75 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 34410
diff changeset
34 self.assertRaises(TypeError, ctor, arg,
34404
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
35 quoting=csv.QUOTE_ALL, quotechar='')
34419
652b85d35a75 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 34410
diff changeset
36 self.assertRaises(TypeError, ctor, arg,
34408
72fd373cd0f9 Fix logic problem in quoting=csv.QUOTE_ALL, quotechar=None check, add test.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34407
diff changeset
37 quoting=csv.QUOTE_ALL, quotechar=None)
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
38
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
39 def test_reader_arg_valid(self):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
40 self._test_arg_valid(csv.reader, [])
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
41
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
42 def test_writer_arg_valid(self):
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
43 self._test_arg_valid(csv.writer, StringIO())
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
44
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
45 def _test_default_attrs(self, ctor, *args):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
46 obj = ctor(*args)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
47 # Check defaults
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
48 self.assertEqual(obj.dialect.delimiter, ',')
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
49 self.assertEqual(obj.dialect.doublequote, True)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
50 self.assertEqual(obj.dialect.escapechar, None)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
51 self.assertEqual(obj.dialect.lineterminator, "\r\n")
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
52 self.assertEqual(obj.dialect.quotechar, '"')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
53 self.assertEqual(obj.dialect.quoting, csv.QUOTE_MINIMAL)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
54 self.assertEqual(obj.dialect.skipinitialspace, False)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
55 self.assertEqual(obj.dialect.strict, False)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
56 # Try deleting or changing attributes (they are read-only)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
57 self.assertRaises(TypeError, delattr, obj.dialect, 'delimiter')
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
58 self.assertRaises(TypeError, setattr, obj.dialect, 'delimiter', ':')
34921
4c8e5243ca42 Fix tests dependent on the exception raised by non-settable descriptors.
Barry Warsaw <barry@python.org>
parents: 34419
diff changeset
59 self.assertRaises(AttributeError, delattr, obj.dialect, 'quoting')
4c8e5243ca42 Fix tests dependent on the exception raised by non-settable descriptors.
Barry Warsaw <barry@python.org>
parents: 34419
diff changeset
60 self.assertRaises(AttributeError, setattr, obj.dialect,
4c8e5243ca42 Fix tests dependent on the exception raised by non-settable descriptors.
Barry Warsaw <barry@python.org>
parents: 34419
diff changeset
61 'quoting', None)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
62
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
63 def test_reader_attrs(self):
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
64 self._test_default_attrs(csv.reader, [])
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
65
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
66 def test_writer_attrs(self):
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
67 self._test_default_attrs(csv.writer, StringIO())
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
68
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
69 def _test_kw_attrs(self, ctor, *args):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
70 # Now try with alternate options
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
71 kwargs = dict(delimiter=':', doublequote=False, escapechar='\\',
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
72 lineterminator='\r', quotechar='*',
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
73 quoting=csv.QUOTE_NONE, skipinitialspace=True,
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
74 strict=True)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
75 obj = ctor(*args, **kwargs)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
76 self.assertEqual(obj.dialect.delimiter, ':')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
77 self.assertEqual(obj.dialect.doublequote, False)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
78 self.assertEqual(obj.dialect.escapechar, '\\')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
79 self.assertEqual(obj.dialect.lineterminator, "\r")
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
80 self.assertEqual(obj.dialect.quotechar, '*')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
81 self.assertEqual(obj.dialect.quoting, csv.QUOTE_NONE)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
82 self.assertEqual(obj.dialect.skipinitialspace, True)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
83 self.assertEqual(obj.dialect.strict, True)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
84
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
85 def test_reader_kw_attrs(self):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
86 self._test_kw_attrs(csv.reader, [])
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
87
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
88 def test_writer_kw_attrs(self):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
89 self._test_kw_attrs(csv.writer, StringIO())
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
90
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
91 def _test_dialect_attrs(self, ctor, *args):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
92 # Now try with dialect-derived options
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
93 class dialect:
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
94 delimiter='-'
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
95 doublequote=False
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
96 escapechar='^'
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
97 lineterminator='$'
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
98 quotechar='#'
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
99 quoting=csv.QUOTE_ALL
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
100 skipinitialspace=True
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
101 strict=False
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
102 args = args + (dialect,)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
103 obj = ctor(*args)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
104 self.assertEqual(obj.dialect.delimiter, '-')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
105 self.assertEqual(obj.dialect.doublequote, False)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
106 self.assertEqual(obj.dialect.escapechar, '^')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
107 self.assertEqual(obj.dialect.lineterminator, "$")
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
108 self.assertEqual(obj.dialect.quotechar, '#')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
109 self.assertEqual(obj.dialect.quoting, csv.QUOTE_ALL)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
110 self.assertEqual(obj.dialect.skipinitialspace, True)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
111 self.assertEqual(obj.dialect.strict, False)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
112
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
113 def test_reader_dialect_attrs(self):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
114 self._test_dialect_attrs(csv.reader, [])
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
115
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
116 def test_writer_dialect_attrs(self):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
117 self._test_dialect_attrs(csv.writer, StringIO())
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
118
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
119
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
120 def _write_test(self, fields, expect, **kwargs):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
121 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
122 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
123 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
124 writer = csv.writer(fileobj, **kwargs)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
125 writer.writerow(fields)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
126 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
127 self.assertEqual(fileobj.read(),
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
128 expect + writer.dialect.lineterminator)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
129 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
130 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
131 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
132
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
133 def test_write_arg_valid(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
134 self.assertRaises(csv.Error, self._write_test, None, '')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
135 self._write_test((), '')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
136 self._write_test([None], '""')
28774
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
137 self.assertRaises(csv.Error, self._write_test,
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
138 [None], None, quoting = csv.QUOTE_NONE)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
139 # Check that exceptions are passed up the chain
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
140 class BadList:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
141 def __len__(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
142 return 10;
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
143 def __getitem__(self, i):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
144 if i > 2:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
145 raise IOError
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
146 self.assertRaises(IOError, self._write_test, BadList(), '')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
147 class BadItem:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
148 def __str__(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
149 raise IOError
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
150 self.assertRaises(IOError, self._write_test, [BadItem()], '')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
151
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
152 def test_write_bigfield(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
153 # This exercises the buffer realloc functionality
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
154 bigstring = 'X' * 50000
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
155 self._write_test([bigstring,bigstring], '%s,%s' % \
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
156 (bigstring, bigstring))
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
157
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
158 def test_write_quoting(self):
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
159 self._write_test(['a',1,'p,q'], 'a,1,"p,q"')
28774
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
160 self.assertRaises(csv.Error,
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
161 self._write_test,
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
162 ['a',1,'p,q'], 'a,1,p,q',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
163 quoting = csv.QUOTE_NONE)
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
164 self._write_test(['a',1,'p,q'], 'a,1,"p,q"',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
165 quoting = csv.QUOTE_MINIMAL)
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
166 self._write_test(['a',1,'p,q'], '"a",1,"p,q"',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
167 quoting = csv.QUOTE_NONNUMERIC)
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
168 self._write_test(['a',1,'p,q'], '"a","1","p,q"',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
169 quoting = csv.QUOTE_ALL)
61775
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
170 self._write_test(['a\nb',1], '"a\nb","1"',
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
171 quoting = csv.QUOTE_ALL)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
172
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
173 def test_write_escape(self):
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
174 self._write_test(['a',1,'p,q'], 'a,1,"p,q"',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
175 escapechar='\\')
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
176 self.assertRaises(csv.Error,
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
177 self._write_test,
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
178 ['a',1,'p,"q"'], 'a,1,"p,\\"q\\""',
34419
652b85d35a75 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 34410
diff changeset
179 escapechar=None, doublequote=False)
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
180 self._write_test(['a',1,'p,"q"'], 'a,1,"p,\\"q\\""',
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
181 escapechar='\\', doublequote = False)
34419
652b85d35a75 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 34410
diff changeset
182 self._write_test(['"'], '""""',
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
183 escapechar='\\', quoting = csv.QUOTE_MINIMAL)
34419
652b85d35a75 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 34410
diff changeset
184 self._write_test(['"'], '\\"',
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
185 escapechar='\\', quoting = csv.QUOTE_MINIMAL,
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
186 doublequote = False)
34419
652b85d35a75 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 34410
diff changeset
187 self._write_test(['"'], '\\"',
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
188 escapechar='\\', quoting = csv.QUOTE_NONE)
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
189 self._write_test(['a',1,'p,q'], 'a,1,p\\,q',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
190 escapechar='\\', quoting = csv.QUOTE_NONE)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
191
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
192 def test_writerows(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
193 class BrokenFile:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
194 def write(self, buf):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
195 raise IOError
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
196 writer = csv.writer(BrokenFile())
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
197 self.assertRaises(IOError, writer.writerows, [['a']])
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
198 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
199 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
200 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
201 writer = csv.writer(fileobj)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
202 self.assertRaises(TypeError, writer.writerows, None)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
203 writer.writerows([['a','b'],['c','d']])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
204 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
205 self.assertEqual(fileobj.read(), "a,b\r\nc,d\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
206 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
207 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
208 os.unlink(name)
32538
4fab4a5cce2f Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 32258
diff changeset
209
73944
bf7329190ca6 Issue #13573: The csv.writer now uses the repr() for floats rather than str().
Raymond Hettinger <python@rcn.com>
parents: 68256
diff changeset
210 def test_write_float(self):
bf7329190ca6 Issue #13573: The csv.writer now uses the repr() for floats rather than str().
Raymond Hettinger <python@rcn.com>
parents: 68256
diff changeset
211 # Issue 13573: loss of precision because csv.writer
bf7329190ca6 Issue #13573: The csv.writer now uses the repr() for floats rather than str().
Raymond Hettinger <python@rcn.com>
parents: 68256
diff changeset
212 # uses str() for floats instead of repr()
bf7329190ca6 Issue #13573: The csv.writer now uses the repr() for floats rather than str().
Raymond Hettinger <python@rcn.com>
parents: 68256
diff changeset
213 orig_row = [1.234567890123, 1.0/7.0, 'abc']
bf7329190ca6 Issue #13573: The csv.writer now uses the repr() for floats rather than str().
Raymond Hettinger <python@rcn.com>
parents: 68256
diff changeset
214 f = StringIO()
bf7329190ca6 Issue #13573: The csv.writer now uses the repr() for floats rather than str().
Raymond Hettinger <python@rcn.com>
parents: 68256
diff changeset
215 c = csv.writer(f, quoting=csv.QUOTE_NONNUMERIC)
bf7329190ca6 Issue #13573: The csv.writer now uses the repr() for floats rather than str().
Raymond Hettinger <python@rcn.com>
parents: 68256
diff changeset
216 c.writerow(orig_row)
bf7329190ca6 Issue #13573: The csv.writer now uses the repr() for floats rather than str().
Raymond Hettinger <python@rcn.com>
parents: 68256
diff changeset
217 f.seek(0)
bf7329190ca6 Issue #13573: The csv.writer now uses the repr() for floats rather than str().
Raymond Hettinger <python@rcn.com>
parents: 68256
diff changeset
218 c = csv.reader(f, quoting=csv.QUOTE_NONNUMERIC)
bf7329190ca6 Issue #13573: The csv.writer now uses the repr() for floats rather than str().
Raymond Hettinger <python@rcn.com>
parents: 68256
diff changeset
219 new_row = next(c)
bf7329190ca6 Issue #13573: The csv.writer now uses the repr() for floats rather than str().
Raymond Hettinger <python@rcn.com>
parents: 68256
diff changeset
220 self.assertEqual(orig_row, new_row)
bf7329190ca6 Issue #13573: The csv.writer now uses the repr() for floats rather than str().
Raymond Hettinger <python@rcn.com>
parents: 68256
diff changeset
221
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
222 def _read_test(self, input, expect, **kwargs):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
223 reader = csv.reader(input, **kwargs)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
224 result = list(reader)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
225 self.assertEqual(result, expect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
226
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
227 def test_read_oddinputs(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
228 self._read_test([], [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
229 self._read_test([''], [[]])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
230 self.assertRaises(csv.Error, self._read_test,
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
231 ['"ab"c'], None, strict = 1)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
232 # cannot handle null bytes for the moment
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
233 self.assertRaises(csv.Error, self._read_test,
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
234 ['ab\0c'], None, strict = 1)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
235 self._read_test(['"ab"c'], [['abc']], doublequote = 0)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
236
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
237 def test_read_eol(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
238 self._read_test(['a,b'], [['a','b']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
239 self._read_test(['a,b\n'], [['a','b']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
240 self._read_test(['a,b\r\n'], [['a','b']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
241 self._read_test(['a,b\r'], [['a','b']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
242 self.assertRaises(csv.Error, self._read_test, ['a,b\rc,d'], [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
243 self.assertRaises(csv.Error, self._read_test, ['a,b\nc,d'], [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
244 self.assertRaises(csv.Error, self._read_test, ['a,b\r\nc,d'], [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
245
79158
5f0465d0e91e 2.7 : Issue #16013: Fix CSV Reader parsing issue with ending quote characters. Patch by Serhiy Storchaka.
Senthil Kumaran <senthil@uthcode.com>
parents: 73944
diff changeset
246 def test_read_eof(self):
5f0465d0e91e 2.7 : Issue #16013: Fix CSV Reader parsing issue with ending quote characters. Patch by Serhiy Storchaka.
Senthil Kumaran <senthil@uthcode.com>
parents: 73944
diff changeset
247 self._read_test(['a,"'], [['a', '']])
5f0465d0e91e 2.7 : Issue #16013: Fix CSV Reader parsing issue with ending quote characters. Patch by Serhiy Storchaka.
Senthil Kumaran <senthil@uthcode.com>
parents: 73944
diff changeset
248 self._read_test(['"a'], [['a']])
5f0465d0e91e 2.7 : Issue #16013: Fix CSV Reader parsing issue with ending quote characters. Patch by Serhiy Storchaka.
Senthil Kumaran <senthil@uthcode.com>
parents: 73944
diff changeset
249 self._read_test(['^'], [['\n']], escapechar='^')
5f0465d0e91e 2.7 : Issue #16013: Fix CSV Reader parsing issue with ending quote characters. Patch by Serhiy Storchaka.
Senthil Kumaran <senthil@uthcode.com>
parents: 73944
diff changeset
250 self.assertRaises(csv.Error, self._read_test, ['a,"'], [], strict=True)
5f0465d0e91e 2.7 : Issue #16013: Fix CSV Reader parsing issue with ending quote characters. Patch by Serhiy Storchaka.
Senthil Kumaran <senthil@uthcode.com>
parents: 73944
diff changeset
251 self.assertRaises(csv.Error, self._read_test, ['"a'], [], strict=True)
5f0465d0e91e 2.7 : Issue #16013: Fix CSV Reader parsing issue with ending quote characters. Patch by Serhiy Storchaka.
Senthil Kumaran <senthil@uthcode.com>
parents: 73944
diff changeset
252 self.assertRaises(csv.Error, self._read_test,
5f0465d0e91e 2.7 : Issue #16013: Fix CSV Reader parsing issue with ending quote characters. Patch by Serhiy Storchaka.
Senthil Kumaran <senthil@uthcode.com>
parents: 73944
diff changeset
253 ['^'], [], escapechar='^', strict=True)
5f0465d0e91e 2.7 : Issue #16013: Fix CSV Reader parsing issue with ending quote characters. Patch by Serhiy Storchaka.
Senthil Kumaran <senthil@uthcode.com>
parents: 73944
diff changeset
254
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
255 def test_read_escape(self):
34380
ba6e17271c62 Fix parsing of csv files with escapes (escape character previously would be
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34358
diff changeset
256 self._read_test(['a,\\b,c'], [['a', 'b', 'c']], escapechar='\\')
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
257 self._read_test(['a,b\\,c'], [['a', 'b,c']], escapechar='\\')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
258 self._read_test(['a,"b\\,c"'], [['a', 'b,c']], escapechar='\\')
34380
ba6e17271c62 Fix parsing of csv files with escapes (escape character previously would be
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34358
diff changeset
259 self._read_test(['a,"b,\\c"'], [['a', 'b,c']], escapechar='\\')
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
260 self._read_test(['a,"b,c\\""'], [['a', 'b,c"']], escapechar='\\')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
261 self._read_test(['a,"b,c"\\'], [['a', 'b,c\\']], escapechar='\\')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
262
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
263 def test_read_quoting(self):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
264 self._read_test(['1,",3,",5'], [['1', ',3,', '5']])
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
265 self._read_test(['1,",3,",5'], [['1', '"', '3', '"', '5']],
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
266 quotechar=None, escapechar='\\')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
267 self._read_test(['1,",3,",5'], [['1', '"', '3', '"', '5']],
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
268 quoting=csv.QUOTE_NONE, escapechar='\\')
34409
1d866c02a8ca When quoting=QUOTE_NONNUMERIC, the reader now casts unquoted fields
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34408
diff changeset
269 # will this fail where locale uses comma for decimals?
34410
a70dd8767b07 Add counting of source iterator lines to the reader object - handy for
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34409
diff changeset
270 self._read_test([',3,"5",7.3, 9'], [['', 3, '5', 7.3, 9]],
34409
1d866c02a8ca When quoting=QUOTE_NONNUMERIC, the reader now casts unquoted fields
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34408
diff changeset
271 quoting=csv.QUOTE_NONNUMERIC)
61775
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
272 self._read_test(['"a\nb", 7'], [['a\nb', ' 7']])
34419
652b85d35a75 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 34410
diff changeset
273 self.assertRaises(ValueError, self._read_test,
34409
1d866c02a8ca When quoting=QUOTE_NONNUMERIC, the reader now casts unquoted fields
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34408
diff changeset
274 ['abc,3'], [[]],
1d866c02a8ca When quoting=QUOTE_NONNUMERIC, the reader now casts unquoted fields
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34408
diff changeset
275 quoting=csv.QUOTE_NONNUMERIC)
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
276
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
277 def test_read_bigfield(self):
34396
7059fb8b9eb3 Set an upper limit on the size of the field buffer, raise an exception
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34393
diff changeset
278 # This exercises the buffer realloc functionality and field size
7059fb8b9eb3 Set an upper limit on the size of the field buffer, raise an exception
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34393
diff changeset
279 # limits.
34406
b93845ce4454 Rename csv.set_field_limit to csv.field_size_limit (since it both sets and
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34404
diff changeset
280 limit = csv.field_size_limit()
34404
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
281 try:
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
282 size = 50000
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
283 bigstring = 'X' * size
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
284 bigline = '%s,%s' % (bigstring, bigstring)
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
285 self._read_test([bigline], [[bigstring, bigstring]])
34406
b93845ce4454 Rename csv.set_field_limit to csv.field_size_limit (since it both sets and
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34404
diff changeset
286 csv.field_size_limit(size)
34404
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
287 self._read_test([bigline], [[bigstring, bigstring]])
34406
b93845ce4454 Rename csv.set_field_limit to csv.field_size_limit (since it both sets and
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34404
diff changeset
288 self.assertEqual(csv.field_size_limit(), size)
b93845ce4454 Rename csv.set_field_limit to csv.field_size_limit (since it both sets and
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34404
diff changeset
289 csv.field_size_limit(size-1)
34404
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
290 self.assertRaises(csv.Error, self._read_test, [bigline], [])
34406
b93845ce4454 Rename csv.set_field_limit to csv.field_size_limit (since it both sets and
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34404
diff changeset
291 self.assertRaises(TypeError, csv.field_size_limit, None)
b93845ce4454 Rename csv.set_field_limit to csv.field_size_limit (since it both sets and
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34404
diff changeset
292 self.assertRaises(TypeError, csv.field_size_limit, 1, None)
34404
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
293 finally:
34406
b93845ce4454 Rename csv.set_field_limit to csv.field_size_limit (since it both sets and
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34404
diff changeset
294 csv.field_size_limit(limit)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
295
34410
a70dd8767b07 Add counting of source iterator lines to the reader object - handy for
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34409
diff changeset
296 def test_read_linenum(self):
45982
441527bfc79c Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 38464
diff changeset
297 for r in (csv.reader(['line,1', 'line,2', 'line,3']),
441527bfc79c Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 38464
diff changeset
298 csv.DictReader(['line,1', 'line,2', 'line,3'],
441527bfc79c Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 38464
diff changeset
299 fieldnames=['a', 'b', 'c'])):
441527bfc79c Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 38464
diff changeset
300 self.assertEqual(r.line_num, 0)
441527bfc79c Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 38464
diff changeset
301 r.next()
441527bfc79c Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 38464
diff changeset
302 self.assertEqual(r.line_num, 1)
441527bfc79c Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 38464
diff changeset
303 r.next()
441527bfc79c Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 38464
diff changeset
304 self.assertEqual(r.line_num, 2)
441527bfc79c Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 38464
diff changeset
305 r.next()
441527bfc79c Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 38464
diff changeset
306 self.assertEqual(r.line_num, 3)
441527bfc79c Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 38464
diff changeset
307 self.assertRaises(StopIteration, r.next)
441527bfc79c Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 38464
diff changeset
308 self.assertEqual(r.line_num, 3)
34410
a70dd8767b07 Add counting of source iterator lines to the reader object - handy for
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34409
diff changeset
309
61775
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
310 def test_roundtrip_quoteed_newlines(self):
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
311 fd, name = tempfile.mkstemp()
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
312 fileobj = os.fdopen(fd, "w+b")
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
313 try:
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
314 writer = csv.writer(fileobj)
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
315 self.assertRaises(TypeError, writer.writerows, None)
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
316 rows = [['a\nb','b'],['c','x\r\nd']]
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
317 writer.writerows(rows)
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
318 fileobj.seek(0)
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
319 for i, row in enumerate(csv.reader(fileobj)):
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
320 self.assertEqual(row, rows[i])
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
321 finally:
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
322 fileobj.close()
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
323 os.unlink(name)
d93bd525473c Unblocked and Merged revisions 70997 via svnmerge from
R. David Murray <rdmurray@bitdance.com>
parents: 58807
diff changeset
324
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
325 class TestDialectRegistry(unittest.TestCase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
326 def test_registry_badargs(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
327 self.assertRaises(TypeError, csv.list_dialects, None)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
328 self.assertRaises(TypeError, csv.get_dialect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
329 self.assertRaises(csv.Error, csv.get_dialect, None)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
330 self.assertRaises(csv.Error, csv.get_dialect, "nonesuch")
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
331 self.assertRaises(TypeError, csv.unregister_dialect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
332 self.assertRaises(csv.Error, csv.unregister_dialect, None)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
333 self.assertRaises(csv.Error, csv.unregister_dialect, "nonesuch")
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
334 self.assertRaises(TypeError, csv.register_dialect, None)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
335 self.assertRaises(TypeError, csv.register_dialect, None, None)
34404
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
336 self.assertRaises(TypeError, csv.register_dialect, "nonesuch", 0, 0)
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
337 self.assertRaises(TypeError, csv.register_dialect, "nonesuch",
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
338 badargument=None)
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
339 self.assertRaises(TypeError, csv.register_dialect, "nonesuch",
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
340 quoting=None)
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
341 self.assertRaises(TypeError, csv.register_dialect, [])
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
342
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
343 def test_registry(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
344 class myexceltsv(csv.excel):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
345 delimiter = "\t"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
346 name = "myexceltsv"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
347 expected_dialects = csv.list_dialects() + [name]
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
348 expected_dialects.sort()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
349 csv.register_dialect(name, myexceltsv)
66613
8629c2a234db Merged revisions 86940 via svnmerge from
Éric Araujo <merwok@netwok.org>
parents: 59337
diff changeset
350 self.addCleanup(csv.unregister_dialect, name)
8629c2a234db Merged revisions 86940 via svnmerge from
Éric Araujo <merwok@netwok.org>
parents: 59337
diff changeset
351 self.assertEqual(csv.get_dialect(name).delimiter, '\t')
8629c2a234db Merged revisions 86940 via svnmerge from
Éric Araujo <merwok@netwok.org>
parents: 59337
diff changeset
352 got_dialects = sorted(csv.list_dialects())
8629c2a234db Merged revisions 86940 via svnmerge from
Éric Araujo <merwok@netwok.org>
parents: 59337
diff changeset
353 self.assertEqual(expected_dialects, got_dialects)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
354
34391
0a1608a5eb05 Allow dialect-describing keywords to be supplied to register_dialect,
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34380
diff changeset
355 def test_register_kwargs(self):
0a1608a5eb05 Allow dialect-describing keywords to be supplied to register_dialect,
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34380
diff changeset
356 name = 'fedcba'
0a1608a5eb05 Allow dialect-describing keywords to be supplied to register_dialect,
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34380
diff changeset
357 csv.register_dialect(name, delimiter=';')
66613
8629c2a234db Merged revisions 86940 via svnmerge from
Éric Araujo <merwok@netwok.org>
parents: 59337
diff changeset
358 self.addCleanup(csv.unregister_dialect, name)
8629c2a234db Merged revisions 86940 via svnmerge from
Éric Araujo <merwok@netwok.org>
parents: 59337
diff changeset
359 self.assertEqual(csv.get_dialect(name).delimiter, ';')
8629c2a234db Merged revisions 86940 via svnmerge from
Éric Araujo <merwok@netwok.org>
parents: 59337
diff changeset
360 self.assertEqual([['X', 'Y', 'Z']], list(csv.reader(['X;Y;Z'], name)))
34391
0a1608a5eb05 Allow dialect-describing keywords to be supplied to register_dialect,
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34380
diff changeset
361
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
362 def test_incomplete_dialect(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
363 class myexceltsv(csv.Dialect):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
364 delimiter = "\t"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
365 self.assertRaises(csv.Error, myexceltsv)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
366
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
367 def test_space_dialect(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
368 class space(csv.excel):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
369 delimiter = " "
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
370 quoting = csv.QUOTE_NONE
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
371 escapechar = "\\"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
372
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
373 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
374 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
375 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
376 fileobj.write("abc def\nc1ccccc1 benzene\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
377 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
378 rdr = csv.reader(fileobj, dialect=space())
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
379 self.assertEqual(rdr.next(), ["abc", "def"])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
380 self.assertEqual(rdr.next(), ["c1ccccc1", "benzene"])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
381 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
382 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
383 os.unlink(name)
32538
4fab4a5cce2f Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 32258
diff changeset
384
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
385 def test_dialect_apply(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
386 class testA(csv.excel):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
387 delimiter = "\t"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
388 class testB(csv.excel):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
389 delimiter = ":"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
390 class testC(csv.excel):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
391 delimiter = "|"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
392
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
393 csv.register_dialect('testC', testC)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
394 try:
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
395 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
396 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
397 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
398 writer = csv.writer(fileobj)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
399 writer.writerow([1,2,3])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
400 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
401 self.assertEqual(fileobj.read(), "1,2,3\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
402 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
403 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
404 os.unlink(name)
32538
4fab4a5cce2f Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 32258
diff changeset
405
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
406 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
407 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
408 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
409 writer = csv.writer(fileobj, testA)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
410 writer.writerow([1,2,3])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
411 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
412 self.assertEqual(fileobj.read(), "1\t2\t3\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
413 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
414 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
415 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
416
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
417 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
418 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
419 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
420 writer = csv.writer(fileobj, dialect=testB())
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
421 writer.writerow([1,2,3])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
422 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
423 self.assertEqual(fileobj.read(), "1:2:3\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
424 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
425 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
426 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
427
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
428 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
429 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
430 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
431 writer = csv.writer(fileobj, dialect='testC')
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
432 writer.writerow([1,2,3])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
433 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
434 self.assertEqual(fileobj.read(), "1|2|3\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
435 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
436 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
437 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
438
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
439 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
440 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
441 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
442 writer = csv.writer(fileobj, dialect=testA, delimiter=';')
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
443 writer.writerow([1,2,3])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
444 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
445 self.assertEqual(fileobj.read(), "1;2;3\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
446 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
447 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
448 os.unlink(name)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
449
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
450 finally:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
451 csv.unregister_dialect('testC')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
452
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
453 def test_bad_dialect(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
454 # Unknown parameter
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
455 self.assertRaises(TypeError, csv.reader, [], bad_attr = 0)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
456 # Bad values
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
457 self.assertRaises(TypeError, csv.reader, [], delimiter = None)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
458 self.assertRaises(TypeError, csv.reader, [], quoting = -1)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
459 self.assertRaises(TypeError, csv.reader, [], quoting = 100)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
460
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
461 class TestCsvBase(unittest.TestCase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
462 def readerAssertEqual(self, input, expected_result):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
463 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
464 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
465 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
466 fileobj.write(input)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
467 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
468 reader = csv.reader(fileobj, dialect = self.dialect)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
469 fields = list(reader)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
470 self.assertEqual(fields, expected_result)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
471 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
472 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
473 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
474
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
475 def writerAssertEqual(self, input, expected_result):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
476 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
477 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
478 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
479 writer = csv.writer(fileobj, dialect = self.dialect)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
480 writer.writerows(input)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
481 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
482 self.assertEqual(fileobj.read(), expected_result)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
483 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
484 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
485 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
486
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
487 class TestDialectExcel(TestCsvBase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
488 dialect = 'excel'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
489
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
490 def test_single(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
491 self.readerAssertEqual('abc', [['abc']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
492
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
493 def test_simple(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
494 self.readerAssertEqual('1,2,3,4,5', [['1','2','3','4','5']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
495
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
496 def test_blankline(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
497 self.readerAssertEqual('', [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
498
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
499 def test_empty_fields(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
500 self.readerAssertEqual(',', [['', '']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
501
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
502 def test_singlequoted(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
503 self.readerAssertEqual('""', [['']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
504
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
505 def test_singlequoted_left_empty(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
506 self.readerAssertEqual('"",', [['','']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
507
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
508 def test_singlequoted_right_empty(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
509 self.readerAssertEqual(',""', [['','']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
510
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
511 def test_single_quoted_quote(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
512 self.readerAssertEqual('""""', [['"']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
513
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
514 def test_quoted_quotes(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
515 self.readerAssertEqual('""""""', [['""']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
516
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
517 def test_inline_quote(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
518 self.readerAssertEqual('a""b', [['a""b']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
519
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
520 def test_inline_quotes(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
521 self.readerAssertEqual('a"b"c', [['a"b"c']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
522
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
523 def test_quotes_and_more(self):
41120
47ede65e2efd Sane humans would call these invalid tests, but Andrew McNamara pointed out
Skip Montanaro <skip@pobox.com>
parents: 38464
diff changeset
524 # Excel would never write a field containing '"a"b', but when
47ede65e2efd Sane humans would call these invalid tests, but Andrew McNamara pointed out
Skip Montanaro <skip@pobox.com>
parents: 38464
diff changeset
525 # reading one, it will return 'ab'.
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
526 self.readerAssertEqual('"a"b', [['ab']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
527
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
528 def test_lone_quote(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
529 self.readerAssertEqual('a"b', [['a"b']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
530
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
531 def test_quote_and_quote(self):
41120
47ede65e2efd Sane humans would call these invalid tests, but Andrew McNamara pointed out
Skip Montanaro <skip@pobox.com>
parents: 38464
diff changeset
532 # Excel would never write a field containing '"a" "b"', but when
47ede65e2efd Sane humans would call these invalid tests, but Andrew McNamara pointed out
Skip Montanaro <skip@pobox.com>
parents: 38464
diff changeset
533 # reading one, it will return 'a "b"'.
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
534 self.readerAssertEqual('"a" "b"', [['a "b"']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
535
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
536 def test_space_and_quote(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
537 self.readerAssertEqual(' "a"', [[' "a"']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
538
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
539 def test_quoted(self):
28774
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
540 self.readerAssertEqual('1,2,3,"I think, therefore I am",5,6',
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
541 [['1', '2', '3',
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
542 'I think, therefore I am',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
543 '5', '6']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
544
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
545 def test_quoted_quote(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
546 self.readerAssertEqual('1,2,3,"""I see,"" said the blind man","as he picked up his hammer and saw"',
28774
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
547 [['1', '2', '3',
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
548 '"I see," said the blind man',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
549 'as he picked up his hammer and saw']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
550
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
551 def test_quoted_nl(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
552 input = '''\
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
553 1,2,3,"""I see,""
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
554 said the blind man","as he picked up his
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
555 hammer and saw"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
556 9,8,7,6'''
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
557 self.readerAssertEqual(input,
28774
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
558 [['1', '2', '3',
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
559 '"I see,"\nsaid the blind man',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
560 'as he picked up his\nhammer and saw'],
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
561 ['9','8','7','6']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
562
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
563 def test_dubious_quote(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
564 self.readerAssertEqual('12,12,1",', [['12', '12', '1"', '']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
565
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
566 def test_null(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
567 self.writerAssertEqual([], '')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
568
58807
dfd46a5db872 Merged revisions 78075-78079 via svnmerge from
Georg Brandl <georg@python.org>
parents: 48198
diff changeset
569 def test_single_writer(self):
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
570 self.writerAssertEqual([['abc']], 'abc\r\n')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
571
58807
dfd46a5db872 Merged revisions 78075-78079 via svnmerge from
Georg Brandl <georg@python.org>
parents: 48198
diff changeset
572 def test_simple_writer(self):
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
573 self.writerAssertEqual([[1, 2, 'abc', 3, 4]], '1,2,abc,3,4\r\n')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
574
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
575 def test_quotes(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
576 self.writerAssertEqual([[1, 2, 'a"bc"', 3, 4]], '1,2,"a""bc""",3,4\r\n')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
577
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
578 def test_quote_fieldsep(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
579 self.writerAssertEqual([['abc,def']], '"abc,def"\r\n')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
580
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
581 def test_newlines(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
582 self.writerAssertEqual([[1, 2, 'a\nbc', 3, 4]], '1,2,"a\nbc",3,4\r\n')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
583
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
584 class EscapedExcel(csv.excel):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
585 quoting = csv.QUOTE_NONE
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
586 escapechar = '\\'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
587
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
588 class TestEscapedExcel(TestCsvBase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
589 dialect = EscapedExcel()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
590
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
591 def test_escape_fieldsep(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
592 self.writerAssertEqual([['abc,def']], 'abc\\,def\r\n')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
593
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
594 def test_read_escape_fieldsep(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
595 self.readerAssertEqual('abc\\,def\r\n', [['abc,def']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
596
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
597 class QuotedEscapedExcel(csv.excel):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
598 quoting = csv.QUOTE_NONNUMERIC
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
599 escapechar = '\\'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
600
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
601 class TestQuotedEscapedExcel(TestCsvBase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
602 dialect = QuotedEscapedExcel()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
603
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
604 def test_write_escape_fieldsep(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
605 self.writerAssertEqual([['abc,def']], '"abc,def"\r\n')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
606
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
607 def test_read_escape_fieldsep(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
608 self.readerAssertEqual('"abc\\,def"\r\n', [['abc,def']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
609
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
610 class TestDictFields(unittest.TestCase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
611 ### "long" means the row is longer than the number of fieldnames
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
612 ### "short" means there are fewer elements in the row than fieldnames
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
613 def test_write_simple_dict(self):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
614 fd, name = tempfile.mkstemp()
59337
02aefc4257de Try to fix buildbot breakage from r78384.
Dirkjan Ochtman <dirkjan@ochtman.nl>
parents: 59078
diff changeset
615 fileobj = io.open(fd, 'w+b')
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
616 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
617 writer = csv.DictWriter(fileobj, fieldnames = ["f1", "f2", "f3"])
59078
dda5165a2374 Fix #1537721: add writeheader() method to csv.DictWriter.
Dirkjan Ochtman <dirkjan@ochtman.nl>
parents: 58801
diff changeset
618 writer.writeheader()
dda5165a2374 Fix #1537721: add writeheader() method to csv.DictWriter.
Dirkjan Ochtman <dirkjan@ochtman.nl>
parents: 58801
diff changeset
619 fileobj.seek(0)
dda5165a2374 Fix #1537721: add writeheader() method to csv.DictWriter.
Dirkjan Ochtman <dirkjan@ochtman.nl>
parents: 58801
diff changeset
620 self.assertEqual(fileobj.readline(), "f1,f2,f3\r\n")
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
621 writer.writerow({"f1": 10, "f3": "abc"})
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
622 fileobj.seek(0)
59078
dda5165a2374 Fix #1537721: add writeheader() method to csv.DictWriter.
Dirkjan Ochtman <dirkjan@ochtman.nl>
parents: 58801
diff changeset
623 fileobj.readline() # header
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
624 self.assertEqual(fileobj.read(), "10,,abc\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
625 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
626 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
627 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
628
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
629 def test_write_no_fields(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
630 fileobj = StringIO()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
631 self.assertRaises(TypeError, csv.DictWriter, fileobj)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
632
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
633 def test_read_dict_fields(self):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
634 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
635 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
636 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
637 fileobj.write("1,2,abc\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
638 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
639 reader = csv.DictReader(fileobj,
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
640 fieldnames=["f1", "f2", "f3"])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
641 self.assertEqual(reader.next(), {"f1": '1', "f2": '2', "f3": 'abc'})
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
642 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
643 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
644 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
645
30632
f9dfdcb897bb Make the fieldnames argument optional in the DictReader. If self.fieldnames
Skip Montanaro <skip@pobox.com>
parents: 30356
diff changeset
646 def test_read_dict_no_fieldnames(self):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
647 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
648 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
649 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
650 fileobj.write("f1,f2,f3\r\n1,2,abc\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
651 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
652 reader = csv.DictReader(fileobj)
48198
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
653 self.assertEqual(reader.fieldnames, ["f1", "f2", "f3"])
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
654 self.assertEqual(reader.next(), {"f1": '1', "f2": '2', "f3": 'abc'})
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
655 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
656 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
657 os.unlink(name)
30632
f9dfdcb897bb Make the fieldnames argument optional in the DictReader. If self.fieldnames
Skip Montanaro <skip@pobox.com>
parents: 30356
diff changeset
658
48198
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
659 # Two test cases to make sure existing ways of implicitly setting
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
660 # fieldnames continue to work. Both arise from discussion in issue3436.
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
661 def test_read_dict_fieldnames_from_file(self):
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
662 fd, name = tempfile.mkstemp()
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
663 f = os.fdopen(fd, "w+b")
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
664 try:
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
665 f.write("f1,f2,f3\r\n1,2,abc\r\n")
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
666 f.seek(0)
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
667 reader = csv.DictReader(f, fieldnames=csv.reader(f).next())
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
668 self.assertEqual(reader.fieldnames, ["f1", "f2", "f3"])
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
669 self.assertEqual(reader.next(), {"f1": '1', "f2": '2', "f3": 'abc'})
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
670 finally:
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
671 f.close()
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
672 os.unlink(name)
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
673
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
674 def test_read_dict_fieldnames_chain(self):
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
675 import itertools
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
676 fd, name = tempfile.mkstemp()
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
677 f = os.fdopen(fd, "w+b")
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
678 try:
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
679 f.write("f1,f2,f3\r\n1,2,abc\r\n")
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
680 f.seek(0)
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
681 reader = csv.DictReader(f)
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
682 first = next(reader)
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
683 for row in itertools.chain([first], reader):
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
684 self.assertEqual(reader.fieldnames, ["f1", "f2", "f3"])
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
685 self.assertEqual(row, {"f1": '1', "f2": '2', "f3": 'abc'})
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
686 finally:
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
687 f.close()
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
688 os.unlink(name)
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
689
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
690 def test_read_long(self):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
691 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
692 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
693 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
694 fileobj.write("1,2,abc,4,5,6\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
695 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
696 reader = csv.DictReader(fileobj,
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
697 fieldnames=["f1", "f2"])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
698 self.assertEqual(reader.next(), {"f1": '1', "f2": '2',
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
699 None: ["abc", "4", "5", "6"]})
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
700 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
701 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
702 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
703
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
704 def test_read_long_with_rest(self):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
705 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
706 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
707 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
708 fileobj.write("1,2,abc,4,5,6\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
709 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
710 reader = csv.DictReader(fileobj,
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
711 fieldnames=["f1", "f2"], restkey="_rest")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
712 self.assertEqual(reader.next(), {"f1": '1', "f2": '2',
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
713 "_rest": ["abc", "4", "5", "6"]})
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
714 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
715 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
716 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
717
30632
f9dfdcb897bb Make the fieldnames argument optional in the DictReader. If self.fieldnames
Skip Montanaro <skip@pobox.com>
parents: 30356
diff changeset
718 def test_read_long_with_rest_no_fieldnames(self):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
719 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
720 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
721 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
722 fileobj.write("f1,f2\r\n1,2,abc,4,5,6\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
723 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
724 reader = csv.DictReader(fileobj, restkey="_rest")
48198
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
725 self.assertEqual(reader.fieldnames, ["f1", "f2"])
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
726 self.assertEqual(reader.next(), {"f1": '1', "f2": '2',
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
727 "_rest": ["abc", "4", "5", "6"]})
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
728 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
729 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
730 os.unlink(name)
30632
f9dfdcb897bb Make the fieldnames argument optional in the DictReader. If self.fieldnames
Skip Montanaro <skip@pobox.com>
parents: 30356
diff changeset
731
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
732 def test_read_short(self):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
733 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
734 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
735 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
736 fileobj.write("1,2,abc,4,5,6\r\n1,2,abc\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
737 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
738 reader = csv.DictReader(fileobj,
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
739 fieldnames="1 2 3 4 5 6".split(),
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
740 restval="DEFAULT")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
741 self.assertEqual(reader.next(), {"1": '1', "2": '2', "3": 'abc',
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
742 "4": '4', "5": '5', "6": '6'})
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
743 self.assertEqual(reader.next(), {"1": '1', "2": '2', "3": 'abc',
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
744 "4": 'DEFAULT', "5": 'DEFAULT',
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
745 "6": 'DEFAULT'})
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
746 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
747 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
748 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
749
29410
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
750 def test_read_multi(self):
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
751 sample = [
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
752 '2147483648,43.0e12,17,abc,def\r\n',
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
753 '147483648,43.0e2,17,abc,def\r\n',
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
754 '47483648,43.0,170,abc,def\r\n'
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
755 ]
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
756
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
757 reader = csv.DictReader(sample,
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
758 fieldnames="i1 float i2 s1 s2".split())
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
759 self.assertEqual(reader.next(), {"i1": '2147483648',
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
760 "float": '43.0e12',
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
761 "i2": '17',
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
762 "s1": 'abc',
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
763 "s2": 'def'})
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
764
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
765 def test_read_with_blanks(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
766 reader = csv.DictReader(["1,2,abc,4,5,6\r\n","\r\n",
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
767 "1,2,abc,4,5,6\r\n"],
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
768 fieldnames="1 2 3 4 5 6".split())
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
769 self.assertEqual(reader.next(), {"1": '1', "2": '2', "3": 'abc',
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
770 "4": '4', "5": '5', "6": '6'})
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
771 self.assertEqual(reader.next(), {"1": '1', "2": '2', "3": 'abc',
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
772 "4": '4', "5": '5', "6": '6'})
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
773
30356
7504812fdb7e **kwds arg was missing from __init__ for Dict{Reader,Writer} classes.
Skip Montanaro <skip@pobox.com>
parents: 29410
diff changeset
774 def test_read_semi_sep(self):
7504812fdb7e **kwds arg was missing from __init__ for Dict{Reader,Writer} classes.
Skip Montanaro <skip@pobox.com>
parents: 29410
diff changeset
775 reader = csv.DictReader(["1;2;abc;4;5;6\r\n"],
7504812fdb7e **kwds arg was missing from __init__ for Dict{Reader,Writer} classes.
Skip Montanaro <skip@pobox.com>
parents: 29410
diff changeset
776 fieldnames="1 2 3 4 5 6".split(),
7504812fdb7e **kwds arg was missing from __init__ for Dict{Reader,Writer} classes.
Skip Montanaro <skip@pobox.com>
parents: 29410
diff changeset
777 delimiter=';')
7504812fdb7e **kwds arg was missing from __init__ for Dict{Reader,Writer} classes.
Skip Montanaro <skip@pobox.com>
parents: 29410
diff changeset
778 self.assertEqual(reader.next(), {"1": '1', "2": '2', "3": 'abc',
7504812fdb7e **kwds arg was missing from __init__ for Dict{Reader,Writer} classes.
Skip Montanaro <skip@pobox.com>
parents: 29410
diff changeset
779 "4": '4', "5": '5', "6": '6'})
7504812fdb7e **kwds arg was missing from __init__ for Dict{Reader,Writer} classes.
Skip Montanaro <skip@pobox.com>
parents: 29410
diff changeset
780
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
781 class TestArrayWrites(unittest.TestCase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
782 def test_int_write(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
783 import array
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
784 contents = [(20-i) for i in range(20)]
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
785 a = array.array('i', contents)
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
786
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
787 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
788 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
789 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
790 writer = csv.writer(fileobj, dialect="excel")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
791 writer.writerow(a)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
792 expected = ",".join([str(i) for i in a])+"\r\n"
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
793 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
794 self.assertEqual(fileobj.read(), expected)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
795 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
796 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
797 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
798
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
799 def test_double_write(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
800 import array
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
801 contents = [(20-i)*0.1 for i in range(20)]
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
802 a = array.array('d', contents)
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
803 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
804 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
805 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
806 writer = csv.writer(fileobj, dialect="excel")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
807 writer.writerow(a)
73944
bf7329190ca6 Issue #13573: The csv.writer now uses the repr() for floats rather than str().
Raymond Hettinger <python@rcn.com>
parents: 68256
diff changeset
808 expected = ",".join([repr(i) for i in a])+"\r\n"
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
809 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
810 self.assertEqual(fileobj.read(), expected)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
811 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
812 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
813 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
814
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
815 def test_float_write(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
816 import array
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
817 contents = [(20-i)*0.1 for i in range(20)]
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
818 a = array.array('f', contents)
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
819 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
820 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
821 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
822 writer = csv.writer(fileobj, dialect="excel")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
823 writer.writerow(a)
73944
bf7329190ca6 Issue #13573: The csv.writer now uses the repr() for floats rather than str().
Raymond Hettinger <python@rcn.com>
parents: 68256
diff changeset
824 expected = ",".join([repr(i) for i in a])+"\r\n"
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
825 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
826 self.assertEqual(fileobj.read(), expected)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
827 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
828 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
829 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
830
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
831 def test_char_write(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
832 import array, string
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
833 a = array.array('c', string.letters)
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
834 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
835 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
836 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
837 writer = csv.writer(fileobj, dialect="excel")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
838 writer.writerow(a)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
839 expected = ",".join(a)+"\r\n"
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
840 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
841 self.assertEqual(fileobj.read(), expected)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
842 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
843 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
844 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
845
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
846 class TestDialectValidity(unittest.TestCase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
847 def test_quoting(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
848 class mydialect(csv.Dialect):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
849 delimiter = ";"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
850 escapechar = '\\'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
851 doublequote = False
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
852 skipinitialspace = True
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
853 lineterminator = '\r\n'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
854 quoting = csv.QUOTE_NONE
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
855 d = mydialect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
856
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
857 mydialect.quoting = None
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
858 self.assertRaises(csv.Error, mydialect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
859
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
860 mydialect.doublequote = True
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
861 mydialect.quoting = csv.QUOTE_ALL
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
862 mydialect.quotechar = '"'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
863 d = mydialect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
864
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
865 mydialect.quotechar = "''"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
866 self.assertRaises(csv.Error, mydialect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
867
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
868 mydialect.quotechar = 4
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
869 self.assertRaises(csv.Error, mydialect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
870
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
871 def test_delimiter(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
872 class mydialect(csv.Dialect):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
873 delimiter = ";"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
874 escapechar = '\\'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
875 doublequote = False
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
876 skipinitialspace = True
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
877 lineterminator = '\r\n'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
878 quoting = csv.QUOTE_NONE
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
879 d = mydialect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
880
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
881 mydialect.delimiter = ":::"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
882 self.assertRaises(csv.Error, mydialect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
883
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
884 mydialect.delimiter = 4
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
885 self.assertRaises(csv.Error, mydialect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
886
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
887 def test_lineterminator(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
888 class mydialect(csv.Dialect):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
889 delimiter = ";"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
890 escapechar = '\\'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
891 doublequote = False
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
892 skipinitialspace = True
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
893 lineterminator = '\r\n'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
894 quoting = csv.QUOTE_NONE
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
895 d = mydialect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
896
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
897 mydialect.lineterminator = ":::"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
898 d = mydialect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
899
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
900 mydialect.lineterminator = 4
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
901 self.assertRaises(csv.Error, mydialect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
902
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
903
28827
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
904 class TestSniffer(unittest.TestCase):
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
905 sample1 = """\
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
906 Harry's, Arlington Heights, IL, 2/1/03, Kimi Hayes
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
907 Shark City, Glendale Heights, IL, 12/28/02, Prezence
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
908 Tommy's Place, Blue Island, IL, 12/28/02, Blue Sunday/White Crow
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
909 Stonecutters Seafood and Chop House, Lemont, IL, 12/19/02, Week Back
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
910 """
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
911 sample2 = """\
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
912 'Harry''s':'Arlington Heights':'IL':'2/1/03':'Kimi Hayes'
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
913 'Shark City':'Glendale Heights':'IL':'12/28/02':'Prezence'
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
914 'Tommy''s Place':'Blue Island':'IL':'12/28/02':'Blue Sunday/White Crow'
56253
c76674c2d74d Patch from Thomas Barr so that csv.Sniffer will set doublequote property.
Skip Montanaro <skip@pobox.com>
parents: 55002
diff changeset
915 'Stonecutters ''Seafood'' and Chop House':'Lemont':'IL':'12/19/02':'Week Back'
28827
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
916 """
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
917 header = '''\
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
918 "venue","city","state","date","performers"
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
919 '''
29169
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
920 sample3 = '''\
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
921 05/05/03?05/05/03?05/05/03?05/05/03?05/05/03?05/05/03
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
922 05/05/03?05/05/03?05/05/03?05/05/03?05/05/03?05/05/03
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
923 05/05/03?05/05/03?05/05/03?05/05/03?05/05/03?05/05/03
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
924 '''
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
925
29410
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
926 sample4 = '''\
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
927 2147483648;43.0e12;17;abc;def
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
928 147483648;43.0e2;17;abc;def
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
929 47483648;43.0;170;abc;def
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
930 '''
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
931
36146
22dbf5818b0b Fix for problem with Sniffer class. If your delimiter is whitespace and the
Skip Montanaro <skip@pobox.com>
parents: 34921
diff changeset
932 sample5 = "aaa\tbbb\r\nAAA\t\r\nBBB\t\r\n"
36157
96eb2a5cfbef Fix a delimiter detection problem in sniffer. Sniffing "a|b|c\r\n" was
Skip Montanaro <skip@pobox.com>
parents: 36146
diff changeset
933 sample6 = "a|b|c\r\nd|e|f\r\n"
96eb2a5cfbef Fix a delimiter detection problem in sniffer. Sniffing "a|b|c\r\n" was
Skip Montanaro <skip@pobox.com>
parents: 36146
diff changeset
934 sample7 = "'a'|'b'|'c'\r\n'd'|e|f\r\n"
36146
22dbf5818b0b Fix for problem with Sniffer class. If your delimiter is whitespace and the
Skip Montanaro <skip@pobox.com>
parents: 34921
diff changeset
935
28827
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
936 def test_has_header(self):
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
937 sniffer = csv.Sniffer()
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
938 self.assertEqual(sniffer.has_header(self.sample1), False)
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
939 self.assertEqual(sniffer.has_header(self.header+self.sample1), True)
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
940
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
941 def test_sniff(self):
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
942 sniffer = csv.Sniffer()
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
943 dialect = sniffer.sniff(self.sample1)
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
944 self.assertEqual(dialect.delimiter, ",")
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
945 self.assertEqual(dialect.quotechar, '"')
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
946 self.assertEqual(dialect.skipinitialspace, True)
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
947
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
948 dialect = sniffer.sniff(self.sample2)
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
949 self.assertEqual(dialect.delimiter, ":")
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
950 self.assertEqual(dialect.quotechar, "'")
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
951 self.assertEqual(dialect.skipinitialspace, False)
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
952
29169
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
953 def test_delimiters(self):
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
954 sniffer = csv.Sniffer()
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
955 dialect = sniffer.sniff(self.sample3)
38464
e989ee5d404a ("Forward-port" of r46506)
Armin Rigo <arigo@tunes.org>
parents: 36157
diff changeset
956 # given that all three lines in sample3 are equal,
e989ee5d404a ("Forward-port" of r46506)
Armin Rigo <arigo@tunes.org>
parents: 36157
diff changeset
957 # I think that any character could have been 'guessed' as the
e989ee5d404a ("Forward-port" of r46506)
Armin Rigo <arigo@tunes.org>
parents: 36157
diff changeset
958 # delimiter, depending on dictionary order
58460
17891566a478 use assert[Not]In where appropriate
Ezio Melotti <ezio.melotti@gmail.com>
parents: 56253
diff changeset
959 self.assertIn(dialect.delimiter, self.sample3)
29169
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
960 dialect = sniffer.sniff(self.sample3, delimiters="?,")
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
961 self.assertEqual(dialect.delimiter, "?")
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
962 dialect = sniffer.sniff(self.sample3, delimiters="/,")
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
963 self.assertEqual(dialect.delimiter, "/")
29410
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
964 dialect = sniffer.sniff(self.sample4)
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
965 self.assertEqual(dialect.delimiter, ";")
36146
22dbf5818b0b Fix for problem with Sniffer class. If your delimiter is whitespace and the
Skip Montanaro <skip@pobox.com>
parents: 34921
diff changeset
966 dialect = sniffer.sniff(self.sample5)
22dbf5818b0b Fix for problem with Sniffer class. If your delimiter is whitespace and the
Skip Montanaro <skip@pobox.com>
parents: 34921
diff changeset
967 self.assertEqual(dialect.delimiter, "\t")
36157
96eb2a5cfbef Fix a delimiter detection problem in sniffer. Sniffing "a|b|c\r\n" was
Skip Montanaro <skip@pobox.com>
parents: 36146
diff changeset
968 dialect = sniffer.sniff(self.sample6)
96eb2a5cfbef Fix a delimiter detection problem in sniffer. Sniffing "a|b|c\r\n" was
Skip Montanaro <skip@pobox.com>
parents: 36146
diff changeset
969 self.assertEqual(dialect.delimiter, "|")
96eb2a5cfbef Fix a delimiter detection problem in sniffer. Sniffing "a|b|c\r\n" was
Skip Montanaro <skip@pobox.com>
parents: 36146
diff changeset
970 dialect = sniffer.sniff(self.sample7)
96eb2a5cfbef Fix a delimiter detection problem in sniffer. Sniffing "a|b|c\r\n" was
Skip Montanaro <skip@pobox.com>
parents: 36146
diff changeset
971 self.assertEqual(dialect.delimiter, "|")
96eb2a5cfbef Fix a delimiter detection problem in sniffer. Sniffing "a|b|c\r\n" was
Skip Montanaro <skip@pobox.com>
parents: 36146
diff changeset
972 self.assertEqual(dialect.quotechar, "'")
29169
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
973
56253
c76674c2d74d Patch from Thomas Barr so that csv.Sniffer will set doublequote property.
Skip Montanaro <skip@pobox.com>
parents: 55002
diff changeset
974 def test_doublequote(self):
c76674c2d74d Patch from Thomas Barr so that csv.Sniffer will set doublequote property.
Skip Montanaro <skip@pobox.com>
parents: 55002
diff changeset
975 sniffer = csv.Sniffer()
c76674c2d74d Patch from Thomas Barr so that csv.Sniffer will set doublequote property.
Skip Montanaro <skip@pobox.com>
parents: 55002
diff changeset
976 dialect = sniffer.sniff(self.header)
c76674c2d74d Patch from Thomas Barr so that csv.Sniffer will set doublequote property.
Skip Montanaro <skip@pobox.com>
parents: 55002
diff changeset
977 self.assertFalse(dialect.doublequote)
c76674c2d74d Patch from Thomas Barr so that csv.Sniffer will set doublequote property.
Skip Montanaro <skip@pobox.com>
parents: 55002
diff changeset
978 dialect = sniffer.sniff(self.sample2)
c76674c2d74d Patch from Thomas Barr so that csv.Sniffer will set doublequote property.
Skip Montanaro <skip@pobox.com>
parents: 55002
diff changeset
979 self.assertTrue(dialect.doublequote)
c76674c2d74d Patch from Thomas Barr so that csv.Sniffer will set doublequote property.
Skip Montanaro <skip@pobox.com>
parents: 55002
diff changeset
980
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
981 if not hasattr(sys, "gettotalrefcount"):
28917
1741af48fd9f Combine the functionality of test_support.run_unittest()
Walter Dörwald <walter@livinglogic.de>
parents: 28827
diff changeset
982 if test_support.verbose: print "*** skipping leakage tests ***"
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
983 else:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
984 class NUL:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
985 def write(s, *args):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
986 pass
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
987 writelines = write
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
988
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
989 class TestLeaks(unittest.TestCase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
990 def test_create_read(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
991 delta = 0
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
992 lastrc = sys.gettotalrefcount()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
993 for i in xrange(20):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
994 gc.collect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
995 self.assertEqual(gc.garbage, [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
996 rc = sys.gettotalrefcount()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
997 csv.reader(["a,b,c\r\n"])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
998 csv.reader(["a,b,c\r\n"])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
999 csv.reader(["a,b,c\r\n"])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1000 delta = rc-lastrc
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1001 lastrc = rc
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1002 # if csv.reader() leaks, last delta should be 3 or more
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1003 self.assertEqual(delta < 3, True)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1004
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1005 def test_create_write(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1006 delta = 0
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1007 lastrc = sys.gettotalrefcount()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1008 s = NUL()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1009 for i in xrange(20):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1010 gc.collect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1011 self.assertEqual(gc.garbage, [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1012 rc = sys.gettotalrefcount()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1013 csv.writer(s)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1014 csv.writer(s)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1015 csv.writer(s)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1016 delta = rc-lastrc
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1017 lastrc = rc
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1018 # if csv.writer() leaks, last delta should be 3 or more
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1019 self.assertEqual(delta < 3, True)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1020
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1021 def test_read(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1022 delta = 0
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1023 rows = ["a,b,c\r\n"]*5
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1024 lastrc = sys.gettotalrefcount()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1025 for i in xrange(20):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1026 gc.collect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1027 self.assertEqual(gc.garbage, [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1028 rc = sys.gettotalrefcount()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1029 rdr = csv.reader(rows)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1030 for row in rdr:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1031 pass
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1032 delta = rc-lastrc
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1033 lastrc = rc
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1034 # if reader leaks during read, delta should be 5 or more
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1035 self.assertEqual(delta < 5, True)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1036
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1037 def test_write(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1038 delta = 0
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1039 rows = [[1,2,3]]*5
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1040 s = NUL()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1041 lastrc = sys.gettotalrefcount()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1042 for i in xrange(20):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1043 gc.collect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1044 self.assertEqual(gc.garbage, [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1045 rc = sys.gettotalrefcount()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1046 writer = csv.writer(s)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1047 for row in rows:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1048 writer.writerow(row)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1049 delta = rc-lastrc
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1050 lastrc = rc
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1051 # if writer leaks during write, last delta should be 5 or more
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1052 self.assertEqual(delta < 5, True)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1053
28991
ce6c3cc422ab add not-yet-supported Unicode test just so it doesn't get lost.
Skip Montanaro <skip@pobox.com>
parents: 28917
diff changeset
1054 # commented out for now - csv module doesn't yet support Unicode
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1055 ## class TestUnicode(unittest.TestCase):
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1056 ## def test_unicode_read(self):
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1057 ## import codecs
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1058 ## f = codecs.EncodedFile(StringIO("Martin von Löwis,"
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1059 ## "Marc André Lemburg,"
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1060 ## "Guido van Rossum,"
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1061 ## "François Pinard\r\n"),
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1062 ## data_encoding='iso-8859-1')
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1063 ## reader = csv.reader(f)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1064 ## self.assertEqual(list(reader), [[u"Martin von Löwis",
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1065 ## u"Marc André Lemburg",
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1066 ## u"Guido van Rossum",
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1067 ## u"François Pinardn"]])
28991
ce6c3cc422ab add not-yet-supported Unicode test just so it doesn't get lost.
Skip Montanaro <skip@pobox.com>
parents: 28917
diff changeset
1068
28917
1741af48fd9f Combine the functionality of test_support.run_unittest()
Walter Dörwald <walter@livinglogic.de>
parents: 28827
diff changeset
1069 def test_main():
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1070 mod = sys.modules[__name__]
28917
1741af48fd9f Combine the functionality of test_support.run_unittest()
Walter Dörwald <walter@livinglogic.de>
parents: 28827
diff changeset
1071 test_support.run_unittest(
1741af48fd9f Combine the functionality of test_support.run_unittest()
Walter Dörwald <walter@livinglogic.de>
parents: 28827
diff changeset
1072 *[getattr(mod, name) for name in dir(mod) if name.startswith('Test')]
1741af48fd9f Combine the functionality of test_support.run_unittest()
Walter Dörwald <walter@livinglogic.de>
parents: 28827
diff changeset
1073 )
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1074
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1075 if __name__ == '__main__':
28917
1741af48fd9f Combine the functionality of test_support.run_unittest()
Walter Dörwald <walter@livinglogic.de>
parents: 28827
diff changeset
1076 test_main()