Mercurial > cpython-lru_cache-weakref

annotate Lib/test/test_csv.py @ 58925:eecf1bef052d 2.6

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Merged revisions 78207 via svnmerge from svn+ssh://pythondev@svn.python.org/python/trunk ........ r78207 | ezio.melotti | 2010-02-17 01:26:09 +0200 (Wed, 17 Feb 2010) | 1 line #7930: fix stripid ........
author Ezio Melotti <ezio.melotti@gmail.com>
date Tue, 16 Feb 2010 23:29:44 +0000
parents dfd46a5db872
children d93bd525473c
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
28991
ce6c3cc422ab add not-yet-supported Unicode test just so it doesn't get lost.
Skip Montanaro <skip@pobox.com>
parents: 28917
diff changeset
1 # -*- coding: iso-8859-1 -*-
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
2 # Copyright (C) 2001,2002 Python Software Foundation
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
3 # csv package unit tests
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
4
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
5 import sys
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
6 import os
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
7 import unittest
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
8 from StringIO import StringIO
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
9 import tempfile
28570
bfc7a9fa34d6 hoist contents of csv submodule up to the package level
Skip Montanaro <skip@pobox.com>
parents: 28348
diff changeset
10 import csv
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
11 import gc
28917
1741af48fd9f Combine the functionality of test_support.run_unittest()
Walter Dörwald <walter@livinglogic.de>
parents: 28827
diff changeset
12 from test import test_support
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
13
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
14 class Test_Csv(unittest.TestCase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
15 """
28774
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
16 Test the underlying C csv parser in ways that are not appropriate
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
17 from the high level interface. Further tests of this nature are done
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
18 in TestDialectRegistry.
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
19 """
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
20 def _test_arg_valid(self, ctor, arg):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
21 self.assertRaises(TypeError, ctor)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
22 self.assertRaises(TypeError, ctor, None)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
23 self.assertRaises(TypeError, ctor, arg, bad_attr = 0)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
24 self.assertRaises(TypeError, ctor, arg, delimiter = 0)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
25 self.assertRaises(TypeError, ctor, arg, delimiter = 'XX')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
26 self.assertRaises(csv.Error, ctor, arg, 'foo')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
27 self.assertRaises(TypeError, ctor, arg, delimiter=None)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
28 self.assertRaises(TypeError, ctor, arg, delimiter=1)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
29 self.assertRaises(TypeError, ctor, arg, quotechar=1)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
30 self.assertRaises(TypeError, ctor, arg, lineterminator=None)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
31 self.assertRaises(TypeError, ctor, arg, lineterminator=1)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
32 self.assertRaises(TypeError, ctor, arg, quoting=None)
34419
652b85d35a75 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 34410
diff changeset
33 self.assertRaises(TypeError, ctor, arg,
34404
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
34 quoting=csv.QUOTE_ALL, quotechar='')
34419
652b85d35a75 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 34410
diff changeset
35 self.assertRaises(TypeError, ctor, arg,
34408
72fd373cd0f9 Fix logic problem in quoting=csv.QUOTE_ALL, quotechar=None check, add test.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34407
diff changeset
36 quoting=csv.QUOTE_ALL, quotechar=None)
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
37
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
38 def test_reader_arg_valid(self):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
39 self._test_arg_valid(csv.reader, [])
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
40
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
41 def test_writer_arg_valid(self):
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
42 self._test_arg_valid(csv.writer, StringIO())
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
43
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
44 def _test_default_attrs(self, ctor, *args):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
45 obj = ctor(*args)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
46 # Check defaults
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
47 self.assertEqual(obj.dialect.delimiter, ',')
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
48 self.assertEqual(obj.dialect.doublequote, True)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
49 self.assertEqual(obj.dialect.escapechar, None)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
50 self.assertEqual(obj.dialect.lineterminator, "\r\n")
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
51 self.assertEqual(obj.dialect.quotechar, '"')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
52 self.assertEqual(obj.dialect.quoting, csv.QUOTE_MINIMAL)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
53 self.assertEqual(obj.dialect.skipinitialspace, False)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
54 self.assertEqual(obj.dialect.strict, False)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
55 # Try deleting or changing attributes (they are read-only)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
56 self.assertRaises(TypeError, delattr, obj.dialect, 'delimiter')
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
57 self.assertRaises(TypeError, setattr, obj.dialect, 'delimiter', ':')
34921
4c8e5243ca42 Fix tests dependent on the exception raised by non-settable descriptors.
Barry Warsaw <barry@python.org>
parents: 34419
diff changeset
58 self.assertRaises(AttributeError, delattr, obj.dialect, 'quoting')
4c8e5243ca42 Fix tests dependent on the exception raised by non-settable descriptors.
Barry Warsaw <barry@python.org>
parents: 34419
diff changeset
59 self.assertRaises(AttributeError, setattr, obj.dialect,
4c8e5243ca42 Fix tests dependent on the exception raised by non-settable descriptors.
Barry Warsaw <barry@python.org>
parents: 34419
diff changeset
60 'quoting', None)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
61
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
62 def test_reader_attrs(self):
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
63 self._test_default_attrs(csv.reader, [])
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
64
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
65 def test_writer_attrs(self):
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
66 self._test_default_attrs(csv.writer, StringIO())
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
67
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
68 def _test_kw_attrs(self, ctor, *args):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
69 # Now try with alternate options
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
70 kwargs = dict(delimiter=':', doublequote=False, escapechar='\\',
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
71 lineterminator='\r', quotechar='*',
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
72 quoting=csv.QUOTE_NONE, skipinitialspace=True,
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
73 strict=True)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
74 obj = ctor(*args, **kwargs)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
75 self.assertEqual(obj.dialect.delimiter, ':')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
76 self.assertEqual(obj.dialect.doublequote, False)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
77 self.assertEqual(obj.dialect.escapechar, '\\')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
78 self.assertEqual(obj.dialect.lineterminator, "\r")
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
79 self.assertEqual(obj.dialect.quotechar, '*')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
80 self.assertEqual(obj.dialect.quoting, csv.QUOTE_NONE)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
81 self.assertEqual(obj.dialect.skipinitialspace, True)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
82 self.assertEqual(obj.dialect.strict, True)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
83
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
84 def test_reader_kw_attrs(self):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
85 self._test_kw_attrs(csv.reader, [])
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
86
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
87 def test_writer_kw_attrs(self):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
88 self._test_kw_attrs(csv.writer, StringIO())
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
89
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
90 def _test_dialect_attrs(self, ctor, *args):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
91 # Now try with dialect-derived options
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
92 class dialect:
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
93 delimiter='-'
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
94 doublequote=False
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
95 escapechar='^'
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
96 lineterminator='$'
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
97 quotechar='#'
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
98 quoting=csv.QUOTE_ALL
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
99 skipinitialspace=True
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
100 strict=False
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
101 args = args + (dialect,)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
102 obj = ctor(*args)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
103 self.assertEqual(obj.dialect.delimiter, '-')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
104 self.assertEqual(obj.dialect.doublequote, False)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
105 self.assertEqual(obj.dialect.escapechar, '^')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
106 self.assertEqual(obj.dialect.lineterminator, "$")
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
107 self.assertEqual(obj.dialect.quotechar, '#')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
108 self.assertEqual(obj.dialect.quoting, csv.QUOTE_ALL)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
109 self.assertEqual(obj.dialect.skipinitialspace, True)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
110 self.assertEqual(obj.dialect.strict, False)
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
111
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
112 def test_reader_dialect_attrs(self):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
113 self._test_dialect_attrs(csv.reader, [])
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
114
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
115 def test_writer_dialect_attrs(self):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
116 self._test_dialect_attrs(csv.writer, StringIO())
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
117
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
118
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
119 def _write_test(self, fields, expect, **kwargs):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
120 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
121 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
122 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
123 writer = csv.writer(fileobj, **kwargs)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
124 writer.writerow(fields)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
125 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
126 self.assertEqual(fileobj.read(),
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
127 expect + writer.dialect.lineterminator)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
128 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
129 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
130 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
131
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
132 def test_write_arg_valid(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
133 self.assertRaises(csv.Error, self._write_test, None, '')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
134 self._write_test((), '')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
135 self._write_test([None], '""')
28774
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
136 self.assertRaises(csv.Error, self._write_test,
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
137 [None], None, quoting = csv.QUOTE_NONE)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
138 # Check that exceptions are passed up the chain
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
139 class BadList:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
140 def __len__(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
141 return 10;
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
142 def __getitem__(self, i):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
143 if i > 2:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
144 raise IOError
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
145 self.assertRaises(IOError, self._write_test, BadList(), '')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
146 class BadItem:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
147 def __str__(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
148 raise IOError
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
149 self.assertRaises(IOError, self._write_test, [BadItem()], '')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
150
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
151 def test_write_bigfield(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
152 # This exercises the buffer realloc functionality
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
153 bigstring = 'X' * 50000
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
154 self._write_test([bigstring,bigstring], '%s,%s' % \
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
155 (bigstring, bigstring))
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
156
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
157 def test_write_quoting(self):
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
158 self._write_test(['a',1,'p,q'], 'a,1,"p,q"')
28774
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
159 self.assertRaises(csv.Error,
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
160 self._write_test,
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
161 ['a',1,'p,q'], 'a,1,p,q',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
162 quoting = csv.QUOTE_NONE)
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
163 self._write_test(['a',1,'p,q'], 'a,1,"p,q"',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
164 quoting = csv.QUOTE_MINIMAL)
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
165 self._write_test(['a',1,'p,q'], '"a",1,"p,q"',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
166 quoting = csv.QUOTE_NONNUMERIC)
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
167 self._write_test(['a',1,'p,q'], '"a","1","p,q"',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
168 quoting = csv.QUOTE_ALL)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
169
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
170 def test_write_escape(self):
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
171 self._write_test(['a',1,'p,q'], 'a,1,"p,q"',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
172 escapechar='\\')
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
173 self.assertRaises(csv.Error,
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
174 self._write_test,
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
175 ['a',1,'p,"q"'], 'a,1,"p,\\"q\\""',
34419
652b85d35a75 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 34410
diff changeset
176 escapechar=None, doublequote=False)
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
177 self._write_test(['a',1,'p,"q"'], 'a,1,"p,\\"q\\""',
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
178 escapechar='\\', doublequote = False)
34419
652b85d35a75 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 34410
diff changeset
179 self._write_test(['"'], '""""',
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
180 escapechar='\\', quoting = csv.QUOTE_MINIMAL)
34419
652b85d35a75 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 34410
diff changeset
181 self._write_test(['"'], '\\"',
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
182 escapechar='\\', quoting = csv.QUOTE_MINIMAL,
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
183 doublequote = False)
34419
652b85d35a75 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 34410
diff changeset
184 self._write_test(['"'], '\\"',
34407
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
185 escapechar='\\', quoting = csv.QUOTE_NONE)
c88ab292bf05 When using QUOTE_NONNUMERIC, we now test for "numericness" with
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34406
diff changeset
186 self._write_test(['a',1,'p,q'], 'a,1,p\\,q',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
187 escapechar='\\', quoting = csv.QUOTE_NONE)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
188
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
189 def test_writerows(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
190 class BrokenFile:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
191 def write(self, buf):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
192 raise IOError
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
193 writer = csv.writer(BrokenFile())
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
194 self.assertRaises(IOError, writer.writerows, [['a']])
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
195 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
196 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
197 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
198 writer = csv.writer(fileobj)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
199 self.assertRaises(TypeError, writer.writerows, None)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
200 writer.writerows([['a','b'],['c','d']])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
201 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
202 self.assertEqual(fileobj.read(), "a,b\r\nc,d\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
203 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
204 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
205 os.unlink(name)
32538
4fab4a5cce2f Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 32258
diff changeset
206
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
207 def _read_test(self, input, expect, **kwargs):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
208 reader = csv.reader(input, **kwargs)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
209 result = list(reader)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
210 self.assertEqual(result, expect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
211
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
212 def test_read_oddinputs(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
213 self._read_test([], [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
214 self._read_test([''], [[]])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
215 self.assertRaises(csv.Error, self._read_test,
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
216 ['"ab"c'], None, strict = 1)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
217 # cannot handle null bytes for the moment
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
218 self.assertRaises(csv.Error, self._read_test,
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
219 ['ab\0c'], None, strict = 1)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
220 self._read_test(['"ab"c'], [['abc']], doublequote = 0)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
221
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
222 def test_read_eol(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
223 self._read_test(['a,b'], [['a','b']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
224 self._read_test(['a,b\n'], [['a','b']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
225 self._read_test(['a,b\r\n'], [['a','b']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
226 self._read_test(['a,b\r'], [['a','b']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
227 self.assertRaises(csv.Error, self._read_test, ['a,b\rc,d'], [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
228 self.assertRaises(csv.Error, self._read_test, ['a,b\nc,d'], [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
229 self.assertRaises(csv.Error, self._read_test, ['a,b\r\nc,d'], [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
230
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
231 def test_read_escape(self):
34380
ba6e17271c62 Fix parsing of csv files with escapes (escape character previously would be
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34358
diff changeset
232 self._read_test(['a,\\b,c'], [['a', 'b', 'c']], escapechar='\\')
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
233 self._read_test(['a,b\\,c'], [['a', 'b,c']], escapechar='\\')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
234 self._read_test(['a,"b\\,c"'], [['a', 'b,c']], escapechar='\\')
34380
ba6e17271c62 Fix parsing of csv files with escapes (escape character previously would be
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34358
diff changeset
235 self._read_test(['a,"b,\\c"'], [['a', 'b,c']], escapechar='\\')
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
236 self._read_test(['a,"b,c\\""'], [['a', 'b,c"']], escapechar='\\')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
237 self._read_test(['a,"b,c"\\'], [['a', 'b,c\\']], escapechar='\\')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
238
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
239 def test_read_quoting(self):
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
240 self._read_test(['1,",3,",5'], [['1', ',3,', '5']])
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
241 self._read_test(['1,",3,",5'], [['1', '"', '3', '"', '5']],
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
242 quotechar=None, escapechar='\\')
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
243 self._read_test(['1,",3,",5'], [['1', '"', '3', '"', '5']],
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
244 quoting=csv.QUOTE_NONE, escapechar='\\')
34409
1d866c02a8ca When quoting=QUOTE_NONNUMERIC, the reader now casts unquoted fields
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34408
diff changeset
245 # will this fail where locale uses comma for decimals?
34410
a70dd8767b07 Add counting of source iterator lines to the reader object - handy for
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34409
diff changeset
246 self._read_test([',3,"5",7.3, 9'], [['', 3, '5', 7.3, 9]],
34409
1d866c02a8ca When quoting=QUOTE_NONNUMERIC, the reader now casts unquoted fields
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34408
diff changeset
247 quoting=csv.QUOTE_NONNUMERIC)
34419
652b85d35a75 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 34410
diff changeset
248 self.assertRaises(ValueError, self._read_test,
34409
1d866c02a8ca When quoting=QUOTE_NONNUMERIC, the reader now casts unquoted fields
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34408
diff changeset
249 ['abc,3'], [[]],
1d866c02a8ca When quoting=QUOTE_NONNUMERIC, the reader now casts unquoted fields
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34408
diff changeset
250 quoting=csv.QUOTE_NONNUMERIC)
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
251
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
252 def test_read_bigfield(self):
34396
7059fb8b9eb3 Set an upper limit on the size of the field buffer, raise an exception
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34393
diff changeset
253 # This exercises the buffer realloc functionality and field size
7059fb8b9eb3 Set an upper limit on the size of the field buffer, raise an exception
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34393
diff changeset
254 # limits.
34406
b93845ce4454 Rename csv.set_field_limit to csv.field_size_limit (since it both sets and
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34404
diff changeset
255 limit = csv.field_size_limit()
34404
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
256 try:
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
257 size = 50000
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
258 bigstring = 'X' * size
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
259 bigline = '%s,%s' % (bigstring, bigstring)
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
260 self._read_test([bigline], [[bigstring, bigstring]])
34406
b93845ce4454 Rename csv.set_field_limit to csv.field_size_limit (since it both sets and
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34404
diff changeset
261 csv.field_size_limit(size)
34404
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
262 self._read_test([bigline], [[bigstring, bigstring]])
34406
b93845ce4454 Rename csv.set_field_limit to csv.field_size_limit (since it both sets and
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34404
diff changeset
263 self.assertEqual(csv.field_size_limit(), size)
b93845ce4454 Rename csv.set_field_limit to csv.field_size_limit (since it both sets and
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34404
diff changeset
264 csv.field_size_limit(size-1)
34404
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
265 self.assertRaises(csv.Error, self._read_test, [bigline], [])
34406
b93845ce4454 Rename csv.set_field_limit to csv.field_size_limit (since it both sets and
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34404
diff changeset
266 self.assertRaises(TypeError, csv.field_size_limit, None)
b93845ce4454 Rename csv.set_field_limit to csv.field_size_limit (since it both sets and
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34404
diff changeset
267 self.assertRaises(TypeError, csv.field_size_limit, 1, None)
34404
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
268 finally:
34406
b93845ce4454 Rename csv.set_field_limit to csv.field_size_limit (since it both sets and
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34404
diff changeset
269 csv.field_size_limit(limit)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
270
34410
a70dd8767b07 Add counting of source iterator lines to the reader object - handy for
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34409
diff changeset
271 def test_read_linenum(self):
45981
85fbd1d265a2 Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 41120
diff changeset
272 for r in (csv.reader(['line,1', 'line,2', 'line,3']),
85fbd1d265a2 Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 41120
diff changeset
273 csv.DictReader(['line,1', 'line,2', 'line,3'],
85fbd1d265a2 Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 41120
diff changeset
274 fieldnames=['a', 'b', 'c'])):
85fbd1d265a2 Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 41120
diff changeset
275 self.assertEqual(r.line_num, 0)
85fbd1d265a2 Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 41120
diff changeset
276 r.next()
85fbd1d265a2 Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 41120
diff changeset
277 self.assertEqual(r.line_num, 1)
85fbd1d265a2 Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 41120
diff changeset
278 r.next()
85fbd1d265a2 Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 41120
diff changeset
279 self.assertEqual(r.line_num, 2)
85fbd1d265a2 Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 41120
diff changeset
280 r.next()
85fbd1d265a2 Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 41120
diff changeset
281 self.assertEqual(r.line_num, 3)
85fbd1d265a2 Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 41120
diff changeset
282 self.assertRaises(StopIteration, r.next)
85fbd1d265a2 Issue #2432: give DictReader the dialect and line_num attributes
Georg Brandl <georg@python.org>
parents: 41120
diff changeset
283 self.assertEqual(r.line_num, 3)
34410
a70dd8767b07 Add counting of source iterator lines to the reader object - handy for
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34409
diff changeset
284
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
285 class TestDialectRegistry(unittest.TestCase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
286 def test_registry_badargs(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
287 self.assertRaises(TypeError, csv.list_dialects, None)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
288 self.assertRaises(TypeError, csv.get_dialect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
289 self.assertRaises(csv.Error, csv.get_dialect, None)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
290 self.assertRaises(csv.Error, csv.get_dialect, "nonesuch")
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
291 self.assertRaises(TypeError, csv.unregister_dialect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
292 self.assertRaises(csv.Error, csv.unregister_dialect, None)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
293 self.assertRaises(csv.Error, csv.unregister_dialect, "nonesuch")
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
294 self.assertRaises(TypeError, csv.register_dialect, None)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
295 self.assertRaises(TypeError, csv.register_dialect, None, None)
34404
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
296 self.assertRaises(TypeError, csv.register_dialect, "nonesuch", 0, 0)
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
297 self.assertRaises(TypeError, csv.register_dialect, "nonesuch",
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
298 badargument=None)
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
299 self.assertRaises(TypeError, csv.register_dialect, "nonesuch",
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
300 quoting=None)
a8599c788218 Improve test coverage fractionally.
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34396
diff changeset
301 self.assertRaises(TypeError, csv.register_dialect, [])
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
302
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
303 def test_registry(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
304 class myexceltsv(csv.excel):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
305 delimiter = "\t"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
306 name = "myexceltsv"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
307 expected_dialects = csv.list_dialects() + [name]
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
308 expected_dialects.sort()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
309 csv.register_dialect(name, myexceltsv)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
310 try:
34391
0a1608a5eb05 Allow dialect-describing keywords to be supplied to register_dialect,
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34380
diff changeset
311 self.failUnless(csv.get_dialect(name).delimiter, '\t')
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
312 got_dialects = csv.list_dialects()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
313 got_dialects.sort()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
314 self.assertEqual(expected_dialects, got_dialects)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
315 finally:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
316 csv.unregister_dialect(name)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
317
34391
0a1608a5eb05 Allow dialect-describing keywords to be supplied to register_dialect,
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34380
diff changeset
318 def test_register_kwargs(self):
0a1608a5eb05 Allow dialect-describing keywords to be supplied to register_dialect,
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34380
diff changeset
319 name = 'fedcba'
0a1608a5eb05 Allow dialect-describing keywords to be supplied to register_dialect,
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34380
diff changeset
320 csv.register_dialect(name, delimiter=';')
0a1608a5eb05 Allow dialect-describing keywords to be supplied to register_dialect,
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34380
diff changeset
321 try:
0a1608a5eb05 Allow dialect-describing keywords to be supplied to register_dialect,
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34380
diff changeset
322 self.failUnless(csv.get_dialect(name).delimiter, '\t')
0a1608a5eb05 Allow dialect-describing keywords to be supplied to register_dialect,
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34380
diff changeset
323 self.failUnless(list(csv.reader('X;Y;Z', name)), ['X', 'Y', 'Z'])
0a1608a5eb05 Allow dialect-describing keywords to be supplied to register_dialect,
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34380
diff changeset
324 finally:
0a1608a5eb05 Allow dialect-describing keywords to be supplied to register_dialect,
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34380
diff changeset
325 csv.unregister_dialect(name)
0a1608a5eb05 Allow dialect-describing keywords to be supplied to register_dialect,
Andrew McNamara <andrewm@object-craft.com.au>
parents: 34380
diff changeset
326
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
327 def test_incomplete_dialect(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
328 class myexceltsv(csv.Dialect):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
329 delimiter = "\t"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
330 self.assertRaises(csv.Error, myexceltsv)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
331
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
332 def test_space_dialect(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
333 class space(csv.excel):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
334 delimiter = " "
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
335 quoting = csv.QUOTE_NONE
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
336 escapechar = "\\"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
337
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
338 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
339 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
340 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
341 fileobj.write("abc def\nc1ccccc1 benzene\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
342 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
343 rdr = csv.reader(fileobj, dialect=space())
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
344 self.assertEqual(rdr.next(), ["abc", "def"])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
345 self.assertEqual(rdr.next(), ["c1ccccc1", "benzene"])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
346 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
347 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
348 os.unlink(name)
32538
4fab4a5cce2f Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 32258
diff changeset
349
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
350 def test_dialect_apply(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
351 class testA(csv.excel):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
352 delimiter = "\t"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
353 class testB(csv.excel):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
354 delimiter = ":"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
355 class testC(csv.excel):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
356 delimiter = "|"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
357
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
358 csv.register_dialect('testC', testC)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
359 try:
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
360 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
361 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
362 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
363 writer = csv.writer(fileobj)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
364 writer.writerow([1,2,3])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
365 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
366 self.assertEqual(fileobj.read(), "1,2,3\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
367 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
368 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
369 os.unlink(name)
32538
4fab4a5cce2f Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 32258
diff changeset
370
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
371 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
372 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
373 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
374 writer = csv.writer(fileobj, testA)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
375 writer.writerow([1,2,3])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
376 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
377 self.assertEqual(fileobj.read(), "1\t2\t3\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
378 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
379 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
380 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
381
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
382 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
383 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
384 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
385 writer = csv.writer(fileobj, dialect=testB())
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
386 writer.writerow([1,2,3])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
387 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
388 self.assertEqual(fileobj.read(), "1:2:3\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
389 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
390 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
391 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
392
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
393 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
394 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
395 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
396 writer = csv.writer(fileobj, dialect='testC')
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
397 writer.writerow([1,2,3])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
398 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
399 self.assertEqual(fileobj.read(), "1|2|3\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
400 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
401 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
402 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
403
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
404 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
405 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
406 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
407 writer = csv.writer(fileobj, dialect=testA, delimiter=';')
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
408 writer.writerow([1,2,3])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
409 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
410 self.assertEqual(fileobj.read(), "1;2;3\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
411 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
412 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
413 os.unlink(name)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
414
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
415 finally:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
416 csv.unregister_dialect('testC')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
417
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
418 def test_bad_dialect(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
419 # Unknown parameter
34340
be4929e5179b Improved the implementation of the internal "dialect" type. The new
Andrew McNamara <andrewm@object-craft.com.au>
parents: 32538
diff changeset
420 self.assertRaises(TypeError, csv.reader, [], bad_attr = 0)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
421 # Bad values
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
422 self.assertRaises(TypeError, csv.reader, [], delimiter = None)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
423 self.assertRaises(TypeError, csv.reader, [], quoting = -1)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
424 self.assertRaises(TypeError, csv.reader, [], quoting = 100)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
425
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
426 class TestCsvBase(unittest.TestCase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
427 def readerAssertEqual(self, input, expected_result):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
428 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
429 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
430 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
431 fileobj.write(input)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
432 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
433 reader = csv.reader(fileobj, dialect = self.dialect)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
434 fields = list(reader)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
435 self.assertEqual(fields, expected_result)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
436 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
437 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
438 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
439
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
440 def writerAssertEqual(self, input, expected_result):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
441 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
442 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
443 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
444 writer = csv.writer(fileobj, dialect = self.dialect)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
445 writer.writerows(input)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
446 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
447 self.assertEqual(fileobj.read(), expected_result)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
448 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
449 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
450 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
451
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
452 class TestDialectExcel(TestCsvBase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
453 dialect = 'excel'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
454
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
455 def test_single(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
456 self.readerAssertEqual('abc', [['abc']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
457
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
458 def test_simple(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
459 self.readerAssertEqual('1,2,3,4,5', [['1','2','3','4','5']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
460
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
461 def test_blankline(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
462 self.readerAssertEqual('', [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
463
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
464 def test_empty_fields(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
465 self.readerAssertEqual(',', [['', '']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
466
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
467 def test_singlequoted(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
468 self.readerAssertEqual('""', [['']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
469
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
470 def test_singlequoted_left_empty(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
471 self.readerAssertEqual('"",', [['','']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
472
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
473 def test_singlequoted_right_empty(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
474 self.readerAssertEqual(',""', [['','']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
475
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
476 def test_single_quoted_quote(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
477 self.readerAssertEqual('""""', [['"']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
478
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
479 def test_quoted_quotes(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
480 self.readerAssertEqual('""""""', [['""']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
481
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
482 def test_inline_quote(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
483 self.readerAssertEqual('a""b', [['a""b']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
484
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
485 def test_inline_quotes(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
486 self.readerAssertEqual('a"b"c', [['a"b"c']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
487
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
488 def test_quotes_and_more(self):
41120
47ede65e2efd Sane humans would call these invalid tests, but Andrew McNamara pointed out
Skip Montanaro <skip@pobox.com>
parents: 38464
diff changeset
489 # Excel would never write a field containing '"a"b', but when
47ede65e2efd Sane humans would call these invalid tests, but Andrew McNamara pointed out
Skip Montanaro <skip@pobox.com>
parents: 38464
diff changeset
490 # reading one, it will return 'ab'.
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
491 self.readerAssertEqual('"a"b', [['ab']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
492
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
493 def test_lone_quote(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
494 self.readerAssertEqual('a"b', [['a"b']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
495
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
496 def test_quote_and_quote(self):
41120
47ede65e2efd Sane humans would call these invalid tests, but Andrew McNamara pointed out
Skip Montanaro <skip@pobox.com>
parents: 38464
diff changeset
497 # Excel would never write a field containing '"a" "b"', but when
47ede65e2efd Sane humans would call these invalid tests, but Andrew McNamara pointed out
Skip Montanaro <skip@pobox.com>
parents: 38464
diff changeset
498 # reading one, it will return 'a "b"'.
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
499 self.readerAssertEqual('"a" "b"', [['a "b"']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
500
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
501 def test_space_and_quote(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
502 self.readerAssertEqual(' "a"', [[' "a"']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
503
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
504 def test_quoted(self):
28774
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
505 self.readerAssertEqual('1,2,3,"I think, therefore I am",5,6',
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
506 [['1', '2', '3',
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
507 'I think, therefore I am',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
508 '5', '6']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
509
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
510 def test_quoted_quote(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
511 self.readerAssertEqual('1,2,3,"""I see,"" said the blind man","as he picked up his hammer and saw"',
28774
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
512 [['1', '2', '3',
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
513 '"I see," said the blind man',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
514 'as he picked up his hammer and saw']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
515
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
516 def test_quoted_nl(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
517 input = '''\
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
518 1,2,3,"""I see,""
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
519 said the blind man","as he picked up his
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
520 hammer and saw"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
521 9,8,7,6'''
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
522 self.readerAssertEqual(input,
28774
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
523 [['1', '2', '3',
c9bee11eaa8b Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 28570
diff changeset
524 '"I see,"\nsaid the blind man',
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
525 'as he picked up his\nhammer and saw'],
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
526 ['9','8','7','6']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
527
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
528 def test_dubious_quote(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
529 self.readerAssertEqual('12,12,1",', [['12', '12', '1"', '']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
530
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
531 def test_null(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
532 self.writerAssertEqual([], '')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
533
58807
dfd46a5db872 Merged revisions 78075-78079 via svnmerge from
Georg Brandl <georg@python.org>
parents: 48198
diff changeset
534 def test_single_writer(self):
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
535 self.writerAssertEqual([['abc']], 'abc\r\n')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
536
58807
dfd46a5db872 Merged revisions 78075-78079 via svnmerge from
Georg Brandl <georg@python.org>
parents: 48198
diff changeset
537 def test_simple_writer(self):
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
538 self.writerAssertEqual([[1, 2, 'abc', 3, 4]], '1,2,abc,3,4\r\n')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
539
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
540 def test_quotes(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
541 self.writerAssertEqual([[1, 2, 'a"bc"', 3, 4]], '1,2,"a""bc""",3,4\r\n')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
542
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
543 def test_quote_fieldsep(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
544 self.writerAssertEqual([['abc,def']], '"abc,def"\r\n')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
545
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
546 def test_newlines(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
547 self.writerAssertEqual([[1, 2, 'a\nbc', 3, 4]], '1,2,"a\nbc",3,4\r\n')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
548
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
549 class EscapedExcel(csv.excel):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
550 quoting = csv.QUOTE_NONE
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
551 escapechar = '\\'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
552
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
553 class TestEscapedExcel(TestCsvBase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
554 dialect = EscapedExcel()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
555
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
556 def test_escape_fieldsep(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
557 self.writerAssertEqual([['abc,def']], 'abc\\,def\r\n')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
558
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
559 def test_read_escape_fieldsep(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
560 self.readerAssertEqual('abc\\,def\r\n', [['abc,def']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
561
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
562 class QuotedEscapedExcel(csv.excel):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
563 quoting = csv.QUOTE_NONNUMERIC
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
564 escapechar = '\\'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
565
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
566 class TestQuotedEscapedExcel(TestCsvBase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
567 dialect = QuotedEscapedExcel()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
568
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
569 def test_write_escape_fieldsep(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
570 self.writerAssertEqual([['abc,def']], '"abc,def"\r\n')
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
571
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
572 def test_read_escape_fieldsep(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
573 self.readerAssertEqual('"abc\\,def"\r\n', [['abc,def']])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
574
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
575 class TestDictFields(unittest.TestCase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
576 ### "long" means the row is longer than the number of fieldnames
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
577 ### "short" means there are fewer elements in the row than fieldnames
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
578 def test_write_simple_dict(self):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
579 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
580 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
581 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
582 writer = csv.DictWriter(fileobj, fieldnames = ["f1", "f2", "f3"])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
583 writer.writerow({"f1": 10, "f3": "abc"})
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
584 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
585 self.assertEqual(fileobj.read(), "10,,abc\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
586 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
587 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
588 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
589
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
590 def test_write_no_fields(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
591 fileobj = StringIO()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
592 self.assertRaises(TypeError, csv.DictWriter, fileobj)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
593
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
594 def test_read_dict_fields(self):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
595 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
596 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
597 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
598 fileobj.write("1,2,abc\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
599 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
600 reader = csv.DictReader(fileobj,
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
601 fieldnames=["f1", "f2", "f3"])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
602 self.assertEqual(reader.next(), {"f1": '1', "f2": '2', "f3": 'abc'})
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
603 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
604 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
605 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
606
30632
f9dfdcb897bb Make the fieldnames argument optional in the DictReader. If self.fieldnames
Skip Montanaro <skip@pobox.com>
parents: 30356
diff changeset
607 def test_read_dict_no_fieldnames(self):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
608 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
609 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
610 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
611 fileobj.write("f1,f2,f3\r\n1,2,abc\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
612 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
613 reader = csv.DictReader(fileobj)
48198
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
614 self.assertEqual(reader.fieldnames, ["f1", "f2", "f3"])
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
615 self.assertEqual(reader.next(), {"f1": '1', "f2": '2', "f3": 'abc'})
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
616 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
617 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
618 os.unlink(name)
30632
f9dfdcb897bb Make the fieldnames argument optional in the DictReader. If self.fieldnames
Skip Montanaro <skip@pobox.com>
parents: 30356
diff changeset
619
48198
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
620 # Two test cases to make sure existing ways of implicitly setting
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
621 # fieldnames continue to work. Both arise from discussion in issue3436.
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
622 def test_read_dict_fieldnames_from_file(self):
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
623 fd, name = tempfile.mkstemp()
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
624 f = os.fdopen(fd, "w+b")
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
625 try:
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
626 f.write("f1,f2,f3\r\n1,2,abc\r\n")
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
627 f.seek(0)
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
628 reader = csv.DictReader(f, fieldnames=csv.reader(f).next())
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
629 self.assertEqual(reader.fieldnames, ["f1", "f2", "f3"])
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
630 self.assertEqual(reader.next(), {"f1": '1', "f2": '2', "f3": 'abc'})
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
631 finally:
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
632 f.close()
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
633 os.unlink(name)
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
634
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
635 def test_read_dict_fieldnames_chain(self):
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
636 import itertools
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
637 fd, name = tempfile.mkstemp()
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
638 f = os.fdopen(fd, "w+b")
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
639 try:
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
640 f.write("f1,f2,f3\r\n1,2,abc\r\n")
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
641 f.seek(0)
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
642 reader = csv.DictReader(f)
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
643 first = next(reader)
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
644 for row in itertools.chain([first], reader):
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
645 self.assertEqual(reader.fieldnames, ["f1", "f2", "f3"])
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
646 self.assertEqual(row, {"f1": '1', "f2": '2', "f3": 'abc'})
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
647 finally:
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
648 f.close()
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
649 os.unlink(name)
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
650
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
651 def test_read_long(self):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
652 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
653 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
654 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
655 fileobj.write("1,2,abc,4,5,6\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
656 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
657 reader = csv.DictReader(fileobj,
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
658 fieldnames=["f1", "f2"])
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
659 self.assertEqual(reader.next(), {"f1": '1', "f2": '2',
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
660 None: ["abc", "4", "5", "6"]})
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
661 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
662 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
663 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
664
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
665 def test_read_long_with_rest(self):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
666 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
667 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
668 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
669 fileobj.write("1,2,abc,4,5,6\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
670 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
671 reader = csv.DictReader(fileobj,
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
672 fieldnames=["f1", "f2"], restkey="_rest")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
673 self.assertEqual(reader.next(), {"f1": '1', "f2": '2',
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
674 "_rest": ["abc", "4", "5", "6"]})
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
675 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
676 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
677 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
678
30632
f9dfdcb897bb Make the fieldnames argument optional in the DictReader. If self.fieldnames
Skip Montanaro <skip@pobox.com>
parents: 30356
diff changeset
679 def test_read_long_with_rest_no_fieldnames(self):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
680 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
681 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
682 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
683 fileobj.write("f1,f2\r\n1,2,abc,4,5,6\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
684 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
685 reader = csv.DictReader(fileobj, restkey="_rest")
48198
47967690b585 accept issue 3436
Skip Montanaro <skip@pobox.com>
parents: 45981
diff changeset
686 self.assertEqual(reader.fieldnames, ["f1", "f2"])
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
687 self.assertEqual(reader.next(), {"f1": '1', "f2": '2',
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
688 "_rest": ["abc", "4", "5", "6"]})
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
689 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
690 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
691 os.unlink(name)
30632
f9dfdcb897bb Make the fieldnames argument optional in the DictReader. If self.fieldnames
Skip Montanaro <skip@pobox.com>
parents: 30356
diff changeset
692
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
693 def test_read_short(self):
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
694 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
695 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
696 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
697 fileobj.write("1,2,abc,4,5,6\r\n1,2,abc\r\n")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
698 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
699 reader = csv.DictReader(fileobj,
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
700 fieldnames="1 2 3 4 5 6".split(),
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
701 restval="DEFAULT")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
702 self.assertEqual(reader.next(), {"1": '1', "2": '2', "3": 'abc',
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
703 "4": '4', "5": '5', "6": '6'})
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
704 self.assertEqual(reader.next(), {"1": '1', "2": '2', "3": 'abc',
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
705 "4": 'DEFAULT', "5": 'DEFAULT',
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
706 "6": 'DEFAULT'})
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
707 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
708 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
709 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
710
29410
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
711 def test_read_multi(self):
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
712 sample = [
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
713 '2147483648,43.0e12,17,abc,def\r\n',
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
714 '147483648,43.0e2,17,abc,def\r\n',
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
715 '47483648,43.0,170,abc,def\r\n'
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
716 ]
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
717
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
718 reader = csv.DictReader(sample,
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
719 fieldnames="i1 float i2 s1 s2".split())
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
720 self.assertEqual(reader.next(), {"i1": '2147483648',
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
721 "float": '43.0e12',
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
722 "i2": '17',
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
723 "s1": 'abc',
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
724 "s2": 'def'})
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
725
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
726 def test_read_with_blanks(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
727 reader = csv.DictReader(["1,2,abc,4,5,6\r\n","\r\n",
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
728 "1,2,abc,4,5,6\r\n"],
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
729 fieldnames="1 2 3 4 5 6".split())
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
730 self.assertEqual(reader.next(), {"1": '1', "2": '2', "3": 'abc',
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
731 "4": '4', "5": '5', "6": '6'})
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
732 self.assertEqual(reader.next(), {"1": '1', "2": '2', "3": 'abc',
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
733 "4": '4', "5": '5', "6": '6'})
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
734
30356
7504812fdb7e **kwds arg was missing from __init__ for Dict{Reader,Writer} classes.
Skip Montanaro <skip@pobox.com>
parents: 29410
diff changeset
735 def test_read_semi_sep(self):
7504812fdb7e **kwds arg was missing from __init__ for Dict{Reader,Writer} classes.
Skip Montanaro <skip@pobox.com>
parents: 29410
diff changeset
736 reader = csv.DictReader(["1;2;abc;4;5;6\r\n"],
7504812fdb7e **kwds arg was missing from __init__ for Dict{Reader,Writer} classes.
Skip Montanaro <skip@pobox.com>
parents: 29410
diff changeset
737 fieldnames="1 2 3 4 5 6".split(),
7504812fdb7e **kwds arg was missing from __init__ for Dict{Reader,Writer} classes.
Skip Montanaro <skip@pobox.com>
parents: 29410
diff changeset
738 delimiter=';')
7504812fdb7e **kwds arg was missing from __init__ for Dict{Reader,Writer} classes.
Skip Montanaro <skip@pobox.com>
parents: 29410
diff changeset
739 self.assertEqual(reader.next(), {"1": '1', "2": '2', "3": 'abc',
7504812fdb7e **kwds arg was missing from __init__ for Dict{Reader,Writer} classes.
Skip Montanaro <skip@pobox.com>
parents: 29410
diff changeset
740 "4": '4', "5": '5', "6": '6'})
7504812fdb7e **kwds arg was missing from __init__ for Dict{Reader,Writer} classes.
Skip Montanaro <skip@pobox.com>
parents: 29410
diff changeset
741
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
742 class TestArrayWrites(unittest.TestCase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
743 def test_int_write(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
744 import array
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
745 contents = [(20-i) for i in range(20)]
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
746 a = array.array('i', contents)
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
747
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
748 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
749 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
750 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
751 writer = csv.writer(fileobj, dialect="excel")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
752 writer.writerow(a)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
753 expected = ",".join([str(i) for i in a])+"\r\n"
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
754 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
755 self.assertEqual(fileobj.read(), expected)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
756 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
757 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
758 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
759
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
760 def test_double_write(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
761 import array
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
762 contents = [(20-i)*0.1 for i in range(20)]
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
763 a = array.array('d', contents)
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
764 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
765 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
766 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
767 writer = csv.writer(fileobj, dialect="excel")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
768 writer.writerow(a)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
769 expected = ",".join([str(i) for i in a])+"\r\n"
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
770 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
771 self.assertEqual(fileobj.read(), expected)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
772 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
773 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
774 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
775
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
776 def test_float_write(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
777 import array
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
778 contents = [(20-i)*0.1 for i in range(20)]
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
779 a = array.array('f', contents)
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
780 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
781 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
782 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
783 writer = csv.writer(fileobj, dialect="excel")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
784 writer.writerow(a)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
785 expected = ",".join([str(i) for i in a])+"\r\n"
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
786 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
787 self.assertEqual(fileobj.read(), expected)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
788 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
789 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
790 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
791
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
792 def test_char_write(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
793 import array, string
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
794 a = array.array('c', string.letters)
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
795 fd, name = tempfile.mkstemp()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
796 fileobj = os.fdopen(fd, "w+b")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
797 try:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
798 writer = csv.writer(fileobj, dialect="excel")
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
799 writer.writerow(a)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
800 expected = ",".join(a)+"\r\n"
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
801 fileobj.seek(0)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
802 self.assertEqual(fileobj.read(), expected)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
803 finally:
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
804 fileobj.close()
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
805 os.unlink(name)
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
806
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
807 class TestDialectValidity(unittest.TestCase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
808 def test_quoting(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
809 class mydialect(csv.Dialect):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
810 delimiter = ";"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
811 escapechar = '\\'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
812 doublequote = False
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
813 skipinitialspace = True
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
814 lineterminator = '\r\n'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
815 quoting = csv.QUOTE_NONE
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
816 d = mydialect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
817
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
818 mydialect.quoting = None
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
819 self.assertRaises(csv.Error, mydialect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
820
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
821 mydialect.doublequote = True
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
822 mydialect.quoting = csv.QUOTE_ALL
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
823 mydialect.quotechar = '"'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
824 d = mydialect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
825
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
826 mydialect.quotechar = "''"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
827 self.assertRaises(csv.Error, mydialect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
828
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
829 mydialect.quotechar = 4
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
830 self.assertRaises(csv.Error, mydialect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
831
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
832 def test_delimiter(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
833 class mydialect(csv.Dialect):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
834 delimiter = ";"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
835 escapechar = '\\'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
836 doublequote = False
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
837 skipinitialspace = True
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
838 lineterminator = '\r\n'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
839 quoting = csv.QUOTE_NONE
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
840 d = mydialect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
841
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
842 mydialect.delimiter = ":::"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
843 self.assertRaises(csv.Error, mydialect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
844
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
845 mydialect.delimiter = 4
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
846 self.assertRaises(csv.Error, mydialect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
847
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
848 def test_lineterminator(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
849 class mydialect(csv.Dialect):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
850 delimiter = ";"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
851 escapechar = '\\'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
852 doublequote = False
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
853 skipinitialspace = True
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
854 lineterminator = '\r\n'
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
855 quoting = csv.QUOTE_NONE
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
856 d = mydialect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
857
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
858 mydialect.lineterminator = ":::"
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
859 d = mydialect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
860
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
861 mydialect.lineterminator = 4
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
862 self.assertRaises(csv.Error, mydialect)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
863
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
864
28827
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
865 class TestSniffer(unittest.TestCase):
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
866 sample1 = """\
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
867 Harry's, Arlington Heights, IL, 2/1/03, Kimi Hayes
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
868 Shark City, Glendale Heights, IL, 12/28/02, Prezence
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
869 Tommy's Place, Blue Island, IL, 12/28/02, Blue Sunday/White Crow
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
870 Stonecutters Seafood and Chop House, Lemont, IL, 12/19/02, Week Back
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
871 """
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
872 sample2 = """\
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
873 'Harry''s':'Arlington Heights':'IL':'2/1/03':'Kimi Hayes'
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
874 'Shark City':'Glendale Heights':'IL':'12/28/02':'Prezence'
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
875 'Tommy''s Place':'Blue Island':'IL':'12/28/02':'Blue Sunday/White Crow'
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
876 'Stonecutters Seafood and Chop House':'Lemont':'IL':'12/19/02':'Week Back'
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
877 """
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
878 header = '''\
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
879 "venue","city","state","date","performers"
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
880 '''
29169
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
881 sample3 = '''\
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
882 05/05/03?05/05/03?05/05/03?05/05/03?05/05/03?05/05/03
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
883 05/05/03?05/05/03?05/05/03?05/05/03?05/05/03?05/05/03
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
884 05/05/03?05/05/03?05/05/03?05/05/03?05/05/03?05/05/03
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
885 '''
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
886
29410
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
887 sample4 = '''\
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
888 2147483648;43.0e12;17;abc;def
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
889 147483648;43.0e2;17;abc;def
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
890 47483648;43.0;170;abc;def
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
891 '''
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
892
36146
22dbf5818b0b Fix for problem with Sniffer class. If your delimiter is whitespace and the
Skip Montanaro <skip@pobox.com>
parents: 34921
diff changeset
893 sample5 = "aaa\tbbb\r\nAAA\t\r\nBBB\t\r\n"
36157
96eb2a5cfbef Fix a delimiter detection problem in sniffer. Sniffing "a|b|c\r\n" was
Skip Montanaro <skip@pobox.com>
parents: 36146
diff changeset
894 sample6 = "a|b|c\r\nd|e|f\r\n"
96eb2a5cfbef Fix a delimiter detection problem in sniffer. Sniffing "a|b|c\r\n" was
Skip Montanaro <skip@pobox.com>
parents: 36146
diff changeset
895 sample7 = "'a'|'b'|'c'\r\n'd'|e|f\r\n"
36146
22dbf5818b0b Fix for problem with Sniffer class. If your delimiter is whitespace and the
Skip Montanaro <skip@pobox.com>
parents: 34921
diff changeset
896
28827
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
897 def test_has_header(self):
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
898 sniffer = csv.Sniffer()
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
899 self.assertEqual(sniffer.has_header(self.sample1), False)
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
900 self.assertEqual(sniffer.has_header(self.header+self.sample1), True)
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
901
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
902 def test_sniff(self):
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
903 sniffer = csv.Sniffer()
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
904 dialect = sniffer.sniff(self.sample1)
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
905 self.assertEqual(dialect.delimiter, ",")
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
906 self.assertEqual(dialect.quotechar, '"')
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
907 self.assertEqual(dialect.skipinitialspace, True)
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
908
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
909 dialect = sniffer.sniff(self.sample2)
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
910 self.assertEqual(dialect.delimiter, ":")
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
911 self.assertEqual(dialect.quotechar, "'")
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
912 self.assertEqual(dialect.skipinitialspace, False)
dc4e47e6f002 some sniffer tests
Skip Montanaro <skip@pobox.com>
parents: 28774
diff changeset
913
29169
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
914 def test_delimiters(self):
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
915 sniffer = csv.Sniffer()
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
916 dialect = sniffer.sniff(self.sample3)
38464
e989ee5d404a ("Forward-port" of r46506)
Armin Rigo <arigo@tunes.org>
parents: 36157
diff changeset
917 # given that all three lines in sample3 are equal,
e989ee5d404a ("Forward-port" of r46506)
Armin Rigo <arigo@tunes.org>
parents: 36157
diff changeset
918 # I think that any character could have been 'guessed' as the
e989ee5d404a ("Forward-port" of r46506)
Armin Rigo <arigo@tunes.org>
parents: 36157
diff changeset
919 # delimiter, depending on dictionary order
e989ee5d404a ("Forward-port" of r46506)
Armin Rigo <arigo@tunes.org>
parents: 36157
diff changeset
920 self.assert_(dialect.delimiter in self.sample3)
29169
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
921 dialect = sniffer.sniff(self.sample3, delimiters="?,")
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
922 self.assertEqual(dialect.delimiter, "?")
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
923 dialect = sniffer.sniff(self.sample3, delimiters="/,")
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
924 self.assertEqual(dialect.delimiter, "/")
29410
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
925 dialect = sniffer.sniff(self.sample4)
f2df9c9f0fcb add a couple test cases which involve longs and floats in 'e' format.
Skip Montanaro <skip@pobox.com>
parents: 29169
diff changeset
926 self.assertEqual(dialect.delimiter, ";")
36146
22dbf5818b0b Fix for problem with Sniffer class. If your delimiter is whitespace and the
Skip Montanaro <skip@pobox.com>
parents: 34921
diff changeset
927 dialect = sniffer.sniff(self.sample5)
22dbf5818b0b Fix for problem with Sniffer class. If your delimiter is whitespace and the
Skip Montanaro <skip@pobox.com>
parents: 34921
diff changeset
928 self.assertEqual(dialect.delimiter, "\t")
36157
96eb2a5cfbef Fix a delimiter detection problem in sniffer. Sniffing "a|b|c\r\n" was
Skip Montanaro <skip@pobox.com>
parents: 36146
diff changeset
929 dialect = sniffer.sniff(self.sample6)
96eb2a5cfbef Fix a delimiter detection problem in sniffer. Sniffing "a|b|c\r\n" was
Skip Montanaro <skip@pobox.com>
parents: 36146
diff changeset
930 self.assertEqual(dialect.delimiter, "|")
96eb2a5cfbef Fix a delimiter detection problem in sniffer. Sniffing "a|b|c\r\n" was
Skip Montanaro <skip@pobox.com>
parents: 36146
diff changeset
931 dialect = sniffer.sniff(self.sample7)
96eb2a5cfbef Fix a delimiter detection problem in sniffer. Sniffing "a|b|c\r\n" was
Skip Montanaro <skip@pobox.com>
parents: 36146
diff changeset
932 self.assertEqual(dialect.delimiter, "|")
96eb2a5cfbef Fix a delimiter detection problem in sniffer. Sniffing "a|b|c\r\n" was
Skip Montanaro <skip@pobox.com>
parents: 36146
diff changeset
933 self.assertEqual(dialect.quotechar, "'")
29169
434ef174f478 * Correct Sniffer doc to correspond to the implementation.
Skip Montanaro <skip@pobox.com>
parents: 28991
diff changeset
934
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
935 if not hasattr(sys, "gettotalrefcount"):
28917
1741af48fd9f Combine the functionality of test_support.run_unittest()
Walter Dörwald <walter@livinglogic.de>
parents: 28827
diff changeset
936 if test_support.verbose: print "*** skipping leakage tests ***"
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
937 else:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
938 class NUL:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
939 def write(s, *args):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
940 pass
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
941 writelines = write
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
942
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
943 class TestLeaks(unittest.TestCase):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
944 def test_create_read(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
945 delta = 0
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
946 lastrc = sys.gettotalrefcount()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
947 for i in xrange(20):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
948 gc.collect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
949 self.assertEqual(gc.garbage, [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
950 rc = sys.gettotalrefcount()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
951 csv.reader(["a,b,c\r\n"])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
952 csv.reader(["a,b,c\r\n"])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
953 csv.reader(["a,b,c\r\n"])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
954 delta = rc-lastrc
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
955 lastrc = rc
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
956 # if csv.reader() leaks, last delta should be 3 or more
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
957 self.assertEqual(delta < 3, True)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
958
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
959 def test_create_write(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
960 delta = 0
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
961 lastrc = sys.gettotalrefcount()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
962 s = NUL()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
963 for i in xrange(20):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
964 gc.collect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
965 self.assertEqual(gc.garbage, [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
966 rc = sys.gettotalrefcount()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
967 csv.writer(s)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
968 csv.writer(s)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
969 csv.writer(s)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
970 delta = rc-lastrc
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
971 lastrc = rc
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
972 # if csv.writer() leaks, last delta should be 3 or more
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
973 self.assertEqual(delta < 3, True)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
974
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
975 def test_read(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
976 delta = 0
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
977 rows = ["a,b,c\r\n"]*5
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
978 lastrc = sys.gettotalrefcount()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
979 for i in xrange(20):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
980 gc.collect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
981 self.assertEqual(gc.garbage, [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
982 rc = sys.gettotalrefcount()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
983 rdr = csv.reader(rows)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
984 for row in rdr:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
985 pass
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
986 delta = rc-lastrc
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
987 lastrc = rc
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
988 # if reader leaks during read, delta should be 5 or more
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
989 self.assertEqual(delta < 5, True)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
990
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
991 def test_write(self):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
992 delta = 0
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
993 rows = [[1,2,3]]*5
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
994 s = NUL()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
995 lastrc = sys.gettotalrefcount()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
996 for i in xrange(20):
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
997 gc.collect()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
998 self.assertEqual(gc.garbage, [])
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
999 rc = sys.gettotalrefcount()
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1000 writer = csv.writer(s)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1001 for row in rows:
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1002 writer.writerow(row)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1003 delta = rc-lastrc
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1004 lastrc = rc
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1005 # if writer leaks during write, last delta should be 5 or more
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1006 self.assertEqual(delta < 5, True)
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1007
28991
ce6c3cc422ab add not-yet-supported Unicode test just so it doesn't get lost.
Skip Montanaro <skip@pobox.com>
parents: 28917
diff changeset
1008 # commented out for now - csv module doesn't yet support Unicode
32258
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1009 ## class TestUnicode(unittest.TestCase):
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1010 ## def test_unicode_read(self):
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1011 ## import codecs
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1012 ## f = codecs.EncodedFile(StringIO("Martin von Löwis,"
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1013 ## "Marc André Lemburg,"
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1014 ## "Guido van Rossum,"
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1015 ## "François Pinard\r\n"),
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1016 ## data_encoding='iso-8859-1')
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1017 ## reader = csv.reader(f)
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1018 ## self.assertEqual(list(reader), [[u"Martin von Löwis",
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1019 ## u"Marc André Lemburg",
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1020 ## u"Guido van Rossum",
3dfe81ac0e7c Rewrote to use temporary files instead of StringIO objects in most places.
Skip Montanaro <skip@pobox.com>
parents: 30632
diff changeset
1021 ## u"François Pinardn"]])
28991
ce6c3cc422ab add not-yet-supported Unicode test just so it doesn't get lost.
Skip Montanaro <skip@pobox.com>
parents: 28917
diff changeset
1022
28917
1741af48fd9f Combine the functionality of test_support.run_unittest()
Walter Dörwald <walter@livinglogic.de>
parents: 28827
diff changeset
1023 def test_main():
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1024 mod = sys.modules[__name__]
28917
1741af48fd9f Combine the functionality of test_support.run_unittest()
Walter Dörwald <walter@livinglogic.de>
parents: 28827
diff changeset
1025 test_support.run_unittest(
1741af48fd9f Combine the functionality of test_support.run_unittest()
Walter Dörwald <walter@livinglogic.de>
parents: 28827
diff changeset
1026 *[getattr(mod, name) for name in dir(mod) if name.startswith('Test')]
1741af48fd9f Combine the functionality of test_support.run_unittest()
Walter Dörwald <walter@livinglogic.de>
parents: 28827
diff changeset
1027 )
28339
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1028
cc35ed2b26a8 new CSV file processing module - see PEP 305
Skip Montanaro <skip@pobox.com>
parents:
diff changeset
1029 if __name__ == '__main__':
28917
1741af48fd9f Combine the functionality of test_support.run_unittest()
Walter Dörwald <walter@livinglogic.de>
parents: 28827
diff changeset
1030 test_main()