annotate Lib/fileinput.py @ 27998:e27f58a50737 legacy-trunk

SF bug #690377: Dud footnote reference in distutils docs
author Raymond Hettinger <python@rcn.com>
date Fri, 21 Feb 2003 02:47:09 +0000
parents 0cadc29180e6
children 25cc61614720 0d5f8077bd24
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
1 """Helper class to quickly write a loop over all standard input files.
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
2
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
3 Typical use is:
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
4
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
5 import fileinput
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
6 for line in fileinput.input():
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
7 process(line)
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
8
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
9 This iterates over the lines of all files listed in sys.argv[1:],
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
10 defaulting to sys.stdin if the list is empty. If a filename is '-' it
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
11 is also replaced by sys.stdin. To specify an alternative list of
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
12 filenames, pass it as the argument to input(). A single file name is
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
13 also allowed.
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
14
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
15 Functions filename(), lineno() return the filename and cumulative line
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
16 number of the line that has just been read; filelineno() returns its
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
17 line number in the current file; isfirstline() returns true iff the
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
18 line just read is the first line of its file; isstdin() returns true
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
19 iff the line was read from sys.stdin. Function nextfile() closes the
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
20 current file so that the next iteration will read the first line from
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
21 the next file (if any); lines not read from the file will not count
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
22 towards the cumulative line count; the filename is not changed until
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
23 after the first line of the next file has been read. Function close()
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
24 closes the sequence.
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
25
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
26 Before any lines have been read, filename() returns None and both line
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
27 numbers are zero; nextfile() has no effect. After all lines have been
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
28 read, filename() and the line number functions return the values
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
29 pertaining to the last line read; nextfile() has no effect.
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
30
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
31 All files are opened in text mode. If an I/O error occurs during
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
32 opening or reading a file, the IOError exception is raised.
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
33
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
34 If sys.stdin is used more than once, the second and further use will
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
35 return no lines, except perhaps for interactive use, or if it has been
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
36 explicitly reset (e.g. using sys.stdin.seek(0)).
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
37
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
38 Empty files are opened and immediately closed; the only time their
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
39 presence in the list of filenames is noticeable at all is when the
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
40 last file opened is empty.
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
41
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
42 It is possible that the last line of a file doesn't end in a newline
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
43 character; otherwise lines are returned including the trailing
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
44 newline.
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
45
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
46 Class FileInput is the implementation; its methods filename(),
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
47 lineno(), fileline(), isfirstline(), isstdin(), nextfile() and close()
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
48 correspond to the functions in the module. In addition it has a
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
49 readline() method which returns the next input line, and a
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
50 __getitem__() method which implements the sequence behavior. The
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
51 sequence must be accessed in strictly sequential order; sequence
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
52 access and readline() cannot be mixed.
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
53
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
54 Optional in-place filtering: if the keyword argument inplace=1 is
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
55 passed to input() or to the FileInput constructor, the file is moved
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
56 to a backup file and standard output is directed to the input file.
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
57 This makes it possible to write a filter that rewrites its input file
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
58 in place. If the keyword argument backup=".<some extension>" is also
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
59 given, it specifies the extension for the backup file, and the backup
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
60 file remains around; by default, the extension is ".bak" and it is
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
61 deleted when the output file is closed. In-place filtering is
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
62 disabled when standard input is read. XXX The current implementation
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
63 does not work for MS-DOS 8+3 filesystems.
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
64
15746
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
65 Performance: this module is unfortunately one of the slower ways of
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
66 processing large numbers of input lines. Nevertheless, a significant
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
67 speed-up has been obtained by using readlines(bufsize) instead of
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
68 readline(). A new keyword argument, bufsize=N, is present on the
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
69 input() function and the FileInput() class to override the default
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
70 buffer size.
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
71
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
72 XXX Possible additions:
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
73
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
74 - optional getopt argument processing
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
75 - specify open mode ('r' or 'rb')
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
76 - fileno()
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
77 - isatty()
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
78 - read(), read(size), even readlines()
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
79
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
80 """
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
81
23697
c0e8c07ae1d6 Replace obsolete stat module constants with
Walter Dörwald <walter@livinglogic.de>
parents: 23521
diff changeset
82 import sys, os
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
83
16072
bae889f44cd1 more __all__ updates
Skip Montanaro <skip@pobox.com>
parents: 15746
diff changeset
84 __all__ = ["input","close","nextfile","filename","lineno","filelineno",
bae889f44cd1 more __all__ updates
Skip Montanaro <skip@pobox.com>
parents: 15746
diff changeset
85 "isfirstline","isstdin","FileInput"]
bae889f44cd1 more __all__ updates
Skip Montanaro <skip@pobox.com>
parents: 15746
diff changeset
86
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
87 _state = None
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
88
15746
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
89 DEFAULT_BUFSIZE = 8*1024
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
90
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
91 def input(files=None, inplace=0, backup="", bufsize=0):
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
92 """input([files[, inplace[, backup]]])
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
93
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
94 Create an instance of the FileInput class. The instance will be used
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
95 as global state for the functions of this module, and is also returned
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
96 to use during iteration. The parameters to this function will be passed
23521
a90faa5f9417 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 23455
diff changeset
97 along to the constructor of the FileInput class.
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
98 """
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
99 global _state
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
100 if _state and _state._file:
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
101 raise RuntimeError, "input() already active"
15746
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
102 _state = FileInput(files, inplace, backup, bufsize)
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
103 return _state
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
104
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
105 def close():
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
106 """Close the sequence."""
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
107 global _state
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
108 state = _state
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
109 _state = None
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
110 if state:
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
111 state.close()
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
112
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
113 def nextfile():
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
114 """
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
115 Close the current file so that the next iteration will read the first
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
116 line from the next file (if any); lines not read from the file will
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
117 not count towards the cumulative line count. The filename is not
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
118 changed until after the first line of the next file has been read.
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
119 Before the first line has been read, this function has no effect;
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
120 it cannot be used to skip the first file. After the last line of the
23521
a90faa5f9417 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 23455
diff changeset
121 last file has been read, this function has no effect.
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
122 """
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
123 if not _state:
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
124 raise RuntimeError, "no active input()"
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
125 return _state.nextfile()
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
126
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
127 def filename():
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
128 """
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
129 Return the name of the file currently being read.
23521
a90faa5f9417 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 23455
diff changeset
130 Before the first line has been read, returns None.
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
131 """
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
132 if not _state:
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
133 raise RuntimeError, "no active input()"
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
134 return _state.filename()
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
135
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
136 def lineno():
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
137 """
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
138 Return the cumulative line number of the line that has just been read.
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
139 Before the first line has been read, returns 0. After the last line
23521
a90faa5f9417 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 23455
diff changeset
140 of the last file has been read, returns the line number of that line.
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
141 """
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
142 if not _state:
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
143 raise RuntimeError, "no active input()"
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
144 return _state.lineno()
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
145
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
146 def filelineno():
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
147 """
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
148 Return the line number in the current file. Before the first line
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
149 has been read, returns 0. After the last line of the last file has
23521
a90faa5f9417 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 23455
diff changeset
150 been read, returns the line number of that line within the file.
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
151 """
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
152 if not _state:
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
153 raise RuntimeError, "no active input()"
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
154 return _state.filelineno()
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
155
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
156 def isfirstline():
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
157 """
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
158 Returns true the line just read is the first line of its file,
23521
a90faa5f9417 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 23455
diff changeset
159 otherwise returns false.
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
160 """
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
161 if not _state:
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
162 raise RuntimeError, "no active input()"
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
163 return _state.isfirstline()
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
164
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
165 def isstdin():
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
166 """
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
167 Returns true if the last line was read from sys.stdin,
23521
a90faa5f9417 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 23455
diff changeset
168 otherwise returns false.
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
169 """
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
170 if not _state:
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
171 raise RuntimeError, "no active input()"
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
172 return _state.isstdin()
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
173
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
174 class FileInput:
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
175 """class FileInput([files[, inplace[, backup]]])
23521
a90faa5f9417 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 23455
diff changeset
176
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
177 Class FileInput is the implementation of the module; its methods
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
178 filename(), lineno(), fileline(), isfirstline(), isstdin(), nextfile()
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
179 and close() correspond to the functions of the same name in the module.
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
180 In addition it has a readline() method which returns the next
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
181 input line, and a __getitem__() method which implements the
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
182 sequence behavior. The sequence must be accessed in strictly
23521
a90faa5f9417 Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 23455
diff changeset
183 sequential order; random access and readline() cannot be mixed.
23455
68c776ba5ea5 Added docstrings excerpted from Python Library Reference.
Raymond Hettinger <python@rcn.com>
parents: 23075
diff changeset
184 """
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
185
15746
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
186 def __init__(self, files=None, inplace=0, backup="", bufsize=0):
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
187 if type(files) == type(''):
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
188 files = (files,)
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
189 else:
12340
e2620aab9f2d Implement suggestion from Lawrence Kesteloot in PR#280, to change the
Guido van Rossum <guido@python.org>
parents: 11387
diff changeset
190 if files is None:
e2620aab9f2d Implement suggestion from Lawrence Kesteloot in PR#280, to change the
Guido van Rossum <guido@python.org>
parents: 11387
diff changeset
191 files = sys.argv[1:]
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
192 if not files:
12340
e2620aab9f2d Implement suggestion from Lawrence Kesteloot in PR#280, to change the
Guido van Rossum <guido@python.org>
parents: 11387
diff changeset
193 files = ('-',)
e2620aab9f2d Implement suggestion from Lawrence Kesteloot in PR#280, to change the
Guido van Rossum <guido@python.org>
parents: 11387
diff changeset
194 else:
e2620aab9f2d Implement suggestion from Lawrence Kesteloot in PR#280, to change the
Guido van Rossum <guido@python.org>
parents: 11387
diff changeset
195 files = tuple(files)
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
196 self._files = files
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
197 self._inplace = inplace
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
198 self._backup = backup
15746
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
199 self._bufsize = bufsize or DEFAULT_BUFSIZE
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
200 self._savestdout = None
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
201 self._output = None
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
202 self._filename = None
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
203 self._lineno = 0
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
204 self._filelineno = 0
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
205 self._file = None
22867
e2f2187c3d2c Partial introduction of bools where appropriate.
Guido van Rossum <guido@python.org>
parents: 22595
diff changeset
206 self._isstdin = False
8687
fd49ed65cd20 Add missing initializer for self._backupfilename. Due to Ralph Butler.
Guido van Rossum <guido@python.org>
parents: 7755
diff changeset
207 self._backupfilename = None
15746
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
208 self._buffer = []
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
209 self._bufindex = 0
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
210
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
211 def __del__(self):
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
212 self.close()
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
213
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
214 def close(self):
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
215 self.nextfile()
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
216 self._files = ()
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
217
22595
204d46fc54f6 Implement iterator protocol.
Neil Schemenauer <nascheme@enme.ucalgary.ca>
parents: 20654
diff changeset
218 def __iter__(self):
204d46fc54f6 Implement iterator protocol.
Neil Schemenauer <nascheme@enme.ucalgary.ca>
parents: 20654
diff changeset
219 return self
204d46fc54f6 Implement iterator protocol.
Neil Schemenauer <nascheme@enme.ucalgary.ca>
parents: 20654
diff changeset
220
204d46fc54f6 Implement iterator protocol.
Neil Schemenauer <nascheme@enme.ucalgary.ca>
parents: 20654
diff changeset
221 def next(self):
15746
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
222 try:
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
223 line = self._buffer[self._bufindex]
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
224 except IndexError:
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
225 pass
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
226 else:
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
227 self._bufindex += 1
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
228 self._lineno += 1
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
229 self._filelineno += 1
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
230 return line
22595
204d46fc54f6 Implement iterator protocol.
Neil Schemenauer <nascheme@enme.ucalgary.ca>
parents: 20654
diff changeset
231 line = self.readline()
204d46fc54f6 Implement iterator protocol.
Neil Schemenauer <nascheme@enme.ucalgary.ca>
parents: 20654
diff changeset
232 if not line:
204d46fc54f6 Implement iterator protocol.
Neil Schemenauer <nascheme@enme.ucalgary.ca>
parents: 20654
diff changeset
233 raise StopIteration
204d46fc54f6 Implement iterator protocol.
Neil Schemenauer <nascheme@enme.ucalgary.ca>
parents: 20654
diff changeset
234 return line
23075
b7e87732f6ab Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 22867
diff changeset
235
22595
204d46fc54f6 Implement iterator protocol.
Neil Schemenauer <nascheme@enme.ucalgary.ca>
parents: 20654
diff changeset
236 def __getitem__(self, i):
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
237 if i != self._lineno:
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
238 raise RuntimeError, "accessing lines out of order"
22595
204d46fc54f6 Implement iterator protocol.
Neil Schemenauer <nascheme@enme.ucalgary.ca>
parents: 20654
diff changeset
239 try:
204d46fc54f6 Implement iterator protocol.
Neil Schemenauer <nascheme@enme.ucalgary.ca>
parents: 20654
diff changeset
240 return self.next()
204d46fc54f6 Implement iterator protocol.
Neil Schemenauer <nascheme@enme.ucalgary.ca>
parents: 20654
diff changeset
241 except StopIteration:
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
242 raise IndexError, "end of input reached"
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
243
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
244 def nextfile(self):
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
245 savestdout = self._savestdout
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
246 self._savestdout = 0
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
247 if savestdout:
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
248 sys.stdout = savestdout
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
249
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
250 output = self._output
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
251 self._output = 0
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
252 if output:
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
253 output.close()
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
254
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
255 file = self._file
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
256 self._file = 0
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
257 if file and not self._isstdin:
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
258 file.close()
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
259
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
260 backupfilename = self._backupfilename
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
261 self._backupfilename = 0
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
262 if backupfilename and not self._backup:
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
263 try: os.unlink(backupfilename)
24807
685cd52c4c43 tightening up a few except: clauses
Skip Montanaro <skip@pobox.com>
parents: 23697
diff changeset
264 except OSError: pass
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
265
22867
e2f2187c3d2c Partial introduction of bools where appropriate.
Guido van Rossum <guido@python.org>
parents: 22595
diff changeset
266 self._isstdin = False
15746
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
267 self._buffer = []
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
268 self._bufindex = 0
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
269
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
270 def readline(self):
15746
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
271 try:
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
272 line = self._buffer[self._bufindex]
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
273 except IndexError:
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
274 pass
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
275 else:
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
276 self._bufindex += 1
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
277 self._lineno += 1
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
278 self._filelineno += 1
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
279 return line
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
280 if not self._file:
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
281 if not self._files:
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
282 return ""
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
283 self._filename = self._files[0]
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
284 self._files = self._files[1:]
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
285 self._filelineno = 0
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
286 self._file = None
22867
e2f2187c3d2c Partial introduction of bools where appropriate.
Guido van Rossum <guido@python.org>
parents: 22595
diff changeset
287 self._isstdin = False
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
288 self._backupfilename = 0
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
289 if self._filename == '-':
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
290 self._filename = '<stdin>'
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
291 self._file = sys.stdin
22867
e2f2187c3d2c Partial introduction of bools where appropriate.
Guido van Rossum <guido@python.org>
parents: 22595
diff changeset
292 self._isstdin = True
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
293 else:
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
294 if self._inplace:
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
295 self._backupfilename = (
20654
edd9d0b3c47e SF patch #474590 -- RISC OS support
Guido van Rossum <guido@python.org>
parents: 16072
diff changeset
296 self._filename + (self._backup or os.extsep+"bak"))
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
297 try: os.unlink(self._backupfilename)
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
298 except os.error: pass
11387
019cd21c8c9f Fix for PR#111: when using the inplace option, give the new file the
Guido van Rossum <guido@python.org>
parents: 8687
diff changeset
299 # The next few lines may raise IOError
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
300 os.rename(self._filename, self._backupfilename)
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
301 self._file = open(self._backupfilename, "r")
11387
019cd21c8c9f Fix for PR#111: when using the inplace option, give the new file the
Guido van Rossum <guido@python.org>
parents: 8687
diff changeset
302 try:
23697
c0e8c07ae1d6 Replace obsolete stat module constants with
Walter Dörwald <walter@livinglogic.de>
parents: 23521
diff changeset
303 perm = os.fstat(self._file.fileno()).st_mode
24807
685cd52c4c43 tightening up a few except: clauses
Skip Montanaro <skip@pobox.com>
parents: 23697
diff changeset
304 except OSError:
11387
019cd21c8c9f Fix for PR#111: when using the inplace option, give the new file the
Guido van Rossum <guido@python.org>
parents: 8687
diff changeset
305 self._output = open(self._filename, "w")
019cd21c8c9f Fix for PR#111: when using the inplace option, give the new file the
Guido van Rossum <guido@python.org>
parents: 8687
diff changeset
306 else:
019cd21c8c9f Fix for PR#111: when using the inplace option, give the new file the
Guido van Rossum <guido@python.org>
parents: 8687
diff changeset
307 fd = os.open(self._filename,
019cd21c8c9f Fix for PR#111: when using the inplace option, give the new file the
Guido van Rossum <guido@python.org>
parents: 8687
diff changeset
308 os.O_CREAT | os.O_WRONLY | os.O_TRUNC,
019cd21c8c9f Fix for PR#111: when using the inplace option, give the new file the
Guido van Rossum <guido@python.org>
parents: 8687
diff changeset
309 perm)
019cd21c8c9f Fix for PR#111: when using the inplace option, give the new file the
Guido van Rossum <guido@python.org>
parents: 8687
diff changeset
310 self._output = os.fdopen(fd, "w")
019cd21c8c9f Fix for PR#111: when using the inplace option, give the new file the
Guido van Rossum <guido@python.org>
parents: 8687
diff changeset
311 try:
27166
0cadc29180e6 Test that chmod() actually exists before calling it (it doesn't on MacOS9).
Jack Jansen <jack.jansen@cwi.nl>
parents: 24807
diff changeset
312 if hasattr(os, 'chmod'):
0cadc29180e6 Test that chmod() actually exists before calling it (it doesn't on MacOS9).
Jack Jansen <jack.jansen@cwi.nl>
parents: 24807
diff changeset
313 os.chmod(self._filename, perm)
24807
685cd52c4c43 tightening up a few except: clauses
Skip Montanaro <skip@pobox.com>
parents: 23697
diff changeset
314 except OSError:
11387
019cd21c8c9f Fix for PR#111: when using the inplace option, give the new file the
Guido van Rossum <guido@python.org>
parents: 8687
diff changeset
315 pass
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
316 self._savestdout = sys.stdout
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
317 sys.stdout = self._output
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
318 else:
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
319 # This may raise IOError
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
320 self._file = open(self._filename, "r")
15746
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
321 self._buffer = self._file.readlines(self._bufsize)
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
322 self._bufindex = 0
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
323 if not self._buffer:
4dbbf322a9df Speed it up by using readlines(sizehint). It's still slower than
Guido van Rossum <guido@python.org>
parents: 12340
diff changeset
324 self.nextfile()
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
325 # Recursive call
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
326 return self.readline()
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
327
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
328 def filename(self):
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
329 return self._filename
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
330
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
331 def lineno(self):
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
332 return self._lineno
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
333
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
334 def filelineno(self):
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
335 return self._filelineno
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
336
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
337 def isfirstline(self):
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
338 return self._filelineno == 1
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
339
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
340 def isstdin(self):
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
341 return self._isstdin
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
342
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
343 def _test():
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
344 import getopt
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
345 inplace = 0
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
346 backup = 0
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
347 opts, args = getopt.getopt(sys.argv[1:], "ib:")
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
348 for o, a in opts:
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
349 if o == '-i': inplace = 1
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
350 if o == '-b': backup = a
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
351 for line in input(args, inplace=inplace, backup=backup):
7755
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
352 if line[-1:] == '\n': line = line[:-1]
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
353 if line[-1:] == '\r': line = line[:-1]
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
354 print "%d: %s[%d]%s %s" % (lineno(), filename(), filelineno(),
fb4b4d069cc7 Mass check-in after untabifying all files that need it.
Guido van Rossum <guido@python.org>
parents: 6620
diff changeset
355 isfirstline() and "*" or "", line)
6620
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
356 print "%d: %s[%d]" % (lineno(), filename(), filelineno())
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
357
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
358 if __name__ == '__main__':
00b1b77c4177 A new standard module, as discussed on comp.lang.python, to simplify
Guido van Rossum <guido@python.org>
parents:
diff changeset
359 _test()