annotate Doc/lib/libfileinput.tex @ 25838:8540887bcec6 2.2

Backport of 2.183: Fix memory leak in add_subclass() found by NealN with valgrind.
author Guido van Rossum <guido@python.org>
date Fri, 18 Oct 2002 13:42:21 +0000
parents 6493d5e941c2
children 2ed36833853a
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
8918
acfffe14628e New section header style.
Fred Drake <fdrake@acm.org>
parents: 8716
diff changeset
1 \section{\module{fileinput} ---
11076
4a1d6c7b0950 Minor wording change in section title.
Fred Drake <fdrake@acm.org>
parents: 8918
diff changeset
2 Iterate over lines from multiple input streams}
8716
760dcf197048 Adjusted to use the new module synopsis support macros.
Fred Drake <fdrake@acm.org>
parents: 7860
diff changeset
3 \declaremodule{standard}{fileinput}
8918
acfffe14628e New section header style.
Fred Drake <fdrake@acm.org>
parents: 8716
diff changeset
4 \moduleauthor{Guido van Rossum}{guido@python.org}
acfffe14628e New section header style.
Fred Drake <fdrake@acm.org>
parents: 8716
diff changeset
5 \sectionauthor{Fred L. Drake, Jr.}{fdrake@acm.org}
8716
760dcf197048 Adjusted to use the new module synopsis support macros.
Fred Drake <fdrake@acm.org>
parents: 7860
diff changeset
6
8918
acfffe14628e New section header style.
Fred Drake <fdrake@acm.org>
parents: 8716
diff changeset
7 \modulesynopsis{Perl-like iteration over lines from multiple input
acfffe14628e New section header style.
Fred Drake <fdrake@acm.org>
parents: 8716
diff changeset
8 streams, with ``save in place'' capability.}
8716
760dcf197048 Adjusted to use the new module synopsis support macros.
Fred Drake <fdrake@acm.org>
parents: 7860
diff changeset
9
7860
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
10
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
11 This module implements a helper class and functions to quickly write a
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
12 loop over standard input or a list of files.
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
13
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
14 The typical use is:
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
15
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
16 \begin{verbatim}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
17 import fileinput
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
18 for line in fileinput.input():
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
19 process(line)
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
20 \end{verbatim}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
21
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
22 This iterates over the lines of all files listed in
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
23 \code{sys.argv[1:]}, defaulting to \code{sys.stdin} if the list is
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
24 empty. If a filename is \code{'-'}, it is also replaced by
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
25 \code{sys.stdin}. To specify an alternative list of filenames, pass
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
26 it as the first argument to \function{input()}. A single file name is
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
27 also allowed.
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
28
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
29 All files are opened in text mode. If an I/O error occurs during
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
30 opening or reading a file, \exception{IOError} is raised.
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
31
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
32 If \code{sys.stdin} is used more than once, the second and further use
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
33 will return no lines, except perhaps for interactive use, or if it has
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
34 been explicitly reset (e.g. using \code{sys.stdin.seek(0)}).
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
35
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
36 Empty files are opened and immediately closed; the only time their
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
37 presence in the list of filenames is noticeable at all is when the
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
38 last file opened is empty.
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
39
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
40 It is possible that the last line of a file does not end in a newline
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
41 character; lines are returned including the trailing newline when it
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
42 is present.
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
43
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
44 The following function is the primary interface of this module:
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
45
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
46 \begin{funcdesc}{input}{\optional{files\optional{,
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
47 inplace\optional{, backup}}}}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
48 Create an instance of the \class{FileInput} class. The instance
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
49 will be used as global state for the functions of this module, and
17714
6493d5e941c2 Note that when inplace=1 existing backup files will be removed silently.
Fred Drake <fdrake@acm.org>
parents: 12223
diff changeset
50 is also returned to use during iteration. The parameters to this
6493d5e941c2 Note that when inplace=1 existing backup files will be removed silently.
Fred Drake <fdrake@acm.org>
parents: 12223
diff changeset
51 function will be passed along to the constructor of the
6493d5e941c2 Note that when inplace=1 existing backup files will be removed silently.
Fred Drake <fdrake@acm.org>
parents: 12223
diff changeset
52 \class{FileInput} class.
7860
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
53 \end{funcdesc}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
54
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
55
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
56 The following functions use the global state created by
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
57 \function{input()}; if there is no active state,
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
58 \exception{RuntimeError} is raised.
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
59
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
60 \begin{funcdesc}{filename}{}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
61 Return the name of the file currently being read. Before the first
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
62 line has been read, returns \code{None}.
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
63 \end{funcdesc}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
64
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
65 \begin{funcdesc}{lineno}{}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
66 Return the cumulative line number of the line that has just been
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
67 read. Before the first line has been read, returns \code{0}. After
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
68 the last line of the last file has been read, returns the line
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
69 number of that line.
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
70 \end{funcdesc}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
71
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
72 \begin{funcdesc}{filelineno}{}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
73 Return the line number in the current file. Before the first line
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
74 has been read, returns \code{0}. After the last line of the last
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
75 file has been read, returns the line number of that line within the
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
76 file.
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
77 \end{funcdesc}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
78
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
79 \begin{funcdesc}{isfirstline}{}
12223
e82e82b3b9ad Merged changes from the 1.5.2p2 release.
Fred Drake <fdrake@acm.org>
parents: 11076
diff changeset
80 Returns true the line just read is the first line of its file,
e82e82b3b9ad Merged changes from the 1.5.2p2 release.
Fred Drake <fdrake@acm.org>
parents: 11076
diff changeset
81 otherwise returns false.
7860
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
82 \end{funcdesc}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
83
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
84 \begin{funcdesc}{isstdin}{}
12223
e82e82b3b9ad Merged changes from the 1.5.2p2 release.
Fred Drake <fdrake@acm.org>
parents: 11076
diff changeset
85 Returns true if the last line was read from \code{sys.stdin},
e82e82b3b9ad Merged changes from the 1.5.2p2 release.
Fred Drake <fdrake@acm.org>
parents: 11076
diff changeset
86 otherwise returns false.
7860
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
87 \end{funcdesc}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
88
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
89 \begin{funcdesc}{nextfile}{}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
90 Close the current file so that the next iteration will read the
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
91 first line from the next file (if any); lines not read from the file
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
92 will not count towards the cumulative line count. The filename is
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
93 not changed until after the first line of the next file has been
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
94 read. Before the first line has been read, this function has no
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
95 effect; it cannot be used to skip the first file. After the last
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
96 line of the last file has been read, this function has no effect.
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
97 \end{funcdesc}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
98
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
99 \begin{funcdesc}{close}{}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
100 Close the sequence.
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
101 \end{funcdesc}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
102
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
103
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
104 The class which implements the sequence behavior provided by the
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
105 module is available for subclassing as well:
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
106
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
107 \begin{classdesc}{FileInput}{\optional{files\optional{,
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
108 inplace\optional{, backup}}}}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
109 Class \class{FileInput} is the implementation; its methods
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
110 \method{filename()}, \method{lineno()}, \method{fileline()},
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
111 \method{isfirstline()}, \method{isstdin()}, \method{nextfile()} and
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
112 \method{close()} correspond to the functions of the same name in the
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
113 module. In addition it has a \method{readline()} method which
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
114 returns the next input line, and a \method{__getitem__()} method
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
115 which implements the sequence behavior. The sequence must be
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
116 accessed in strictly sequential order; random access and
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
117 \method{readline()} cannot be mixed.
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
118 \end{classdesc}
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
119
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
120 \strong{Optional in-place filtering:} if the keyword argument
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
121 \code{\var{inplace}=1} is passed to \function{input()} or to the
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
122 \class{FileInput} constructor, the file is moved to a backup file and
17714
6493d5e941c2 Note that when inplace=1 existing backup files will be removed silently.
Fred Drake <fdrake@acm.org>
parents: 12223
diff changeset
123 standard output is directed to the input file (if a file of the same
6493d5e941c2 Note that when inplace=1 existing backup files will be removed silently.
Fred Drake <fdrake@acm.org>
parents: 12223
diff changeset
124 name as the backup file already exists, it will be replaced silently).
7860
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
125 This makes it possible to write a filter that rewrites its input file
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
126 in place. If the keyword argument \code{\var{backup}='.<some
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
127 extension>'} is also given, it specifies the extension for the backup
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
128 file, and the backup file remains around; by default, the extension is
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
129 \code{'.bak'} and it is deleted when the output file is closed. In-place
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
130 filtering is disabled when standard input is read.
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
131
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
132 \strong{Caveat:} The current implementation does not work for MS-DOS
9e10c862abfc Document fileinput.
Fred Drake <fdrake@acm.org>
parents:
diff changeset
133 8+3 filesystems.