cpython-lru_cache-weakref: Tools/scripts/fixcid.py annotate

annotate Tools/scripts/fixcid.py @ 25838:8540887bcec6 2.2

Backport of 2.183: Fix memory leak in add_subclass() found by NealN with valgrind.

author	Guido van Rossum <guido@python.org>
date	Fri, 18 Oct 2002 13:42:21 +0000
parents	1881b968989b
children	8a7a2f1f88f0

rev	line source
4573 73758db2f464 /usr/local/bin/python -> /usr/bin/env python Guido van Rossum <guido@python.org> parents: 3026 diff changeset	1 #! /usr/bin/env python
1309 02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	2
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	3 # Perform massive identifier substitution on C source files.
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	4 # This actually tokenizes the files (to some extent) so it can
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	5 # avoid making substitutions inside strings or comments.
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	6 # Inside strings, substitutions are never made; inside comments,
5537 b1df938655e1 Correct comment; -c is off by default. Guido van Rossum <guido@python.org> parents: 4573 diff changeset	7 # it is a user option (off by default).
1309 02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	8 #
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	9 # The substitutions are read from one or more files whose lines,
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	10 # when not empty, after stripping comments starting with #,
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	11 # must contain exactly two words separated by whitespace: the
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	12 # old identifier and its replacement.
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	13 #
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	14 # The option -r reverses the sense of the substitutions (this may be
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	15 # useful to undo a particular substitution).
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	16 #
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	17 # If the old identifier is prefixed with a '*' (with no intervening
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	18 # whitespace), then it will not be substituted inside comments.
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	19 #
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	20 # Command line arguments are files or directories to be processed.
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	21 # Directories are searched recursively for files whose name looks
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	22 # like a C file (ends in .h or .c). The special filename '-' means
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	23 # operate in filter mode: read stdin, write stdout.
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	24 #
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	25 # Symbolic links are always ignored (except as explicit directory
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	26 # arguments).
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	27 #
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	28 # The original files are kept as back-up with a "~" suffix.
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	29 #
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	30 # Changes made are reported to stdout in a diff-like format.
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	31 #
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	32 # NB: by changing only the function fixline() you can turn this
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	33 # into a program for different changes to C source files; by
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	34 # changing the function wanted() you can make a different selection of
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	35 # files.
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	36
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	37 import sys
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	38 import regex
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	39 import string
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	40 import os
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	41 from stat import *
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	42 import getopt
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	43
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	44 err = sys.stderr.write
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	45 dbg = err
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	46 rep = sys.stdout.write
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	47
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	48 def usage():
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	49 progname = sys.argv[0]
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	50 err('Usage: ' + progname +
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	51 ' [-c] [-r] [-s file] ... file-or-directory ...\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	52 err('\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	53 err('-c : substitute inside comments\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	54 err('-r : reverse direction for following -s options\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	55 err('-s substfile : add a file of substitutions\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	56 err('\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	57 err('Each non-empty non-comment line in a substitution file must\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	58 err('contain exactly two words: an identifier and its replacement.\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	59 err('Comments start with a # character and end at end of line.\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	60 err('If an identifier is preceded with a *, it is not substituted\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	61 err('inside a comment even when -c is specified.\n')
1309 02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	62
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	63 def main():
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	64 try:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	65 opts, args = getopt.getopt(sys.argv[1:], 'crs:')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	66 except getopt.error, msg:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	67 err('Options error: ' + str(msg) + '\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	68 usage()
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	69 sys.exit(2)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	70 bad = 0
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	71 if not args: # No arguments
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	72 usage()
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	73 sys.exit(2)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	74 for opt, arg in opts:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	75 if opt == '-c':
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	76 setdocomments()
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	77 if opt == '-r':
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	78 setreverse()
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	79 if opt == '-s':
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	80 addsubst(arg)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	81 for arg in args:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	82 if os.path.isdir(arg):
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	83 if recursedown(arg): bad = 1
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	84 elif os.path.islink(arg):
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	85 err(arg + ': will not process symbolic links\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	86 bad = 1
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	87 else:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	88 if fix(arg): bad = 1
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	89 sys.exit(bad)
1309 02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	90
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	91 # Change this regular expression to select a different set of files
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	92 Wanted = '^[a-zA-Z0-9_]+\.[ch]$'
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	93 def wanted(name):
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	94 return regex.match(Wanted, name) >= 0
1309 02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	95
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	96 def recursedown(dirname):
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	97 dbg('recursedown(' + `dirname` + ')\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	98 bad = 0
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	99 try:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	100 names = os.listdir(dirname)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	101 except os.error, msg:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	102 err(dirname + ': cannot list directory: ' + str(msg) + '\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	103 return 1
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	104 names.sort()
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	105 subdirs = []
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	106 for name in names:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	107 if name in (os.curdir, os.pardir): continue
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	108 fullname = os.path.join(dirname, name)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	109 if os.path.islink(fullname): pass
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	110 elif os.path.isdir(fullname):
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	111 subdirs.append(fullname)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	112 elif wanted(name):
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	113 if fix(fullname): bad = 1
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	114 for fullname in subdirs:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	115 if recursedown(fullname): bad = 1
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	116 return bad
1309 02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	117
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	118 def fix(filename):
15932 1881b968989b Hand repair of cases where reindent changed lines of the form Tim Peters <tim.peters@gmail.com> parents: 15930 diff changeset	119 ## dbg('fix(' + `filename` + ')\n')
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	120 if filename == '-':
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	121 # Filter mode
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	122 f = sys.stdin
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	123 g = sys.stdout
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	124 else:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	125 # File replacement mode
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	126 try:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	127 f = open(filename, 'r')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	128 except IOError, msg:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	129 err(filename + ': cannot open: ' + str(msg) + '\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	130 return 1
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	131 head, tail = os.path.split(filename)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	132 tempname = os.path.join(head, '@' + tail)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	133 g = None
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	134 # If we find a match, we rewind the file and start over but
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	135 # now copy everything to a temp file.
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	136 lineno = 0
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	137 initfixline()
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	138 while 1:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	139 line = f.readline()
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	140 if not line: break
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	141 lineno = lineno + 1
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	142 while line[-2:] == '\\\n':
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	143 nextline = f.readline()
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	144 if not nextline: break
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	145 line = line + nextline
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	146 lineno = lineno + 1
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	147 newline = fixline(line)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	148 if newline != line:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	149 if g is None:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	150 try:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	151 g = open(tempname, 'w')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	152 except IOError, msg:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	153 f.close()
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	154 err(tempname+': cannot create: '+
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	155 str(msg)+'\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	156 return 1
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	157 f.seek(0)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	158 lineno = 0
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	159 initfixline()
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	160 rep(filename + ':\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	161 continue # restart from the beginning
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	162 rep(`lineno` + '\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	163 rep('< ' + line)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	164 rep('> ' + newline)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	165 if g is not None:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	166 g.write(newline)
1309 02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	167
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	168 # End of file
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	169 if filename == '-': return 0 # Done in filter mode
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	170 f.close()
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	171 if not g: return 0 # No changes
1309 02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	172
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	173 # Finishing touch -- move files
1309 02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	174
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	175 # First copy the file's mode to the temp file
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	176 try:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	177 statbuf = os.stat(filename)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	178 os.chmod(tempname, statbuf[ST_MODE] & 07777)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	179 except os.error, msg:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	180 err(tempname + ': warning: chmod failed (' + str(msg) + ')\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	181 # Then make a backup of the original file as filename~
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	182 try:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	183 os.rename(filename, filename + '~')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	184 except os.error, msg:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	185 err(filename + ': warning: backup failed (' + str(msg) + ')\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	186 # Now move the temp file to the original file
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	187 try:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	188 os.rename(tempname, filename)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	189 except os.error, msg:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	190 err(filename + ': rename failed (' + str(msg) + ')\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	191 return 1
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	192 # Return succes
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	193 return 0
1309 02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	194
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	195 # Tokenizing ANSI C (partly)
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	196
1928 a8b7ee0e572d Get rid of freeze (now its own directory). Guido van Rossum <guido@python.org> parents: 1506 diff changeset	197 Identifier = '$struct $?[a-zA-Z_][a-zA-Z0-9_]+'
1309 02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	198 String = '"$[^\n\\"]\\|\\\\.$*"'
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	199 Char = '\'$[^\n\\\']\\|\\\\.$*\''
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	200 CommentStart = '/\*'
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	201 CommentEnd = '\*/'
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	202
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	203 Hexnumber = '0[xX][0-9a-fA-F][uUlL]'
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	204 Octnumber = '0[0-7][uUlL]'
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	205 Decnumber = '[1-9][0-9][uUlL]'
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	206 Intnumber = Hexnumber + '\\|' + Octnumber + '\\|' + Decnumber
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	207 Exponent = '[eE][-+]?[0-9]+'
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	208 Pointfloat = '$[0-9]+\.[0-9]*\\|\.[0-9]+$$' + Exponent + '$?'
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	209 Expfloat = '[0-9]+' + Exponent
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	210 Floatnumber = Pointfloat + '\\|' + Expfloat
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	211 Number = Floatnumber + '\\|' + Intnumber
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	212
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	213 # Anything else is an operator -- don't list this explicitly because of '/*'
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	214
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	215 OutsideComment = (Identifier, Number, String, Char, CommentStart)
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	216 OutsideCommentPattern = '$' + string.joinfields(OutsideComment, '\\|') + '$'
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	217 OutsideCommentProgram = regex.compile(OutsideCommentPattern)
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	218
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	219 InsideComment = (Identifier, Number, CommentEnd)
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	220 InsideCommentPattern = '$' + string.joinfields(InsideComment, '\\|') + '$'
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	221 InsideCommentProgram = regex.compile(InsideCommentPattern)
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	222
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	223 def initfixline():
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	224 global Program
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	225 Program = OutsideCommentProgram
1309 02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	226
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	227 def fixline(line):
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	228 global Program
15932 1881b968989b Hand repair of cases where reindent changed lines of the form Tim Peters <tim.peters@gmail.com> parents: 15930 diff changeset	229 ## print '-->', `line`
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	230 i = 0
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	231 while i < len(line):
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	232 i = Program.search(line, i)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	233 if i < 0: break
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	234 found = Program.group(0)
15932 1881b968989b Hand repair of cases where reindent changed lines of the form Tim Peters <tim.peters@gmail.com> parents: 15930 diff changeset	235 ## if Program is InsideCommentProgram: print '...',
1881b968989b Hand repair of cases where reindent changed lines of the form Tim Peters <tim.peters@gmail.com> parents: 15930 diff changeset	236 ## else: print ' ',
1881b968989b Hand repair of cases where reindent changed lines of the form Tim Peters <tim.peters@gmail.com> parents: 15930 diff changeset	237 ## print found
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	238 if len(found) == 2:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	239 if found == '/*':
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	240 Program = InsideCommentProgram
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	241 elif found == '*/':
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	242 Program = OutsideCommentProgram
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	243 n = len(found)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	244 if Dict.has_key(found):
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	245 subst = Dict[found]
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	246 if Program is InsideCommentProgram:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	247 if not Docomments:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	248 print 'Found in comment:', found
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	249 i = i + n
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	250 continue
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	251 if NotInComment.has_key(found):
15932 1881b968989b Hand repair of cases where reindent changed lines of the form Tim Peters <tim.peters@gmail.com> parents: 15930 diff changeset	252 ## print 'Ignored in comment:',
1881b968989b Hand repair of cases where reindent changed lines of the form Tim Peters <tim.peters@gmail.com> parents: 15930 diff changeset	253 ## print found, '-->', subst
1881b968989b Hand repair of cases where reindent changed lines of the form Tim Peters <tim.peters@gmail.com> parents: 15930 diff changeset	254 ## print 'Line:', line,
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	255 subst = found
15932 1881b968989b Hand repair of cases where reindent changed lines of the form Tim Peters <tim.peters@gmail.com> parents: 15930 diff changeset	256 ## else:
1881b968989b Hand repair of cases where reindent changed lines of the form Tim Peters <tim.peters@gmail.com> parents: 15930 diff changeset	257 ## print 'Substituting in comment:',
1881b968989b Hand repair of cases where reindent changed lines of the form Tim Peters <tim.peters@gmail.com> parents: 15930 diff changeset	258 ## print found, '-->', subst
1881b968989b Hand repair of cases where reindent changed lines of the form Tim Peters <tim.peters@gmail.com> parents: 15930 diff changeset	259 ## print 'Line:', line,
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	260 line = line[:i] + subst + line[i+n:]
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	261 n = len(subst)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	262 i = i + n
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	263 return line
1309 02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	264
1502 8965ef4eb399 Various changes, andded -c option Guido van Rossum <guido@python.org> parents: 1309 diff changeset	265 Docomments = 0
8965ef4eb399 Various changes, andded -c option Guido van Rossum <guido@python.org> parents: 1309 diff changeset	266 def setdocomments():
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	267 global Docomments
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	268 Docomments = 1
1502 8965ef4eb399 Various changes, andded -c option Guido van Rossum <guido@python.org> parents: 1309 diff changeset	269
1309 02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	270 Reverse = 0
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	271 def setreverse():
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	272 global Reverse
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	273 Reverse = (not Reverse)
1309 02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	274
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	275 Dict = {}
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	276 NotInComment = {}
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	277 def addsubst(substfile):
15930 14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	278 try:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	279 fp = open(substfile, 'r')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	280 except IOError, msg:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	281 err(substfile + ': cannot read substfile: ' + str(msg) + '\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	282 sys.exit(1)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	283 lineno = 0
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	284 while 1:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	285 line = fp.readline()
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	286 if not line: break
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	287 lineno = lineno + 1
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	288 try:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	289 i = string.index(line, '#')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	290 except string.index_error:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	291 i = -1 # Happens to delete trailing \n
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	292 words = string.split(line[:i])
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	293 if not words: continue
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	294 if len(words) == 3 and words[0] == 'struct':
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	295 words[:2] = [words[0] + ' ' + words[1]]
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	296 elif len(words) <> 2:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	297 err(substfile + ':' + `lineno` +
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	298 ': warning: bad line: ' + line)
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	299 continue
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	300 if Reverse:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	301 [value, key] = words
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	302 else:
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	303 [key, value] = words
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	304 if value[0] == '*':
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	305 value = value[1:]
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	306 if key[0] == '*':
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	307 key = key[1:]
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	308 NotInComment[key] = value
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	309 if Dict.has_key(key):
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	310 err(substfile + ':' + `lineno` +
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	311 ': warning: overriding: ' +
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	312 key + ' ' + value + '\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	313 err(substfile + ':' + `lineno` +
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	314 ': warning: previous: ' + Dict[key] + '\n')
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	315 Dict[key] = value
14a27acc755a Whitespace normalization. Tim Peters <tim.peters@gmail.com> parents: 5537 diff changeset	316 fp.close()
1309 02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	317
02c03afc513e Initial revision Guido van Rossum <guido@python.org> parents: diff changeset	318 main()

Mercurial > cpython-lru_cache-weakref

annotate Tools/scripts/fixcid.py @ 25838:8540887bcec6 2.2