Mercurial > cpython-lru_cache-weakref

annotate Tools/scripts/ftpmirror.py @ 25838:8540887bcec6 2.2

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Backport of 2.183: Fix memory leak in add_subclass() found by NealN with valgrind.
author Guido van Rossum <guido@python.org>
date Fri, 18 Oct 2002 13:42:21 +0000
parents c4016abd6b7f
children 8a7a2f1f88f0
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
4573
73758db2f464 /usr/local/bin/python -> /usr/bin/env python
Guido van Rossum <guido@python.org>
parents: 4544
diff changeset
1 #! /usr/bin/env python
2761
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
2
7024
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
3 """Mirror a remote ftp subtree into a local directory tree.
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
4
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
5 usage: ftpmirror [-v] [-q] [-i] [-m] [-n] [-r] [-s pat]
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
6 [-l username [-p passwd [-a account]]]
15930
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
7 hostname [remotedir [localdir]]
7024
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
8 -v: verbose
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
9 -q: quiet
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
10 -i: interactive mode
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
11 -m: macintosh server (NCSA telnet 2.4) (implies -n -s '*.o')
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
12 -n: don't log in
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
13 -r: remove local files/directories no longer pertinent
18052
c4016abd6b7f Patch #430754: Makes ftpmirror.py .netrc aware
Martin v. Löwis <martin@v.loewis.de>
parents: 15930
diff changeset
14 -l username [-p passwd [-a account]]: login info (default .netrc or anonymous)
7024
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
15 -s pat: skip files matching pattern
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
16 hostname: remote host
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
17 remotedir: remote directory (default initial)
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
18 localdir: local directory (default current)
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
19 """
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
20
2761
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
21 import os
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
22 import sys
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
23 import time
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
24 import getopt
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
25 import string
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
26 import ftplib
18052
c4016abd6b7f Patch #430754: Makes ftpmirror.py .netrc aware
Martin v. Löwis <martin@v.loewis.de>
parents: 15930
diff changeset
27 import netrc
2761
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
28 from fnmatch import fnmatch
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
29
7024
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
30 # Print usage message and exit
2761
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
31 def usage(*args):
15930
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
32 sys.stdout = sys.stderr
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
33 for msg in args: print msg
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
34 print __doc__
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
35 sys.exit(2)
2761
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
36
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
37 verbose = 1 # 0 for -q, 2 for -v
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
38 interactive = 0
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
39 mac = 0
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
40 rmok = 0
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
41 nologin = 0
3374
0c8821bf6db5 don't die on unreadable files etc.
Guido van Rossum <guido@python.org>
parents: 2761
diff changeset
42 skippats = ['.', '..', '.mirrorinfo']
2761
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
43
7024
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
44 # Main program: parse command line and start processing
2761
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
45 def main():
15930
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
46 global verbose, interactive, mac, rmok, nologin
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
47 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
48 opts, args = getopt.getopt(sys.argv[1:], 'a:bil:mnp:qrs:v')
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
49 except getopt.error, msg:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
50 usage(msg)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
51 login = ''
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
52 passwd = ''
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
53 account = ''
18052
c4016abd6b7f Patch #430754: Makes ftpmirror.py .netrc aware
Martin v. Löwis <martin@v.loewis.de>
parents: 15930
diff changeset
54 if not args: usage('hostname missing')
c4016abd6b7f Patch #430754: Makes ftpmirror.py .netrc aware
Martin v. Löwis <martin@v.loewis.de>
parents: 15930
diff changeset
55 host = args[0]
c4016abd6b7f Patch #430754: Makes ftpmirror.py .netrc aware
Martin v. Löwis <martin@v.loewis.de>
parents: 15930
diff changeset
56 try:
c4016abd6b7f Patch #430754: Makes ftpmirror.py .netrc aware
Martin v. Löwis <martin@v.loewis.de>
parents: 15930
diff changeset
57 auth = netrc.netrc().authenticators(host)
c4016abd6b7f Patch #430754: Makes ftpmirror.py .netrc aware
Martin v. Löwis <martin@v.loewis.de>
parents: 15930
diff changeset
58 if auth is not None:
c4016abd6b7f Patch #430754: Makes ftpmirror.py .netrc aware
Martin v. Löwis <martin@v.loewis.de>
parents: 15930
diff changeset
59 login, account, passwd = auth
c4016abd6b7f Patch #430754: Makes ftpmirror.py .netrc aware
Martin v. Löwis <martin@v.loewis.de>
parents: 15930
diff changeset
60 except (netrc.NetrcParseError, IOError):
c4016abd6b7f Patch #430754: Makes ftpmirror.py .netrc aware
Martin v. Löwis <martin@v.loewis.de>
parents: 15930
diff changeset
61 pass
15930
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
62 for o, a in opts:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
63 if o == '-l': login = a
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
64 if o == '-p': passwd = a
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
65 if o == '-a': account = a
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
66 if o == '-v': verbose = verbose + 1
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
67 if o == '-q': verbose = 0
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
68 if o == '-i': interactive = 1
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
69 if o == '-m': mac = 1; nologin = 1; skippats.append('*.o')
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
70 if o == '-n': nologin = 1
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
71 if o == '-r': rmok = 1
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
72 if o == '-s': skippats.append(a)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
73 remotedir = ''
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
74 localdir = ''
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
75 if args[1:]:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
76 remotedir = args[1]
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
77 if args[2:]:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
78 localdir = args[2]
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
79 if args[3:]: usage('too many arguments')
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
80 #
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
81 f = ftplib.FTP()
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
82 if verbose: print 'Connecting to %s...' % `host`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
83 f.connect(host)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
84 if not nologin:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
85 if verbose:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
86 print 'Logging in as %s...' % `login or 'anonymous'`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
87 f.login(login, passwd, account)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
88 if verbose: print 'OK.'
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
89 pwd = f.pwd()
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
90 if verbose > 1: print 'PWD =', `pwd`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
91 if remotedir:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
92 if verbose > 1: print 'cwd(%s)' % `remotedir`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
93 f.cwd(remotedir)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
94 if verbose > 1: print 'OK.'
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
95 pwd = f.pwd()
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
96 if verbose > 1: print 'PWD =', `pwd`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
97 #
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
98 mirrorsubdir(f, localdir)
2761
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
99
7024
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
100 # Core logic: mirror one subdirectory (recursively)
2761
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
101 def mirrorsubdir(f, localdir):
15930
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
102 pwd = f.pwd()
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
103 if localdir and not os.path.isdir(localdir):
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
104 if verbose: print 'Creating local directory', `localdir`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
105 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
106 makedir(localdir)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
107 except os.error, msg:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
108 print "Failed to establish local directory", `localdir`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
109 return
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
110 infofilename = os.path.join(localdir, '.mirrorinfo')
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
111 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
112 text = open(infofilename, 'r').read()
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
113 except IOError, msg:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
114 text = '{}'
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
115 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
116 info = eval(text)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
117 except (SyntaxError, NameError):
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
118 print 'Bad mirror info in %s' % `infofilename`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
119 info = {}
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
120 subdirs = []
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
121 listing = []
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
122 if verbose: print 'Listing remote directory %s...' % `pwd`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
123 f.retrlines('LIST', listing.append)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
124 filesfound = []
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
125 for line in listing:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
126 if verbose > 1: print '-->', `line`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
127 if mac:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
128 # Mac listing has just filenames;
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
129 # trailing / means subdirectory
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
130 filename = string.strip(line)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
131 mode = '-'
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
132 if filename[-1:] == '/':
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
133 filename = filename[:-1]
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
134 mode = 'd'
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
135 infostuff = ''
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
136 else:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
137 # Parse, assuming a UNIX listing
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
138 words = string.split(line, None, 8)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
139 if len(words) < 6:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
140 if verbose > 1: print 'Skipping short line'
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
141 continue
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
142 filename = string.lstrip(words[-1])
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
143 i = string.find(filename, " -> ")
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
144 if i >= 0:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
145 # words[0] had better start with 'l'...
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
146 if verbose > 1:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
147 print 'Found symbolic link %s' % `filename`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
148 linkto = filename[i+4:]
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
149 filename = filename[:i]
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
150 infostuff = words[-5:-1]
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
151 mode = words[0]
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
152 skip = 0
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
153 for pat in skippats:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
154 if fnmatch(filename, pat):
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
155 if verbose > 1:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
156 print 'Skip pattern', `pat`,
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
157 print 'matches', `filename`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
158 skip = 1
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
159 break
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
160 if skip:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
161 continue
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
162 if mode[0] == 'd':
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
163 if verbose > 1:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
164 print 'Remembering subdirectory', `filename`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
165 subdirs.append(filename)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
166 continue
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
167 filesfound.append(filename)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
168 if info.has_key(filename) and info[filename] == infostuff:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
169 if verbose > 1:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
170 print 'Already have this version of',`filename`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
171 continue
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
172 fullname = os.path.join(localdir, filename)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
173 tempname = os.path.join(localdir, '@'+filename)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
174 if interactive:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
175 doit = askabout('file', filename, pwd)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
176 if not doit:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
177 if not info.has_key(filename):
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
178 info[filename] = 'Not retrieved'
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
179 continue
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
180 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
181 os.unlink(tempname)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
182 except os.error:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
183 pass
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
184 if mode[0] == 'l':
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
185 if verbose:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
186 print "Creating symlink %s -> %s" % (
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
187 `filename`, `linkto`)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
188 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
189 os.symlink(linkto, tempname)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
190 except IOError, msg:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
191 print "Can't create %s: %s" % (
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
192 `tempname`, str(msg))
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
193 continue
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
194 else:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
195 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
196 fp = open(tempname, 'wb')
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
197 except IOError, msg:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
198 print "Can't create %s: %s" % (
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
199 `tempname`, str(msg))
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
200 continue
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
201 if verbose:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
202 print 'Retrieving %s from %s as %s...' % \
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
203 (`filename`, `pwd`, `fullname`)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
204 if verbose:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
205 fp1 = LoggingFile(fp, 1024, sys.stdout)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
206 else:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
207 fp1 = fp
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
208 t0 = time.time()
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
209 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
210 f.retrbinary('RETR ' + filename,
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
211 fp1.write, 8*1024)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
212 except ftplib.error_perm, msg:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
213 print msg
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
214 t1 = time.time()
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
215 bytes = fp.tell()
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
216 fp.close()
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
217 if fp1 != fp:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
218 fp1.close()
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
219 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
220 os.unlink(fullname)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
221 except os.error:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
222 pass # Ignore the error
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
223 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
224 os.rename(tempname, fullname)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
225 except os.error, msg:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
226 print "Can't rename %s to %s: %s" % (`tempname`,
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
227 `fullname`,
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
228 str(msg))
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
229 continue
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
230 info[filename] = infostuff
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
231 writedict(info, infofilename)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
232 if verbose and mode[0] != 'l':
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
233 dt = t1 - t0
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
234 kbytes = bytes / 1024.0
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
235 print int(round(kbytes)),
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
236 print 'Kbytes in',
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
237 print int(round(dt)),
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
238 print 'seconds',
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
239 if t1 > t0:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
240 print '(~%d Kbytes/sec)' % \
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
241 int(round(kbytes/dt),)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
242 print
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
243 #
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
244 # Remove files from info that are no longer remote
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
245 deletions = 0
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
246 for filename in info.keys():
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
247 if filename not in filesfound:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
248 if verbose:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
249 print "Removing obsolete info entry for",
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
250 print `filename`, "in", `localdir or "."`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
251 del info[filename]
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
252 deletions = deletions + 1
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
253 if deletions:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
254 writedict(info, infofilename)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
255 #
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
256 # Remove local files that are no longer in the remote directory
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
257 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
258 if not localdir: names = os.listdir(os.curdir)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
259 else: names = os.listdir(localdir)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
260 except os.error:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
261 names = []
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
262 for name in names:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
263 if name[0] == '.' or info.has_key(name) or name in subdirs:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
264 continue
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
265 skip = 0
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
266 for pat in skippats:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
267 if fnmatch(name, pat):
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
268 if verbose > 1:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
269 print 'Skip pattern', `pat`,
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
270 print 'matches', `name`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
271 skip = 1
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
272 break
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
273 if skip:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
274 continue
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
275 fullname = os.path.join(localdir, name)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
276 if not rmok:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
277 if verbose:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
278 print 'Local file', `fullname`,
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
279 print 'is no longer pertinent'
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
280 continue
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
281 if verbose: print 'Removing local file/dir', `fullname`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
282 remove(fullname)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
283 #
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
284 # Recursively mirror subdirectories
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
285 for subdir in subdirs:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
286 if interactive:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
287 doit = askabout('subdirectory', subdir, pwd)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
288 if not doit: continue
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
289 if verbose: print 'Processing subdirectory', `subdir`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
290 localsubdir = os.path.join(localdir, subdir)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
291 pwd = f.pwd()
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
292 if verbose > 1:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
293 print 'Remote directory now:', `pwd`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
294 print 'Remote cwd', `subdir`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
295 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
296 f.cwd(subdir)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
297 except ftplib.error_perm, msg:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
298 print "Can't chdir to", `subdir`, ":", `msg`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
299 else:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
300 if verbose: print 'Mirroring as', `localsubdir`
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
301 mirrorsubdir(f, localsubdir)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
302 if verbose > 1: print 'Remote cwd ..'
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
303 f.cwd('..')
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
304 newpwd = f.pwd()
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
305 if newpwd != pwd:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
306 print 'Ended up in wrong directory after cd + cd ..'
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
307 print 'Giving up now.'
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
308 break
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
309 else:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
310 if verbose > 1: print 'OK.'
2761
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
311
7024
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
312 # Helper to remove a file or directory tree
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
313 def remove(fullname):
15930
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
314 if os.path.isdir(fullname) and not os.path.islink(fullname):
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
315 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
316 names = os.listdir(fullname)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
317 except os.error:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
318 names = []
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
319 ok = 1
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
320 for name in names:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
321 if not remove(os.path.join(fullname, name)):
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
322 ok = 0
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
323 if not ok:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
324 return 0
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
325 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
326 os.rmdir(fullname)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
327 except os.error, msg:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
328 print "Can't remove local directory %s: %s" % \
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
329 (`fullname`, str(msg))
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
330 return 0
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
331 else:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
332 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
333 os.unlink(fullname)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
334 except os.error, msg:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
335 print "Can't remove local file %s: %s" % \
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
336 (`fullname`, str(msg))
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
337 return 0
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
338 return 1
7024
e17fe79305c7 Dangerous feature added: when removing local files (i.e., only when -r
Guido van Rossum <guido@python.org>
parents: 5546
diff changeset
339
2761
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
340 # Wrapper around a file for writing to write a hash sign every block.
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
341 class LoggingFile:
15930
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
342 def __init__(self, fp, blocksize, outfp):
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
343 self.fp = fp
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
344 self.bytes = 0
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
345 self.hashes = 0
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
346 self.blocksize = blocksize
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
347 self.outfp = outfp
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
348 def write(self, data):
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
349 self.bytes = self.bytes + len(data)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
350 hashes = int(self.bytes) / self.blocksize
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
351 while hashes > self.hashes:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
352 self.outfp.write('#')
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
353 self.outfp.flush()
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
354 self.hashes = self.hashes + 1
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
355 self.fp.write(data)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
356 def close(self):
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
357 self.outfp.write('\n')
2761
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
358
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
359 # Ask permission to download a file.
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
360 def askabout(filetype, filename, pwd):
15930
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
361 prompt = 'Retrieve %s %s from %s ? [ny] ' % (filetype, filename, pwd)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
362 while 1:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
363 reply = string.lower(string.strip(raw_input(prompt)))
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
364 if reply in ['y', 'ye', 'yes']:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
365 return 1
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
366 if reply in ['', 'n', 'no', 'nop', 'nope']:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
367 return 0
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
368 print 'Please answer yes or no.'
2761
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
369
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
370 # Create a directory if it doesn't exist. Recursively create the
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
371 # parent directory as well if needed.
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
372 def makedir(pathname):
15930
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
373 if os.path.isdir(pathname):
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
374 return
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
375 dirname = os.path.dirname(pathname)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
376 if dirname: makedir(dirname)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
377 os.mkdir(pathname, 0777)
2761
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
378
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
379 # Write a dictionary to a file in a way that can be read back using
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
380 # rval() but is still somewhat readable (i.e. not a single long line).
8591
2f43b61a98df Fix by Sjoerd Mullender to support symbolic links and make a backup of
Guido van Rossum <guido@python.org>
parents: 8320
diff changeset
381 # Also creates a backup file.
2761
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
382 def writedict(dict, filename):
15930
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
383 dir, file = os.path.split(filename)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
384 tempname = os.path.join(dir, '@' + file)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
385 backup = os.path.join(dir, file + '~')
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
386 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
387 os.unlink(backup)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
388 except os.error:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
389 pass
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
390 fp = open(tempname, 'w')
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
391 fp.write('{\n')
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
392 for key, value in dict.items():
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
393 fp.write('%s: %s,\n' % (`key`, `value`))
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
394 fp.write('}\n')
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
395 fp.close()
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
396 try:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
397 os.rename(filename, backup)
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
398 except os.error:
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
399 pass
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
400 os.rename(tempname, filename)
2761
b40cabfdc91d added ftp mirror script
Guido van Rossum <guido@python.org>
parents:
diff changeset
401
14648
15cbe399a9c3 Allow this script to act like a module by only calling main() if
Barry Warsaw <barry@python.org>
parents: 8591
diff changeset
402
15cbe399a9c3 Allow this script to act like a module by only calling main() if
Barry Warsaw <barry@python.org>
parents: 8591
diff changeset
403 if __name__ == '__main__':
15930
14a27acc755a Whitespace normalization.
Tim Peters <tim.peters@gmail.com>
parents: 14648
diff changeset
404 main()