Mercurial > cpython-lru_cache-weakref
annotate Lib/urlparse.py @ 39042:c02fa187e0f4 legacy-trunk
Part of SF patch #1484695. This removes dead code. The chksum was
already verified in .frombuf() on the lines above. If there was
a problem an exception is raised, so there was no way this condition
could have been true.
| author | Neal Norwitz <nnorwitz@gmail.com> |
|---|---|
| date | Mon, 10 Jul 2006 00:23:17 +0000 |
| parents | a6bce7aebe05 |
| children | 6ae94a2ba5df |
| rev | line source |
|---|---|
|
11707
6f4146846337
The third and final doc-string sweep by Ka-Ping Yee.
Guido van Rossum <guido@python.org>
parents:
10830
diff
changeset
|
1 """Parse (absolute and relative) URLs. |
|
6f4146846337
The third and final doc-string sweep by Ka-Ping Yee.
Guido van Rossum <guido@python.org>
parents:
10830
diff
changeset
|
2 |
|
6f4146846337
The third and final doc-string sweep by Ka-Ping Yee.
Guido van Rossum <guido@python.org>
parents:
10830
diff
changeset
|
3 See RFC 1808: "Relative Uniform Resource Locators", by R. Fielding, |
|
6f4146846337
The third and final doc-string sweep by Ka-Ping Yee.
Guido van Rossum <guido@python.org>
parents:
10830
diff
changeset
|
4 UC Irvine, June 1995. |
|
6f4146846337
The third and final doc-string sweep by Ka-Ping Yee.
Guido van Rossum <guido@python.org>
parents:
10830
diff
changeset
|
5 """ |
|
1875
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
6 |
|
25814
b8cbdb735cf2
Added missing entries to __all__.
Fred Drake <fdrake@acm.org>
parents:
25787
diff
changeset
|
7 __all__ = ["urlparse", "urlunparse", "urljoin", "urldefrag", |
|
b8cbdb735cf2
Added missing entries to __all__.
Fred Drake <fdrake@acm.org>
parents:
25787
diff
changeset
|
8 "urlsplit", "urlunsplit"] |
|
16889
0feb63490093
final round of __all__ lists (I hope) - skipped urllib2 because Moshe may be
Skip Montanaro <skip@pobox.com>
parents:
15874
diff
changeset
|
9 |
|
1875
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
10 # A classification of schemes ('' means apply by default) |
| 32004 | 11 uses_relative = ['ftp', 'http', 'gopher', 'nntp', 'imap', |
|
36339
76aba3fa4e2f
Bug #1407902: Added support for sftp:// URIs to urlparse.
Georg Brandl <georg@python.org>
parents:
35289
diff
changeset
|
12 'wais', 'file', 'https', 'shttp', 'mms', |
|
76aba3fa4e2f
Bug #1407902: Added support for sftp:// URIs to urlparse.
Georg Brandl <georg@python.org>
parents:
35289
diff
changeset
|
13 'prospero', 'rtsp', 'rtspu', '', 'sftp'] |
| 32004 | 14 uses_netloc = ['ftp', 'http', 'gopher', 'nntp', 'telnet', |
|
36339
76aba3fa4e2f
Bug #1407902: Added support for sftp:// URIs to urlparse.
Georg Brandl <georg@python.org>
parents:
35289
diff
changeset
|
15 'imap', 'wais', 'file', 'mms', 'https', 'shttp', |
|
76aba3fa4e2f
Bug #1407902: Added support for sftp:// URIs to urlparse.
Georg Brandl <georg@python.org>
parents:
35289
diff
changeset
|
16 'snews', 'prospero', 'rtsp', 'rtspu', 'rsync', '', |
|
76aba3fa4e2f
Bug #1407902: Added support for sftp:// URIs to urlparse.
Georg Brandl <georg@python.org>
parents:
35289
diff
changeset
|
17 'svn', 'svn+ssh', 'sftp'] |
| 32004 | 18 non_hierarchical = ['gopher', 'hdl', 'mailto', 'news', |
|
37368
05914e8ded73
add support for the sips: scheme (identical to sip: except for scheme name)
Fred Drake <fdrake@acm.org>
parents:
36339
diff
changeset
|
19 'telnet', 'wais', 'imap', 'snews', 'sip', 'sips'] |
| 32004 | 20 uses_params = ['ftp', 'hdl', 'prospero', 'http', 'imap', |
|
37368
05914e8ded73
add support for the sips: scheme (identical to sip: except for scheme name)
Fred Drake <fdrake@acm.org>
parents:
36339
diff
changeset
|
21 'https', 'shttp', 'rtsp', 'rtspu', 'sip', 'sips', |
|
36339
76aba3fa4e2f
Bug #1407902: Added support for sftp:// URIs to urlparse.
Georg Brandl <georg@python.org>
parents:
35289
diff
changeset
|
22 'mms', '', 'sftp'] |
| 32004 | 23 uses_query = ['http', 'wais', 'imap', 'https', 'shttp', 'mms', |
|
37368
05914e8ded73
add support for the sips: scheme (identical to sip: except for scheme name)
Fred Drake <fdrake@acm.org>
parents:
36339
diff
changeset
|
24 'gopher', 'rtsp', 'rtspu', 'sip', 'sips', ''] |
| 32004 | 25 uses_fragment = ['ftp', 'hdl', 'http', 'gopher', 'news', |
|
36339
76aba3fa4e2f
Bug #1407902: Added support for sftp:// URIs to urlparse.
Georg Brandl <georg@python.org>
parents:
35289
diff
changeset
|
26 'nntp', 'wais', 'https', 'shttp', 'snews', |
|
76aba3fa4e2f
Bug #1407902: Added support for sftp:// URIs to urlparse.
Georg Brandl <georg@python.org>
parents:
35289
diff
changeset
|
27 'file', 'prospero', ''] |
|
1875
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
28 |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
29 # Characters valid in scheme names |
|
15623
db69c092c906
Be explicit about scheme_chars -- string.letters is locale dependent
Guido van Rossum <guido@python.org>
parents:
12967
diff
changeset
|
30 scheme_chars = ('abcdefghijklmnopqrstuvwxyz' |
|
db69c092c906
Be explicit about scheme_chars -- string.letters is locale dependent
Guido van Rossum <guido@python.org>
parents:
12967
diff
changeset
|
31 'ABCDEFGHIJKLMNOPQRSTUVWXYZ' |
|
db69c092c906
Be explicit about scheme_chars -- string.letters is locale dependent
Guido van Rossum <guido@python.org>
parents:
12967
diff
changeset
|
32 '0123456789' |
|
db69c092c906
Be explicit about scheme_chars -- string.letters is locale dependent
Guido van Rossum <guido@python.org>
parents:
12967
diff
changeset
|
33 '+-.') |
|
1875
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
34 |
|
5785
b247297be9a0
After some discussion with Jeremy and Fred, decided to limit the
Guido van Rossum <guido@python.org>
parents:
5776
diff
changeset
|
35 MAX_CACHE_SIZE = 20 |
|
3652
728a39a3e0d5
optimizations due to Fred Drake; added urldefrag() function
Guido van Rossum <guido@python.org>
parents:
3641
diff
changeset
|
36 _parse_cache = {} |
|
728a39a3e0d5
optimizations due to Fred Drake; added urldefrag() function
Guido van Rossum <guido@python.org>
parents:
3641
diff
changeset
|
37 |
|
728a39a3e0d5
optimizations due to Fred Drake; added urldefrag() function
Guido van Rossum <guido@python.org>
parents:
3641
diff
changeset
|
38 def clear_cache(): |
|
15874
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
39 """Clear the parse cache.""" |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
40 global _parse_cache |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
41 _parse_cache = {} |
|
3652
728a39a3e0d5
optimizations due to Fred Drake; added urldefrag() function
Guido van Rossum <guido@python.org>
parents:
3641
diff
changeset
|
42 |
|
728a39a3e0d5
optimizations due to Fred Drake; added urldefrag() function
Guido van Rossum <guido@python.org>
parents:
3641
diff
changeset
|
43 |
|
37393
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
44 class BaseResult(tuple): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
45 """Base class for the parsed result objects. |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
46 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
47 This provides the attributes shared by the two derived result |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
48 objects as read-only properties. The derived classes are |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
49 responsible for checking the right number of arguments were |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
50 supplied to the constructor. |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
51 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
52 """ |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
53 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
54 __slots__ = () |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
55 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
56 # Attributes that access the basic components of the URL: |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
57 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
58 @property |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
59 def scheme(self): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
60 return self[0] |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
61 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
62 @property |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
63 def netloc(self): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
64 return self[1] |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
65 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
66 @property |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
67 def path(self): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
68 return self[2] |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
69 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
70 @property |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
71 def query(self): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
72 return self[-2] |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
73 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
74 @property |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
75 def fragment(self): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
76 return self[-1] |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
77 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
78 # Additional attributes that provide access to parsed-out portions |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
79 # of the netloc: |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
80 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
81 @property |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
82 def username(self): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
83 netloc = self.netloc |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
84 if "@" in netloc: |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
85 userinfo = netloc.split("@", 1)[0] |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
86 if ":" in userinfo: |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
87 userinfo = userinfo.split(":", 1)[0] |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
88 return userinfo |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
89 return None |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
90 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
91 @property |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
92 def password(self): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
93 netloc = self.netloc |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
94 if "@" in netloc: |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
95 userinfo = netloc.split("@", 1)[0] |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
96 if ":" in userinfo: |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
97 return userinfo.split(":", 1)[1] |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
98 return None |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
99 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
100 @property |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
101 def hostname(self): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
102 netloc = self.netloc |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
103 if "@" in netloc: |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
104 netloc = netloc.split("@", 1)[1] |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
105 if ":" in netloc: |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
106 netloc = netloc.split(":", 1)[0] |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
107 return netloc.lower() or None |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
108 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
109 @property |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
110 def port(self): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
111 netloc = self.netloc |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
112 if "@" in netloc: |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
113 netloc = netloc.split("@", 1)[1] |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
114 if ":" in netloc: |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
115 port = netloc.split(":", 1)[1] |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
116 return int(port, 10) |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
117 return None |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
118 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
119 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
120 class SplitResult(BaseResult): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
121 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
122 __slots__ = () |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
123 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
124 def __new__(cls, scheme, netloc, path, query, fragment): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
125 return BaseResult.__new__( |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
126 cls, (scheme, netloc, path, query, fragment)) |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
127 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
128 def geturl(self): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
129 return urlunsplit(self) |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
130 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
131 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
132 class ParseResult(BaseResult): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
133 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
134 __slots__ = () |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
135 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
136 def __new__(cls, scheme, netloc, path, params, query, fragment): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
137 return BaseResult.__new__( |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
138 cls, (scheme, netloc, path, params, query, fragment)) |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
139 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
140 @property |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
141 def params(self): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
142 return self[3] |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
143 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
144 def geturl(self): |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
145 return urlunparse(self) |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
146 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
147 |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
148 def urlparse(url, scheme='', allow_fragments=True): |
|
15874
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
149 """Parse a URL into 6 components: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
150 <scheme>://<netloc>/<path>;<params>?<query>#<fragment> |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
151 Return a 6-tuple: (scheme, netloc, path, params, query, fragment). |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
152 Note that we don't break the components up in smaller bits |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
153 (e.g. netloc is a single string) and we don't expand % escapes.""" |
|
20995
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
154 tuple = urlsplit(url, scheme, allow_fragments) |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
155 scheme, netloc, url, query, fragment = tuple |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
156 if scheme in uses_params and ';' in url: |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
157 url, params = _splitparams(url) |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
158 else: |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
159 params = '' |
|
37393
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
160 return ParseResult(scheme, netloc, url, params, query, fragment) |
|
20995
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
161 |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
162 def _splitparams(url): |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
163 if '/' in url: |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
164 i = url.find(';', url.rfind('/')) |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
165 if i < 0: |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
166 return url, '' |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
167 else: |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
168 i = url.find(';') |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
169 return url[:i], url[i+1:] |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
170 |
|
34378
a0bc4419663c
Patch #712317: In URLs such as http://www.example.com?query=spam, treat '?' as
Johannes Gijsbers <jlg@dds.nl>
parents:
34293
diff
changeset
|
171 def _splitnetloc(url, start=0): |
|
a0bc4419663c
Patch #712317: In URLs such as http://www.example.com?query=spam, treat '?' as
Johannes Gijsbers <jlg@dds.nl>
parents:
34293
diff
changeset
|
172 for c in '/?#': # the order is important! |
|
a0bc4419663c
Patch #712317: In URLs such as http://www.example.com?query=spam, treat '?' as
Johannes Gijsbers <jlg@dds.nl>
parents:
34293
diff
changeset
|
173 delim = url.find(c, start) |
|
a0bc4419663c
Patch #712317: In URLs such as http://www.example.com?query=spam, treat '?' as
Johannes Gijsbers <jlg@dds.nl>
parents:
34293
diff
changeset
|
174 if delim >= 0: |
|
a0bc4419663c
Patch #712317: In URLs such as http://www.example.com?query=spam, treat '?' as
Johannes Gijsbers <jlg@dds.nl>
parents:
34293
diff
changeset
|
175 break |
|
a0bc4419663c
Patch #712317: In URLs such as http://www.example.com?query=spam, treat '?' as
Johannes Gijsbers <jlg@dds.nl>
parents:
34293
diff
changeset
|
176 else: |
|
a0bc4419663c
Patch #712317: In URLs such as http://www.example.com?query=spam, treat '?' as
Johannes Gijsbers <jlg@dds.nl>
parents:
34293
diff
changeset
|
177 delim = len(url) |
|
a0bc4419663c
Patch #712317: In URLs such as http://www.example.com?query=spam, treat '?' as
Johannes Gijsbers <jlg@dds.nl>
parents:
34293
diff
changeset
|
178 return url[start:delim], url[delim:] |
|
a0bc4419663c
Patch #712317: In URLs such as http://www.example.com?query=spam, treat '?' as
Johannes Gijsbers <jlg@dds.nl>
parents:
34293
diff
changeset
|
179 |
|
37393
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
180 def urlsplit(url, scheme='', allow_fragments=True): |
|
20995
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
181 """Parse a URL into 5 components: |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
182 <scheme>://<netloc>/<path>?<query>#<fragment> |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
183 Return a 5-tuple: (scheme, netloc, path, query, fragment). |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
184 Note that we don't break the components up in smaller bits |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
185 (e.g. netloc is a single string) and we don't expand % escapes.""" |
|
37393
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
186 allow_fragments = bool(allow_fragments) |
|
15874
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
187 key = url, scheme, allow_fragments |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
188 cached = _parse_cache.get(key, None) |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
189 if cached: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
190 return cached |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
191 if len(_parse_cache) >= MAX_CACHE_SIZE: # avoid runaway growth |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
192 clear_cache() |
|
20995
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
193 netloc = query = fragment = '' |
|
15874
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
194 i = url.find(':') |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
195 if i > 0: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
196 if url[:i] == 'http': # optimize the common case |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
197 scheme = url[:i].lower() |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
198 url = url[i+1:] |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
199 if url[:2] == '//': |
|
34378
a0bc4419663c
Patch #712317: In URLs such as http://www.example.com?query=spam, treat '?' as
Johannes Gijsbers <jlg@dds.nl>
parents:
34293
diff
changeset
|
200 netloc, url = _splitnetloc(url, 2) |
|
20995
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
201 if allow_fragments and '#' in url: |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
202 url, fragment = url.split('#', 1) |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
203 if '?' in url: |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
204 url, query = url.split('?', 1) |
|
37393
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
205 v = SplitResult(scheme, netloc, url, query, fragment) |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
206 _parse_cache[key] = v |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
207 return v |
|
15874
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
208 for c in url[:i]: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
209 if c not in scheme_chars: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
210 break |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
211 else: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
212 scheme, url = url[:i].lower(), url[i+1:] |
|
34378
a0bc4419663c
Patch #712317: In URLs such as http://www.example.com?query=spam, treat '?' as
Johannes Gijsbers <jlg@dds.nl>
parents:
34293
diff
changeset
|
213 if scheme in uses_netloc and url[:2] == '//': |
|
a0bc4419663c
Patch #712317: In URLs such as http://www.example.com?query=spam, treat '?' as
Johannes Gijsbers <jlg@dds.nl>
parents:
34293
diff
changeset
|
214 netloc, url = _splitnetloc(url, 2) |
|
20995
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
215 if allow_fragments and scheme in uses_fragment and '#' in url: |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
216 url, fragment = url.split('#', 1) |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
217 if scheme in uses_query and '?' in url: |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
218 url, query = url.split('?', 1) |
|
37393
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
219 v = SplitResult(scheme, netloc, url, query, fragment) |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
220 _parse_cache[key] = v |
|
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
221 return v |
|
1875
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
222 |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
223 def urlunparse((scheme, netloc, url, params, query, fragment)): |
|
15874
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
224 """Put a parsed URL back together again. This may result in a |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
225 slightly different, but equivalent URL, if the URL that was parsed |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
226 originally had redundant delimiters, e.g. a ? with an empty query |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
227 (the draft states that these are equivalent).""" |
|
20995
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
228 if params: |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
229 url = "%s;%s" % (url, params) |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
230 return urlunsplit((scheme, netloc, url, query, fragment)) |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
231 |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
232 def urlunsplit((scheme, netloc, url, query, fragment)): |
|
25787
bf384111b3b3
Backporting urlparse.py:1.34, test_urlparse.py:1.8:
Guido van Rossum <guido@python.org>
parents:
25425
diff
changeset
|
233 if netloc or (scheme and scheme in uses_netloc and url[:2] != '//'): |
|
15874
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
234 if url and url[:1] != '/': url = '/' + url |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
235 url = '//' + (netloc or '') + url |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
236 if scheme: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
237 url = scheme + ':' + url |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
238 if query: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
239 url = url + '?' + query |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
240 if fragment: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
241 url = url + '#' + fragment |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
242 return url |
|
1875
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
243 |
|
37393
a6bce7aebe05
Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results
Fred Drake <fdrake@acm.org>
parents:
37368
diff
changeset
|
244 def urljoin(base, url, allow_fragments=True): |
|
15874
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
245 """Join a base URL and a possibly relative URL to form an absolute |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
246 interpretation of the latter.""" |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
247 if not base: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
248 return url |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
249 if not url: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
250 return base |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
251 bscheme, bnetloc, bpath, bparams, bquery, bfragment = \ |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
252 urlparse(base, '', allow_fragments) |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
253 scheme, netloc, path, params, query, fragment = \ |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
254 urlparse(url, bscheme, allow_fragments) |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
255 if scheme != bscheme or scheme not in uses_relative: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
256 return url |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
257 if scheme in uses_netloc: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
258 if netloc: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
259 return urlunparse((scheme, netloc, path, |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
260 params, query, fragment)) |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
261 netloc = bnetloc |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
262 if path[:1] == '/': |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
263 return urlunparse((scheme, netloc, path, |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
264 params, query, fragment)) |
|
30675
fce80ad83477
See rev. 1.42 for log message
Brett Cannon <bcannon@gmail.com>
parents:
28449
diff
changeset
|
265 if not (path or params or query): |
|
15874
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
266 return urlunparse((scheme, netloc, bpath, |
|
30675
fce80ad83477
See rev. 1.42 for log message
Brett Cannon <bcannon@gmail.com>
parents:
28449
diff
changeset
|
267 bparams, bquery, fragment)) |
|
15874
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
268 segments = bpath.split('/')[:-1] + path.split('/') |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
269 # XXX The stuff below is bogus in various ways... |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
270 if segments[-1] == '.': |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
271 segments[-1] = '' |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
272 while '.' in segments: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
273 segments.remove('.') |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
274 while 1: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
275 i = 1 |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
276 n = len(segments) - 1 |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
277 while i < n: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
278 if (segments[i] == '..' |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
279 and segments[i-1] not in ('', '..')): |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
280 del segments[i-1:i+1] |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
281 break |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
282 i = i+1 |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
283 else: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
284 break |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
285 if segments == ['', '..']: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
286 segments[-1] = '' |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
287 elif len(segments) >= 2 and segments[-1] == '..': |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
288 segments[-2:] = [''] |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
289 return urlunparse((scheme, netloc, '/'.join(segments), |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
290 params, query, fragment)) |
|
1875
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
291 |
|
3652
728a39a3e0d5
optimizations due to Fred Drake; added urldefrag() function
Guido van Rossum <guido@python.org>
parents:
3641
diff
changeset
|
292 def urldefrag(url): |
|
15874
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
293 """Removes any existing fragment from URL. |
|
3652
728a39a3e0d5
optimizations due to Fred Drake; added urldefrag() function
Guido van Rossum <guido@python.org>
parents:
3641
diff
changeset
|
294 |
|
15874
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
295 Returns a tuple of the defragmented URL and the fragment. If |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
296 the URL contained no fragments, the second element is the |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
297 empty string. |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
298 """ |
|
20995
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
299 if '#' in url: |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
300 s, n, p, a, q, frag = urlparse(url) |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
301 defrag = urlunparse((s, n, p, a, q, '')) |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
302 return defrag, frag |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
303 else: |
|
174ccb035b3d
Fix parsing of parameters from a URL; urlparse() did not check that it only
Fred Drake <fdrake@acm.org>
parents:
19209
diff
changeset
|
304 return url, '' |
|
3652
728a39a3e0d5
optimizations due to Fred Drake; added urldefrag() function
Guido van Rossum <guido@python.org>
parents:
3641
diff
changeset
|
305 |
|
728a39a3e0d5
optimizations due to Fred Drake; added urldefrag() function
Guido van Rossum <guido@python.org>
parents:
3641
diff
changeset
|
306 |
|
1875
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
307 test_input = """ |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
308 http://a/b/c/d |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
309 |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
310 g:h = <URL:g:h> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
311 http:g = <URL:http://a/b/c/g> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
312 http: = <URL:http://a/b/c/d> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
313 g = <URL:http://a/b/c/g> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
314 ./g = <URL:http://a/b/c/g> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
315 g/ = <URL:http://a/b/c/g/> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
316 /g = <URL:http://a/g> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
317 //g = <URL:http://g> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
318 ?y = <URL:http://a/b/c/d?y> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
319 g?y = <URL:http://a/b/c/g?y> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
320 g?y/./x = <URL:http://a/b/c/g?y/./x> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
321 . = <URL:http://a/b/c/> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
322 ./ = <URL:http://a/b/c/> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
323 .. = <URL:http://a/b/> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
324 ../ = <URL:http://a/b/> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
325 ../g = <URL:http://a/b/g> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
326 ../.. = <URL:http://a/> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
327 ../../g = <URL:http://a/g> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
328 ../../../g = <URL:http://a/../g> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
329 ./../g = <URL:http://a/b/g> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
330 ./g/. = <URL:http://a/b/c/g/> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
331 /./g = <URL:http://a/./g> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
332 g/./h = <URL:http://a/b/c/g/h> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
333 g/../h = <URL:http://a/b/c/h> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
334 http:g = <URL:http://a/b/c/g> |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
335 http: = <URL:http://a/b/c/d> |
|
9793
737d05a9bb5e
Fixed bug in the common-case code for HTTP URLs; it would lose the query,
Andrew M. Kuchling <amk@amk.ca>
parents:
9665
diff
changeset
|
336 http:?y = <URL:http://a/b/c/d?y> |
|
737d05a9bb5e
Fixed bug in the common-case code for HTTP URLs; it would lose the query,
Andrew M. Kuchling <amk@amk.ca>
parents:
9665
diff
changeset
|
337 http:g?y = <URL:http://a/b/c/g?y> |
|
737d05a9bb5e
Fixed bug in the common-case code for HTTP URLs; it would lose the query,
Andrew M. Kuchling <amk@amk.ca>
parents:
9665
diff
changeset
|
338 http:g?y/./x = <URL:http://a/b/c/g?y/./x> |
|
1875
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
339 """ |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
340 |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
341 def test(): |
|
15874
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
342 import sys |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
343 base = '' |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
344 if sys.argv[1:]: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
345 fn = sys.argv[1] |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
346 if fn == '-': |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
347 fp = sys.stdin |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
348 else: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
349 fp = open(fn) |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
350 else: |
|
34293
cd517701fd93
Use cStringIO where available.
Raymond Hettinger <python@rcn.com>
parents:
32435
diff
changeset
|
351 try: |
|
cd517701fd93
Use cStringIO where available.
Raymond Hettinger <python@rcn.com>
parents:
32435
diff
changeset
|
352 from cStringIO import StringIO |
|
cd517701fd93
Use cStringIO where available.
Raymond Hettinger <python@rcn.com>
parents:
32435
diff
changeset
|
353 except ImportError: |
|
cd517701fd93
Use cStringIO where available.
Raymond Hettinger <python@rcn.com>
parents:
32435
diff
changeset
|
354 from StringIO import StringIO |
|
cd517701fd93
Use cStringIO where available.
Raymond Hettinger <python@rcn.com>
parents:
32435
diff
changeset
|
355 fp = StringIO(test_input) |
|
15874
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
356 while 1: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
357 line = fp.readline() |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
358 if not line: break |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
359 words = line.split() |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
360 if not words: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
361 continue |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
362 url = words[0] |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
363 parts = urlparse(url) |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
364 print '%-10s : %s' % (url, parts) |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
365 abs = urljoin(base, url) |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
366 if not base: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
367 base = abs |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
368 wrapped = '<URL:%s>' % abs |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
369 print '%-10s = %s' % (url, wrapped) |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
370 if len(words) == 3 and words[1] == '=': |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
371 if wrapped != words[2]: |
|
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
372 print 'EXPECTED', words[2], '!!!!!!!!!!' |
|
1875
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
373 |
|
8c9cc054c5ed
New tty/pty modules by Steen; new urlparser.
Guido van Rossum <guido@python.org>
parents:
diff
changeset
|
374 if __name__ == '__main__': |
|
15874
4c01ee0a8073
Whitespace normalization. Top level of Lib now fixed-point for reindent.py!
Tim Peters <tim.peters@gmail.com>
parents:
15741
diff
changeset
|
375 test() |
