Mercurial > cpython-lru_cache-weakref
diff Doc/lib/librobotparser.tex @ 18574:346dcafc878b legacy-trunk
Minor changes to match the style guide.
| author | Fred Drake <fdrake@acm.org> |
|---|---|
| date | Sat, 14 Jul 2001 02:50:55 +0000 |
| parents | c2bb5e4b04a8 |
| children | 316fffd80b16 |
line wrap: on
line diff
--- a/Doc/lib/librobotparser.tex Sat Jul 14 02:46:01 2001 +0000 +++ b/Doc/lib/librobotparser.tex Sat Jul 14 02:50:55 2001 +0000 @@ -9,13 +9,13 @@ \sectionauthor{Skip Montanaro}{skip@mojam.com} \index{WWW} -\index{World-Wide Web} +\index{World Wide Web} \index{URL} \index{robots.txt} This module provides a single class, \class{RobotFileParser}, which answers questions about whether or not a particular user agent can fetch a URL on -the web site that published the \file{robots.txt} file. For more details on +the Web site that published the \file{robots.txt} file. For more details on the structure of \file{robots.txt} files, see \url{http://info.webcrawler.com/mak/projects/robots/norobots.html}.
