source:
ruby/branches/0.5/public/robots.txt@
241
| Last change on this file since 241 was 164, checked in by , 15 years ago | |
|---|---|
| File size: 204 bytes | |
| Line | |
|---|---|
| 1 | # See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file |
| 2 | # |
| 3 | # To ban all spiders from the entire site uncomment the next two lines: |
| 4 | # User-Agent: * |
| 5 | # Disallow: / |
Note:
See TracBrowser
for help on using the repository browser.
