Changeset 4307


Ignore:
Timestamp:
Jan 29, 2010, 11:18:58 PM (8 years ago)
Author:
Sam Hocevar
Message:

Tell search engine bots not to crawl our git mirrors.

File:
1 edited

Legend:

Unmodified
Added
Removed
  • web/trunk/www/robots.txt

    r4083 r4307  
    99Disallow: /cgi-bin/trac.cgi
    1010Disallow: /log
     11
     12# Don’t crawl git repos
     13Disallow: /git/*.git/*
     14Disallow: /git/*.git.broken/*
    1115
    1216# "This robot collects content from the Internet for the sole purpose of
Note: See TracChangeset for help on using the changeset viewer.