# robots.txt ... used to give directions to search engines and crawlers # - Allow all types of crawler # - don't tell code of bugtrack # - don't tell other code files User-agent: * Disallow: /~* Disallow: *.inc Disallow: guestbook2.php User-agent: Fasterfox Disallow: /