# Robots.txt to restrict crawling of the site User-agent: Fasterfox Disallow: / User-agent: Twiceler-0.9 Disallow: / User-agent: Gigabot/2.0att Disallow: / User-agent: Gigabot/3.0 Disallow: / User-agent: * Disallow: /admin/ Disallow: /backup/ Disallow: /config/ Disallow: /dealer/ Disallow: /dealer_update/ Disallow: /downloads/ Disallow: /includes/