# Exclude Files From All Robots: User-agent: * Disallow: /images Disallow: /private Disallow: /cgi-bin Disallow: /tmp Disallow: /mail/ Disallow: /etc/ Disallow: /access-logs/ # End robots.txt file