# robots.txt file to exclude files from access by web robots User-agent: * Disallow: /contact.html Disallow: /logs/ Disallow: /test/ Disallow: /private/ Disallow: /public/ Disallow: /image/ Disallow: /images/