# /robots.txt file # "allow" is not formally recognized, except by google User-agent: * Disallow: /cgi-bin/ Allow: / Disallow: /blogalizer/ Disallow: /mt-comments.cgi