User-agent: * Disallow: /cgi-bin/ Disallow: /main.html # prevents opening home page w/o directory Disallow: /_private/ Disallow: /mtemp/