User-agent: * Disallow: *.doc Disallow: *.txt Disallow: *.swp Disallow: /cgi-bin/ Disallow: /img/ Disallow: /css/