User-agent: * ## robot.txt file for http://www.yourhost.com/ Disallow: /admin Disallow: /bh-email-templates Disallow: /bluehornetpartner Disallow: /bwcalcpub Disallow: /bwcalc Disallow: /ccs Disallow: /css Disallow: /cgi-bin Disallow: /clients Disallow: /credit Disallow: /data Disallow: /devsupport Disallow: /dir Disallow: /ebay Disallow: /errorpages Disallow: /faq-temp Disallow: /faq.pending-deletion Disallow: /faqtest Disallow: /forms Disallow: /globalincludes2 Disallow: /games1 Disallow: /goto Disallow: /header Disallow: /images-newsite Disallow: /images Disallow: /inc Disallow: /inc2 Disallow: /includes Disallow: /includes-php Disallow: /javascripts Disallow: /libs Disallow: /links Disallow: /matt Disallow: /media Disallow: /mtc Disallow: /myadmin Disallow: /payment Disallow: /phpsitemapng Disallow: /refuge Disallow: /refugemens Disallow: /reports Disallow: /sales Disallow: /split_test Disallow: /samplet Disallow: /status Disallow: /test Disallow: /webcam Disallow: /whois Disallow: /yourhost-dev Disallow: /index2.html Disallow: /phpscanout.txt Disallow: /yhdirectory.php Disallow: /header_door.htm Disallow: /news1.htm Disallow: /postinfo.htm Disallow: /webmarketing/ Disallow: */_vti_cnf Disallow: *WS_FTP.LOG