# Robots.txt file from # All robots will spider the domain User-agent: * Disallow: /adpic/ Disallow: /bbs/Dataxttvv/ Disallow: /cert/ Disallow: /cityadmin/ Disallow: /images/ Disallow: /inc/ Disallow: /js/ Disallow: /urlt/ Disallow: /zn_message.asp Disallow: /user_left.asp Disallow: /topdh.asp User-agent: Crawler Disallow: