User-agent: * # directed to all spiders Allow: Index.* Disallow: /cgi-bin/ Disallow: /HGex/ Disallow: *.txt Disallow: *.grf Disallow: *.hld Disallow: *.inp Disallow: *.lst Disallow: *.log Disallow: *.pm Disallow: temp.htm Disallow: /Images/ Disallow: /images/ Disallow: /Records/ Disallow: /forms/ Disallow: /Logs/ Disallow: /Upload/ Disallow: /Download/ Disallow: /TempFiles/ Disallow: /Test/ Disallow: /Bookmarks/ Disallow: /Clients/ Disallow: /Closed/ Disallow: /Donate/ Disallow: /News/ Disallow: /Examples Disallow: /Flash Disallow: /LiveChat