# TitansGo.net: robots.txt # # This file is used to let search engines correctly spider our website. # It does nothing else. # # Please do not edit this file if you do not understand the syntax. # User-agent: WebPix 1.0 (www.netwu.com) Disallow: User-agent: * Crawl-Delay: 20 Disallow: /cgi-bin/ Disallow: /mumbo/ Disallow: /theme_red/ Disallow: /theme_tan/ Disallow: /theme_teal/ Disallow: /updateicons/