# default record User-agent: * Disallow: /tmp/ # fast User-agent: Fast-WebCrawler Disallow: /tmp/ Disallow: /td/ Disallow: /tele