User-agent: MSIECrawler Disallow: / User-agent: * Disallow: /WEB-INF Disallow: /xml Disallow: /development Disallow: /tlds Disallow: /templates Disallow: /mailtemplate Disallow: /ksads Disallow: /jscript Disallow: /images Disallow: /shared Disallow: /ActivityServlet Disallow: /networkexposure Crawl-delay: 8 #User-agent: *