User-agent: crawl Disallow: / User-agent: WISENutbot Disallow: / # Allow only specific directories User-agent: Teoma Disallow: / User-agent: * Disallow: /gallery Disallow: /tgfxr User-agent: Yahoo-MMCrawler Disallow: /gallery User-agent: msnbot Disallow: /gallery