# robots.txt for all new CMS sites User-agent: * Disallow: /bookies/ # don't crawl bookie redirect links