# say where the sitemap is Sitemap:sitemap_index.xml # Disallow all crawlers access to certain pages. User-agent: * Disallow: /x/ Disallow: /f/ Disallow: /l/