# HeadsUp robots.txt # Allow all search engines to crawl the site User-agent: * Allow: / # Sitemap locations # sitemap.xml is the index and covers all five children on its own. The children are # also declared directly, which is belt and braces: they were submitted individually # in Search Console back when sitemap.xml was a flat that listed them as # pages, and pulling them now would drop that submission history. # # sitemap-companies.xml (7,296 URLs) and sitemap-comparisons.xml were omitted until # 2026-08-23, so the largest slice of the corpus was undeclared. See # products/headsup/seo-assessment-2026-08-20.md defect #5. Sitemap: https://headsup.bot/sitemap.xml Sitemap: https://headsup.bot/sitemap-pages.xml Sitemap: https://headsup.bot/sitemap-changes.xml Sitemap: https://headsup.bot/sitemap-alerts.xml Sitemap: https://headsup.bot/sitemap-competitors.xml Sitemap: https://headsup.bot/sitemap-companies.xml Sitemap: https://headsup.bot/sitemap-comparisons.xml # Crawl delay (be nice to crawlers) Crawl-delay: 1