# Aggregation / archival / training-only crawlers: blocked.
# They ingest content for bulk datasets or model training and send no
# user-facing search or citation traffic. Search and answer-engine crawlers
# (Googlebot, Bingbot, GPTBot, OAI-SearchBot, ChatGPT-User, PerplexityBot,
# ClaudeBot, Amazonbot, Applebot, DuckDuckBot) and social link unfurlers stay
# fully allowed via the wildcard group at the bottom.
# GPTBot is intentionally allowed: it feeds ChatGPT's crawl/citation surface,
# and that GEO reach is worth more here than opting out of model training.
# Google-Extended is intentionally allowed for the same reason: it governs
# whether Gemini can ground answers in and cite this site, and that citation
# reach is worth more here than opting out of Google's model training.

User-agent: CCBot
Disallow: /

User-agent: anthropic-ai
Disallow: /

User-agent: Applebot-Extended
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: Diffbot
Disallow: /

User-agent: cohere-ai
Disallow: /

User-agent: Meta-ExternalAgent
Disallow: /

User-agent: YouBot
Disallow: /

User-agent: archive.org_bot
Disallow: /

User-agent: ia_archiver
Disallow: /

User-agent: Reflectionbot
Disallow: /

User-agent: *
Allow: /

Sitemap: https://www.footage.cool/sitemap.xml