# Refugio San Bernardo — robots.txt
# Every crawler is welcome on the whole site, including AI assistants: being
# read and cited by ChatGPT, Perplexity, Copilot, Gemini & co REQUIRES not
# blocking their crawlers. Nothing here is disallowed.

User-agent: *
Allow: /

# AI / LLM crawlers — explicit opt-in. Redundant with the wildcard above, but a
# clear, future-proof signal that we WANT to be read and cited by generative
# engines (some day a stricter default could change; this states intent).
User-agent: GPTBot
User-agent: OAI-SearchBot
User-agent: ChatGPT-User
User-agent: ClaudeBot
User-agent: anthropic-ai
User-agent: Claude-Web
User-agent: PerplexityBot
User-agent: Perplexity-User
User-agent: Google-Extended
User-agent: Applebot-Extended
User-agent: CCBot
Allow: /

Sitemap: https://sanbernardorefugio.com/sitemap.xml