# ── BOOYAH! — robots.txt ───────────────────────────────────────────────── # Policy: every crawler — search engines, AI assistants, and social-card # unfurlers — may read the entire public site, including llms.txt and # llms-full.txt. Only API routes and the private client dashboard are blocked. # (Booyah's whole job is AI visibility, so AI crawlers are explicitly welcome.) User-agent: * Allow: / Disallow: /api/ Disallow: /dashboard/ # junk / probe paths (don't exist here) Disallow: /wp-admin/ Disallow: /wp-login.php Disallow: /*.php$ Disallow: /*.env$ # ── AI training & answer engines — explicitly welcomed ─────────────────── # robots.txt groups don't cascade from "*", so these are listed and given the # same full access (incl. the LLM files), inheriting only the api/dashboard block. # OpenAI/ChatGPT · Anthropic/Claude · Perplexity · Google Gemini · Apple # Intelligence · Microsoft/Amazon · Meta AI · DuckDuckGo · Common Crawl · ByteDance User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: anthropic-ai User-agent: Claude-User User-agent: Claude-SearchBot User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Amazonbot User-agent: meta-externalagent User-agent: DuckAssistBot User-agent: CCBot User-agent: Bytespider Allow: / Disallow: /api/ Disallow: /dashboard/ Sitemap: https://getbooyah.com/sitemap-index.xml