# Robots.txt for HeyKeyword User-agent: * Allow: / # Block private/authenticated areas — these are SPA routes but listed for clarity Disallow: /dashboard Disallow: /dashboard/ Disallow: /auth # AI/LLM crawlers User-agent: GPTBot Allow: / User-agent: Google-Extended Allow: / User-agent: CCBot Allow: / User-agent: anthropic-ai Allow: / User-agent: ClaudeBot Allow: / Sitemap: https://heykeyword.com/sitemap.xml