# Get Text Formula — robots.txt # Canonical host: https://gettextformula.com # Note: robots.txt is not a security mechanism. Private routes are also # protected by auth middleware (_authenticated layout) and server-side RLS. User-agent: * Allow: / # Auth, account, and private surfaces (also gated server-side) Disallow: /auth Disallow: /settings Disallow: /assets Disallow: /my-formulas Disallow: /my-voice Disallow: /library Disallow: /templates Disallow: /hook-lab Disallow: /admin Disallow: /admin/ # Per-user dynamic resources (auth-only; never indexable) Disallow: /a/ Disallow: /c/ # System / API Disallow: /api/ # Checkout flow (transactional, not indexable) Disallow: /checkout Disallow: /checkout/ # AI crawler policy: NOT YET DECIDED. # Default = permissive (allow training/search bots) so the public site is # discoverable in AI answers. To opt out of training crawlers, uncomment # the block below. # # User-agent: GPTBot # Disallow: / # User-agent: ChatGPT-User # Disallow: / # User-agent: CCBot # Disallow: / # User-agent: anthropic-ai # Disallow: / # User-agent: ClaudeBot # Disallow: / # User-agent: Claude-Web # Disallow: / # User-agent: PerplexityBot # Disallow: / # User-agent: Google-Extended # Disallow: / Sitemap: https://gettextformula.com/sitemap.xml