# ValorAI robots.txt (origin policy) # Product host: https://www.tryvalor.ai # # Content Signals (https://contentsignals.org/): # search — classic search indexes # ai-input — real-time grounding / answer engines (public pages only) # ai-train — model training / fine-tuning # use — how content may be retained (immediate | reference | full) # # Product intent: # Public marketing + education: search=yes, ai-input=yes, ai-train=no, use=full # App shells, APIs, chat, documents: Disallow (no training, no grounding source) # # Cloudflare note: if "Managed robots.txt" / "block training in robots.txt" is ON, # Cloudflare PREPENDS Disallow rules for GPTBot/ClaudeBot/etc. Disable that setting # so this file is authoritative (docs/seo/cloudflare-robots-geo.md). User-agent: * User-agent: Twitterbot User-agent: facebookexternalhit User-agent: LinkedInBot User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: ClaudeBot User-agent: Claude-Web User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Bingbot User-agent: Googlebot User-agent: DuckAssistBot User-agent: meta-externalagent User-agent: meta-webindexer User-agent: FacebookBot Content-Signal: search=yes, ai-train=no, ai-input=yes, use=full Allow: / Allow: /api/og Allow: /blog/ Allow: /roadmap/ Allow: /pricing Allow: /plans Allow: /about Allow: /security Allow: /privacy Allow: /terms Allow: /newsletter Allow: /faq Allow: /compare Allow: /assessment Allow: /dd214 Allow: /answers/ Allow: /tools/ Allow: /benefits Allow: /bdd Allow: /denied Allow: /va-nexus-letters Allow: /va-buddy-statements Allow: /claims-assistance-boundary Allow: /find-a-veteran-service-organization Allow: /why-valorai Allow: /why-vso Allow: /community Allow: /support Allow: /status Allow: /refer Allow: /llms.txt Allow: /llms-full-text.txt Allow: /developers Allow: /docs Disallow: /api/ Disallow: /dashboard/ Disallow: /auth/ Disallow: /claims/ Disallow: /chat/ Disallow: /documents/ Disallow: /share/ Disallow: /profile/ Disallow: /settings/ Disallow: /claim-prep Disallow: /academy Disallow: /post-auth Disallow: /opportunities Disallow: /onboarding Disallow: /admin Disallow: /review/ Disallow: /witness/ Disallow: /knowledgebase Disallow: /prototype User-agent: Bytespider User-agent: CCBot User-agent: Diffbot User-agent: ImagesiftBot User-agent: omgili User-agent: omgilibot User-agent: Amazonbot Content-Signal: search=no, ai-train=no, ai-input=no, use=immediate Disallow: / Sitemap: https://www.tryvalor.ai/sitemap.xml Host: https://www.tryvalor.ai