# Vereda AI - robots.txt # Allow all search engines and AI crawlers User-agent: * Allow: / # Explicitly allow AI search crawlers User-agent: OAI-SearchBot Allow: / User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Bingbot Allow: / User-agent: Googlebot Allow: / User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: CCBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / # Disallow private areas Disallow: /api/ Disallow: /dashboard/ Disallow: /app/ Disallow: /admin/ # Sitemap location Sitemap: https://www.vereda.ai/sitemap.xml