# mrkaiserkhan.com robots.txt # # If Cloudflare prepends "BEGIN Cloudflare Managed content" that Disallows # GPTBot, ClaudeBot, Google-Extended, Amazonbot, Applebot-Extended, Bytespider, # CCBot or meta-externalagent, this origin file cannot win. Turn that setting # OFF: Cloudflare dashboard → mrkaiserkhan.com → Security / AI Crawl Control → # robots.txt / "block training in robots.txt". Intended policy: search=yes, # ai-input=yes, ai-train=yes, with attribution to mrkaiserkhan.com. User-agent: GPTBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: OAI-SearchBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: ChatGPT-User Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Amazonbot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: FacebookBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Google-Extended Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Googlebot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: PerplexityBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Perplexity-User Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: anthropic-ai Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: meta-externalagent Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Meta-ExternalFetcher Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: ClaudeBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Claude-Web Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Bingbot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: DuckAssistBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Applebot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Applebot-Extended Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: cohere-ai Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: YouBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: CCBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Bytespider Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: * Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes Sitemap: https://mrkaiserkhan.com/sitemap.xml Agentmap: https://mrkaiserkhan.com/.well-known/ard.json