# LocalGhost.ai robots.txt # Generated: 2026.11.13_0x0c837c7e # Policy: search engines and AI crawlers are welcome. We want to be cited. # Every crawler gets the same rules. The named agents are listed so the # welcome is explicit, and they share one group so the Disallow lines # below apply to them too (a crawler only reads the most specific group # that names it). User-agent: Googlebot User-agent: Google-Extended User-agent: bingbot User-agent: msnbot User-agent: DuckDuckBot User-agent: DuckAssistBot User-agent: Applebot User-agent: Applebot-Extended User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: ClaudeBot User-agent: Claude-User User-agent: Claude-SearchBot User-agent: Claude-Web User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Perplexity-User User-agent: MistralAI-User User-agent: CCBot User-agent: meta-externalagent User-agent: FacebookBot User-agent: * Allow: / Disallow: /ghost/ Disallow: /mirror/ Disallow: /assets/podcast/*.m4a$ # Sitemaps Sitemap: https://www.localghost.ai/sitemap.xml # Feeds and LLM indexes (discoverability hints) # Atom feed: https://www.localghost.ai/feed.xml # LLM index: https://www.localghost.ai/llms.txt # LLM full archive: https://www.localghost.ai/llms-full.txt # Markdown twins: every page at its own address plus .md (https://www.localghost.ai/about.md) # About and key facts: https://www.localghost.ai/about