# robots.txt — Puls MCP # Compliant with isitagentready.com Discoverability + Bot Access checks. # Content Signals follow https://contentsignals.org/ # ---------------------------------------------------------------------------- # Default policy — public marketing, blog, prompts, status are crawlable. # Content-Signal declares downstream-AI preferences (draft-romm-aipref). # ---------------------------------------------------------------------------- User-agent: * Content-Signal: search=yes, ai-train=no, ai-input=yes Allow: / Disallow: /dashboard/ Disallow: /admin/ Disallow: /api/ Disallow: /auth/ Disallow: /login Disallow: /login/ Disallow: /oauth/ Disallow: /nastaveni Disallow: /nastaveni/ Disallow: /settings/ Disallow: /maintenance Disallow: /install-coming-soon # ---------------------------------------------------------------------------- # AI training crawlers — blocked. # Puls content is not licensed for model training. # ---------------------------------------------------------------------------- User-agent: GPTBot Content-Signal: ai-train=no Disallow: / User-agent: ClaudeBot Content-Signal: ai-train=no Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Google-Extended Disallow: / User-agent: PerplexityBot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: meta-externalagent Disallow: / User-agent: FacebookBot Disallow: / User-agent: Diffbot Disallow: / User-agent: ImagesiftBot Disallow: / # ---------------------------------------------------------------------------- # AI answer / live-search assistants — allowed. # These fetch content live to answer user questions; we want Puls docs and # blog posts to surface in their answers. # ---------------------------------------------------------------------------- User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot-User Allow: / User-agent: Claude-Web Allow: / # ---------------------------------------------------------------------------- # Discovery pointers # ---------------------------------------------------------------------------- Sitemap: https://pulsmcp.com/sitemap.xml