User-agent: Googlebot Allow: / Disallow: /admin Disallow: /test/ Disallow: /buchen Disallow: /domain-health Disallow: /lp/ User-agent: Bingbot Allow: / Disallow: /admin Disallow: /test/ Disallow: /buchen Disallow: /domain-health Disallow: /lp/ # Social-/Messenger-Crawler — explizit erlaubt, damit Link-Vorschauen # (OG-Tags + og:image) korrekt geladen werden. User-agent: Twitterbot Allow: / Disallow: /test/ User-agent: facebookexternalhit Allow: / Disallow: /test/ User-agent: facebookcatalog Allow: / Disallow: /test/ User-agent: LinkedInBot Allow: / Disallow: /test/ User-agent: WhatsApp Allow: / Disallow: /test/ User-agent: Slackbot Allow: / Disallow: /test/ User-agent: Slackbot-LinkExpanding Allow: / Disallow: /test/ # AI-Crawler — bewusst erlaubt, damit die Inhalte in KI-Antworten # auftauchen können (gleiche Ausnahmen wie für Suchmaschinen). User-agent: GPTBot Allow: / Disallow: /admin Disallow: /test/ Disallow: /buchen Disallow: /domain-health Disallow: /lp/ User-agent: OAI-SearchBot Allow: / Disallow: /admin Disallow: /test/ Disallow: /buchen Disallow: /domain-health Disallow: /lp/ User-agent: ChatGPT-User Allow: / Disallow: /admin Disallow: /test/ Disallow: /buchen Disallow: /domain-health Disallow: /lp/ User-agent: ClaudeBot Allow: / Disallow: /admin Disallow: /test/ Disallow: /buchen Disallow: /domain-health Disallow: /lp/ User-agent: Claude-Web Allow: / Disallow: /admin Disallow: /test/ Disallow: /buchen Disallow: /domain-health Disallow: /lp/ User-agent: anthropic-ai Allow: / Disallow: /admin Disallow: /test/ Disallow: /buchen Disallow: /domain-health Disallow: /lp/ User-agent: PerplexityBot Allow: / Disallow: /admin Disallow: /test/ Disallow: /buchen Disallow: /domain-health Disallow: /lp/ User-agent: CCBot Allow: / Disallow: /admin Disallow: /test/ Disallow: /buchen Disallow: /domain-health Disallow: /lp/ User-agent: Google-Extended Allow: / Disallow: /admin Disallow: /test/ Disallow: /buchen Disallow: /domain-health Disallow: /lp/ User-agent: Applebot-Extended Allow: / Disallow: /admin Disallow: /test/ Disallow: /buchen Disallow: /domain-health Disallow: /lp/ User-agent: Bytespider Allow: / Disallow: /admin Disallow: /test/ Disallow: /buchen Disallow: /domain-health Disallow: /lp/ User-agent: cohere-ai Allow: / Disallow: /admin Disallow: /test/ Disallow: /buchen Disallow: /domain-health Disallow: /lp/ User-agent: * Allow: / Disallow: /admin Disallow: /test/ Disallow: /buchen Disallow: /domain-health Disallow: /lp/ Sitemap: https://pfeffel.at/sitemap.xml