# KI-RECHERCHE FUER USER-ANFRAGEN (erlaubt) # OpenAI - Live-Recherche fuer Nutzer User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / # Anthropic - Live-Recherche fuer Nutzer User-agent: ClaudeBot Allow: / # Perplexity AI User-agent: PerplexityBot Allow: / # You.com User-agent: YouBot Allow: / # Microsoft Copilot User-agent: CopilotBot Allow: / # Phind (Code-/Tech-Suche) User-agent: PhindBot Allow: / # Kagi (Privatsphäre-fokussierte Suche) User-agent: KagiBot Allow: / # Brave Search User-agent: BraveBot Allow: / # Neeva (AI-Suche) User-agent: NeevaBot Allow: / # STANDARD-SUCHMASCHINEN User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: DuckDuckBot Allow: / User-agent: Yahoo! Slurp Allow: / # KI-TRAINING CRAWLER (blockiert) # OpenAI - Training User-agent: GPTBot Disallow: / # Google - KI-Training (Gemini, Bard) User-agent: Google-Extended Disallow: / # Anthropic - Training User-agent: anthropic-ai Disallow: / User-agent: Claude-Web Disallow: / # Meta - KI-Training User-agent: FacebookBot Disallow: / User-agent: Meta-ExternalAgent Disallow: / # Common Crawl - haeufig fuer KI-Training genutzt User-agent: CCBot Disallow: / # ByteDance/TikTok User-agent: Bytespider Disallow: / # Apple - KI-Training User-agent: Applebot-Extended Disallow: / # Cohere User-agent: cohere-ai Disallow: / # Amazon User-agent: Amazonbot Disallow: / # Weitere KI-Crawler User-agent: Diffbot Disallow: / User-agent: Omgilibot Disallow: / User-agent: ImagesiftBot Disallow: / # SCRAPING-DIENSTE (blockiert) # Firecrawl User-agent: Firecrawl Disallow: / # Apify User-agent: Apify Disallow: / User-agent: apifybot Disallow: / # ScrapingBot User-agent: ScrapingBot Disallow: / # Scrapy User-agent: Scrapy Disallow: / # Webz.io User-agent: webzio Disallow: / User-agent: webzio-extended Disallow: / # ParseHub User-agent: ParseHub Disallow: / # Octoparse User-agent: Octoparse Disallow: / # Import.io User-agent: import.io Disallow: / # SEO-Crawler (Datensammlung) User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: serpstatbot Disallow: / User-agent: SeekportBot Disallow: / # Weitere Scraper User-agent: HTTrack Disallow: / User-agent: WebCopier Disallow: / User-agent: Offline Explorer Disallow: / User-agent: SiteSnagger Disallow: / # ALLGEMEINE REGELN User-agent: * Allow: / # Interne Dateien ausschliessen Disallow: /*.inc Disallow: /logs/ Disallow: /eu/ Disallow: /eu/scipts/ Disallow: /r/ Disallow: /scripts/
Se han encontrado las siguientes palabras clave. Comprueba si esta página está bien optimizada para cada palabra clave en concreto.
(Deseable)