# ------------------------------------ # Zimmerei Rathjens Robots.txt # Optimized for SEO and AI Crawlers # ------------------------------------ # ===== General Rules for All Bots ===== User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-login.php Disallow: /cgi-bin/ Disallow: /trackback/ Disallow: /xmlrpc.php Disallow: /?s= Disallow: /readme.html Disallow: /refer/ Disallow: /comments/feed/ Disallow: /wp-content/uploads/wpforms/ Disallow: /author/ # Allow assets for proper rendering Allow: /wp-content/uploads/ Allow: /wp-content/themes/ Allow: /wp-content/plugins/ # Sitemap declaration Sitemap: zimmerei-rathjens.de/sitemap_index.xml # ------------------------------------ # AI Crawlers - Explicitly Allowed # ------------------------------------ # OpenAI User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / # Perplexity User-agent: PerplexityBot Allow: / # Anthropic (Claude) User-agent: ClaudeBot Allow: / # Google Gemini User-agent: Google-Extended Allow: / # Microsoft Bing / Copilot User-agent: Bingbot Allow: / # Meta AI User-agent: FacebookBot Allow: / # Amazon AI User-agent: Amazonbot Allow: / # Apple AI User-agent: Applebot Allow: / # You.com User-agent: YouBot Allow: / # Neeva (now part of Snowflake) User-agent: NeevaBot Allow: / # Common Crawl User-agent: CCBot Allow: / # Internet Archive User-agent: ia_archiver Allow: / User-agent: archive.org_bot Allow: / # Emerging AI Crawlers (placeholders) User-agent: RekaBot Allow: / User-agent: MistralBot Allow: / User-agent: HelsingBot Allow: / User-agent: AlephAlphaBot Allow: / User-agent: DeepLBot Allow: / User-agent: CoachHubBot Allow: / User-agent: QuantumSystemsBot Allow: / User-agent: UniphoreBot Allow: / User-agent: QureBot Allow: / User-agent: YellowMessengerBot Allow: / User-agent: ORAIBot Allow: / User-agent: LocusBot Allow: /
Se han encontrado las siguientes palabras clave. Comprueba si esta página está bien optimizada para cada palabra clave en concreto.
(Deseable)