# Robots.txt for Film und Medien Forum Rheinland-Pfalz # Allow all crawlers User-agent: * Allow: / # Disallow admin and API routes Disallow: /admin Disallow: /api/ Disallow: /eintrag/*/bearbeiten Disallow: /eintrag/*/bilder # Allow important API endpoints for search Allow: /api/entries Allow: /api/tags Allow: /api/search # Sitemap location (to be implemented) # Sitemap: https://medienguide.rlp.de/sitemap.xml # Crawl-delay for respectful crawling (in seconds) Crawl-delay: 1 # Common crawler-specific rules User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Slurp Allow: / User-agent: DuckDuckBot Allow: / # Block bad bots User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: /
Se han encontrado las siguientes palabras clave. Comprueba si esta página está bien optimizada para cada palabra clave en concreto.
(Deseable)