# This file is automatically added by Rank Math SEO plugin to help a website index better # More info: https://rankmath.com/?utm_source=Plugin&utm_medium=Robots&utm_campaign=WP User-Agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php # Bloqueo de las URL dinámicas Disallow: /*? # Sitemap Sitemap: https://museodecera.com/sitemap_index.xml Sitemap: https://museodecera.com/post-sitemap.xml Sitemap: https://museodecera.com/page-sitemap.xml Sitemap: https://museodecera.com/personaje-sitemap.xml Sitemap: https://museodecera.com/local-sitemap.xml # Bloqueo de las búsquedas User-agent: * Disallow: /?s= Disallow: /search # Bloqueo de trackbacks User-agent: * Disallow: /trackback Disallow: /*trackback Disallow: /*trackback* Disallow: /*/trackback # Bloqueo de feeds para crawlers User-agent: * Allow: /feed/$ Disallow: /feed/ Disallow: /comments/feed/ Disallow: /*/feed/$ Disallow: /*/feed/rss/$ Disallow: /*/trackback/$ Disallow: /*/*/feed/$ Disallow: /*/*/feed/rss/$ Disallow: /*/*/trackback/$ Disallow: /*/*/*/feed/$ Disallow: /*/*/*/feed/rss/$ Disallow: /*/*/*/trackback/$ # Añadimos tiempo de espera a algunos bots que se suelen volver locos User-agent: noxtrumbot Crawl-delay: 20 User-agent: msnbot Crawl-delay: 20 User-agent: Slurp Crawl-delay: 20 # Bloqueo de bots y crawlers poco útiles User-agent: MSIECrawler Disallow: / User-agent: WebCopier Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: libwww Disallow: / User-agent: Orthogaffe Disallow: / User-agent: UbiCrawler Disallow: / User-agent: DOC Disallow: / User-agent: Zao Disallow: / User-agent: sitecheck.internetseer.com Disallow: / User-agent: Zealbot Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WebStripper Disallow: / User-agent: Fetch Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: WebZIP Disallow: / User-agent: linko Disallow: / User-agent: Xenu Disallow: / User-agent: larbin Disallow: / User-agent: ZyBORG Disallow: / User-agent: Download Ninja Disallow: / User-agent: wget Disallow: / User-agent: grub-client Disallow: / User-agent: k2spider Disallow: / User-agent: NPBot Disallow: / User-agent: WebReaper Disallow: / # Previene problemas de recursos bloqueados en Google Search Console User-agent: Googlebot Allow: /*.css$ Allow: /*.js$ # Permitir uso por agentes de búsqueda de IA User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: PerplexityBot User-agent: FirecrawlAgent User-agent: AndiBot User-agent: ExaBot User-agent: PhindBot User-agent: YouBot Allow: / # Bloquear recopilación de datos para entrenamiento de IA User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / # Permitir indexación por buscadores tradicionales User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / # Bloqueo de acceso a áreas administrativas para todos los bots User-agent: * Disallow: /admin/ Disallow: /internal/
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)