This site can not be crawled by the Seobility bot. The robots.txt file restricts access for our bot. No URLs can be crawled that deny access to the user agent Seobility or *.
Problem URL: http://web.gencat.cat
User-agent: * Disallow: / #Algolia-Crawler-Verif: B80761741539486D User-agent: Algolia Crawler Allow: /*/sitemap-oposicions.xml Allow: /*/generalitat/treballar-generalitat/oposicions/* Sitemap: https://web.gencat.cat/ca/sitemap-oposicions.xml Sitemap: https://web.gencat.cat/en/sitemap-oposicions.xml Sitemap: https://web.gencat.cat/es/sitemap-oposicions.xml # Allow Vertex AI Search bot to crawl specific language directories User-agent: Google-CloudVertexBot Allow: /ca/ Allow: /en/ Allow: /es/ Disallow: / #Bot WayBackMachine User-Agent: ia_archiver Disallow: #Bot Bing User-agent: Bing Disallow: /*? #Bot Google User-agent: Googlebot Disallow: /*? #Bot Yahoo User-agent: Slurp Disallow: /*? #Bot Twitter User-agent: Twitterbot Disallow: #Baiduspider User-agent: Baiduspider Disallow: / #Yandex User-agent: Yandex Disallow: / #SputnikBot User-agent: SputnikBot Disallow: / #Sputnik User-agent: Sputnik Disallow: / #SputnikBot/2.3 User-agent: SputnikBot/2.3 Disallow: / #Bot Salesforce User-agent: SFbot Disallow: /*?