This site can not be crawled by the Seobility bot. The robots.txt file restricts access for our bot. No URLs can be crawled that deny access to the user agent Seobility or *.
Problem URL: http://mysortimo.de
# Sortimo International GmbH -- intelligente Mobilität # # SSSS OOO RRRR TTTTT III M M OOO # S O O R R T I MM MM O O # SSS O O RRRR T I M M M O O # S O O R R T I M M O O # SSSS OOO R RR T III M M OOO # # robots.txt for https://www.mysortimo.de # # send e-mail to IT(at)Sortimo(dot)de for updates or problems # Last updated 2024-11-06 # For all robots ############## User-agent: * Crawl-delay: 3 # 3 seconds between page requests # solr Disallow: /*/search # Wildcard for bots that can read it, fallback for others below. Disallow: /*/v2/search # Wildcard for bots that can read it, fallback for others below. # Block access to specific groups of pages ######################### User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /blog/wp-admin/ Disallow: /blog/wp-includes/ Disallow: /hac/* Disallow: /register/ Disallow: /sortimoknots/api/v1/ Disallow: /unity/* Disallow: */forms/ Disallow: */search-results.html # Disallow country depending Sites ################################# Disallow: /de/robots.txt Disallow: /de/cart Disallow: /de/checkout Disallow: /de/my-account Disallow: /de/o/ # Block access for specific Bots ################################ # Block BLEXBot (Bad Bot) User-agent: BLEXBot Disallow: / # Block Bytespider User-agent: Bytespider Disallow: / # Block CazoodleBot as it does not present correct accept content headers User-agent: CazoodleBot Disallow: / # Block MJ12bot as it is just noise User-agent: MJ12bot Disallow: / # Block Gigabot User-agent: Gigabot Disallow: / # Block DataForSeoBot User-agent: DataForSeoBot Disallow: / # Block DotBot User-agent: DotBot Disallow: / # Block dotbot as it cannot parse base urls properly User-agent: dotbot/1.0 Disallow: / # Block Gigabot User-agent: Gigabot Disallow: / # Block ImagesiftBot User-agent: ImagesiftBot Disallow: / # Block OpenindexSpider User-agent: OpenindexSpider Disallow: / # Block Orbbot User-agent: Orbbot Disallow: / # Block python-requests User-agent: python-requests Disallow: / # Block SeekportBot User-agent: SeekportBot Disallow: / # New 11/2024 # Block ClaudeBot/1.0; +claudebot@anthropic.com - 3.22.242.248 User-agent: ClaudeBot Disallow: / # Allow specific crawler ##################################################### # SiteAuditBot http://www.semrush.com/bot.html # Is allowed to crawl every Sunday, but default delay 1 Second is too much load User-agent: SiteAuditBot Crawl-delay: 2 Allow: / # AhrefsBot User-agent: AhrefsBot Crawl-delay: 3 Allow: / User-agent: Googlebot Crawl-delay: 2 Allow: / # HubSpot Crawler; +https://www.hubspot.com User-agent: HubSpot Crawl-delay: 2 Allow: / User-agent: SemrushBot Crawl-delay: 3 Allow: / # New 04/2025 # Disalow everyone per default and withelist above ############################# User-agent: * Disallow: / # AppleWebKit/537.36 (KHTML, like Gecko) #blockieren, da kein Mehrwert # Barkrowler/0.9; +https://babbar.tech/crawler 154.54.249.204 # ChatGPT-User/1.0; +https://openai.com/bot # coccocbot-image/1.0; +http://help.coccoc.com/searchengine #blockieren # Dataprovider.com # DuckDuckBot # facebookexternalhit # Googlebot/2.1; +http://www.google.com/bot.html #erlaubt # HubSpot Crawler; +https://www.hubspot.com #erlaubt # ows.eu/owler # PetalBot 114.119.146.114 # SemrushBot/7~bl; +http://www.semrush.com/bot.html # SeznamBot # Turnitin (https://bit.ly/2UvnfoQ) #blockieren # um-FC/1.0 159.69.14.105 # YandexBot/3.0; +http://yandex.com/bots #blockieren (nur für Russland wichtig) # YandexMarket/2.0; +http://yandex.com/bots #blockieren # ZoominfoBot (zoominfobot at zoominfo dot com) #blockieren # Place the Sitemap at the END ############################################## # Allow search crawlers to discover the sitemap User-agent: * # siteMapsMaintainedByJob Sitemap: https://www.mysortimo.de/de/sitemap.xml Sitemap: https://www.mysortimo.de/blog/sitemap_index.xml # END of Robots.txt #########################################################