# =============================================================== # Official robots.txt for Austrian Ministry of the Interior (BMI) # =============================================================== # 1. BLOCK ALL AGGRESSIVE SEO, BACKLINK & AUDIT TRACKERS User-agent: SERankingBacklinksBot User-agent: AhrefsBot User-agent: DotBot User-agent: Rogerbot User-agent: Mozdotcombot User-agent: SemrushBot User-agent: SemrushBot-SA User-agent: MJ12bot User-agent: Barkrowler User-agent: BLEXBot User-agent: Eyeota User-agent: Lipperhey User-agent: ZoominfoBot User-agent: SeznamBot User-agent: CognitiveRGBot User-agent: Sogou web spider User-agent: Baiduspider Disallow: / # 2. BLOCK ALL AI TRAINING SCRAPERS, LLM CRAWLERS & DISCOVERY ENGINES User-agent: GPTBot User-agent: ChatGPT-User User-agent: Google-Extended User-agent: Anthropic-ai User-agent: Claude-Web User-agent: Applebot-Extended User-agent: PerplexityBot User-agent: Cohere-ai User-agent: Meta-ExternalAgent User-agent: Omgilibot User-agent: Amazonbot User-agent: FacebookBot User-agent: Diffbot User-agent: Bytespider Disallow: / # 3. GLOBAL PROTECTION FOR SENSITIVE GOVERNMENT DIRECTORIES User-agent: * Disallow: /admin/ Disallow: /autodiscover/ Disallow: /backend/ Disallow: /config/ Disallow: /cms/ Disallow: /_layouts/ Disallow: /api/ Disallow: /temp/ Disallow: /search?* Disallow: /*?downloads=* Disallow: /*?print=* # 4. EXPLICIT ALLOWANCE FOR LEGITIMATE PUBLIC SEARCH ENGINES # Global Mainstream Engines User-agent: Googlebot User-agent: Bingbot User-agent: Slurp User-agent: Yahoo! Slurp # Privacy-First & Independent Engines User-agent: DuckDuckBot User-agent: Qwantify User-agent: BraveBot User-agent: MojeekBot # European / Academic Regional Engines User-agent: YandexBot User-agent: EcosiaBot User-agent: SwisscowsBot Allow: / # Dynamic XML Sitemap Location Sitemap:
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)