# Custom Robots by Brisbane User-agent: * Disallow: /files/* Disallow: /readme.html Disallow: /thank-you/ Disallow: /footer/ Disallow: /xmlfeeds/ Disallow: *?utm_source Disallow: *?utm_medium Disallow: *?utm_campaign Disallow: *?utm_term Disallow: *?utm_content Disallow: *?fbclid Disallow: *?gclid Disallow: *?ref= Disallow: *?replytocom Disallow: /wp-admin/ Disallow: /wp-login.php Allow: /*$ # --- Google Crawlers (Allowed) --- User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: / User-agent: Adsbot-Google Allow: / User-agent: Googlebot-Mobile Allow: / # --- Search & SEO Crawlers (Allowed) --- User-agent: AhrefsBot Allow: / User-agent: AhrefsSiteAudit Allow: / User-agent: SemrushBot Allow: / User-agent: SemrushBot-SA Allow: / User-agent: DuckDuckBot Allow: / User-agent: bingbot Allow: / User-agent: Qwantify Allow: / # --- AI & Assistant Crawlers (Allowed) --- User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Google-Extended Allow: / User-agent: PerplexityBot Allow: / User-agent: CCBot Allow: / User-agent: Applebot Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: Twitterbot Allow: / User-agent: YouBot Allow: / User-agent: ai-crawler Allow: / # --- Commercial / Data Crawlers (Blocked) --- User-agent: Amazonbot Disallow: / User-agent: Bytespider Disallow: / User-agent: MJ12bot Disallow: / User-agent: dotbot Disallow: / User-agent: BLEXBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: Yandex Disallow: / User-agent: PetalBot Disallow: / User-agent: DeepSeekBot Disallow: / Sitemap: https://apaththatfits.com/sitemap_index.xml/
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)