# robots.txt for headmasters.com # Optimised for Google AI Overviews, Perplexity, Claude, and other AI Search platforms # Default rules (applies to everything unless overridden below) User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://www.headmasters.com/sitemap_index.xml # Explicitly allow major AI crawlers (but keep wp-admin blocked) User-agent: Googlebot Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Allow: / User-agent: Google-Extended Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Allow: / User-agent: GPTBot Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Allow: / User-agent: OAI-SearchBot Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Allow: / User-agent: ClaudeBot Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Allow: / User-agent: Claude-SearchBot Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Allow: / User-agent: PerplexityBot Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Allow: / User-agent: CCBot Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Allow: /
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)