Drappier.com.au - SEO Check

Meta Tags

Medienliste

Überschriftenstruktur

Gefundene Links auf dieser Seite

HTTP-Header

Links von Wikipedia

Robots.txt

# Drappier - robots.txt
# Reference: https://www.robotstxt.org/ + https://developers.google.com/search/docs/crawling-indexing/robots/intro
# Policy preference: search=yes, ai-input=yes, broad third-party training crawl=no
# Normal search visibility allowed.
# AI search, answer grounding, and user-retrieval crawlers allowed where they can surface or cite Drappier.
# Google-Extended allowed for Google AI and grounding use; broad data-collection crawlers blocked where crawler-specific controls are available.

User-agent: *
Content-Signal: ai-train=no, search=yes, ai-input=yes

# Test/staging-only paths that should never appear in search
Disallow: /blog-filter-test/

# Cloudflare Pages serverless endpoints, not content
Disallow: /functions/

# Allow CSS / JS so search engines can render pages correctly
Allow: /assets/
Allow: /*.css$
Allow: /*.js$

# AI search, answer, and user-retrieval crawlers allowed with shared utility exclusions
User-agent: OAI-SearchBot
User-agent: ChatGPT-User
User-agent: PerplexityBot
User-agent: Perplexity-User
User-agent: Claude-SearchBot
User-agent: Claude-User
User-agent: Applebot
User-agent: Google-Extended
User-agent: DuckAssistBot
User-agent: MistralAI-User
User-agent: YouBot
Disallow: /blog-filter-test/
Disallow: /functions/
Allow: /assets/
Allow: /*.css$
Allow: /*.js$

# AI training, extended-use, and broad data crawlers blocked
User-agent: GPTBot
User-agent: ClaudeBot
User-agent: Claude-Web
User-agent: anthropic-ai
User-agent: Applebot-Extended
User-agent: CCBot
User-agent: Bytespider
User-agent: cohere-ai
User-agent: Diffbot
User-agent: Meta-ExternalAgent
User-agent: FacebookBot
User-agent: Amazonbot
Disallow: /

Sitemap: https://drappier.com.au/sitemap_index.xml

Suchvorschau