Pos.de - SEO Check

Meta Tags

Medienliste

Überschriftenstruktur

Gefundene Links auf dieser Seite

HTTP-Header

Links von Wikipedia

• Culli
• Erick Barrondo
• Moura
• Nigel Dennis (Hispanist)
• Nozza
• Riena W. Kondo
• Wilhelm IX. (Aquitanien)

Robots.txt

# robots.txt for https://pos.de
# This file provides instructions for search engine crawlers.
# Last updated: 2025-06-16

User-agent: *

# Disallow backend, functional, and user-specific areas
Disallow: /wp-admin/
Disallow: /wp-login.php
Disallow: /cgi-bin/
Disallow: /mein-konto/
Disallow: /warenkorb/
Disallow: /kasse/

# Disallow internal search results and feeds to avoid duplicate/low-value content
# and to focus the crawl budget on valuable pages.
Disallow: /search/
Disallow: /*?s=
Disallow: /*?
Disallow: /feed/

# --- Sitemap Location ---
# The sitemap index file is the single source of truth for all URLs.
Sitemap: https://pos.de/sitemap_index.xml

# ============================================
# POS.de - Robots.txt für AI & Search Crawler
# ============================================

# OpenAI (ChatGPT)
User-agent: GPTBot
Allow: /

# Anthropic (Claude)
User-agent: ClaudeBot
Allow: /
User-agent: anthropic-ai
Allow: /

# Google (Gemini)
User-agent: Google-Extended
Allow: /
User-agent: Googlebot
Allow: /

# Perplexity
User-agent: PerplexityBot
Allow: /

# Common Crawl (viele AI-Modelle)
User-agent: CCBot
Allow: /

# Cohere
User-agent: cohere-ai
Allow: /

# Apple Intelligence
User-agent: Applebot-Extended
Allow: /

# Amazon (Alexa AI)
User-agent: Amazonbot
Allow: /

# You.com
User-agent: YouBot
Allow: /

# Diffbot (Wissensextraktion)
User-agent: Diffbot
Allow: /

# Microsoft Bing
User-agent: Bingbot
Allow: /

Suchvorschau