# Allow all crawlers (default) User-agent: * # Content Signals (https://contentsignals.org) — declare how this content may # be used: discoverable in search and usable by AI assistants to answer # questions (so Open can be cited), but not used to train AI models. Content-Signal: search=yes, ai-input=yes, ai-train=no Allow: / Allow: /_next/static/ Allow: /_next/image Disallow: /api/ Disallow: /_next/data/ Disallow: /admin/ Disallow: /sales/ Disallow: /security-files/ # Specific rules for AI crawlers — same disallows User-agent: GPTBot Allow: / Disallow: /sales/ Disallow: /security-files/ User-agent: ChatGPT-User Allow: / Disallow: /sales/ Disallow: /security-files/ User-agent: Google-Extended Allow: / Disallow: /sales/ Disallow: /security-files/ User-agent: anthropic-ai Allow: / Disallow: /sales/ Disallow: /security-files/ User-agent: Claude-Web Allow: / Disallow: /sales/ Disallow: /security-files/ User-agent: CCBot Allow: / Disallow: /sales/ Disallow: /security-files/ User-agent: PerplexityBot Allow: / Disallow: /sales/ Disallow: /security-files/ # Sitemap location Sitemap: https://www.open.cx/sitemap.xml # No Crawl-delay. Google ignores the directive outright; Bing and Yandex honour # it, so at one second per request a ~970-URL sitemap became a quarter of an # hour of throttling on a statically rendered site behind a CDN with a 0.2s # median TTFB. There is no origin here to protect.
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)