Show your SEO score to your visitors using the Seobility widget. The widget always displays the current SEO score of your homepage.
User-agent: * Disallow: /search/ Disallow: /*/search/ Disallow: /overlay/ Disallow: /popups/mediaplayer/ Disallow: /popups/popup_gallery/ Disallow: /*/layoutvorlagen/ Disallow: /*/user/account$ Disallow: /*/user/activity$ Disallow: /*/user/profile$ Disallow: /*/user/password/change$ Disallow: /*/user/password/set$ Disallow: /*/user/feedback/status?type=* Disallow: /*/user/register/confirm$ Disallow: /*/user/email/change$ User-agent: Googlebot User-agent: Bingbot Disallow: /*?* Disallow: /p/* # DW content is made available for your personal, non-commercial use. Use of any device, # tool, or process designed to data mine or scrape the content using automated means is # prohibited without prior written permission from Deutsche Welle. # Disallowd Bots User-agent: AhrefsBot Disallow: / User-agent: Ai2Bot Disallow: / User-agent: Ai2Bot-Dolma Disallow: / User-agent: Amazonbot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Applebot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: AwarioRssBot Disallow: / User-agent: AwarioSmartBot Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Claude-Web Disallow: / User-agent: cohere-ai Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Diffbot Disallow: / User-agent: dotbot Disallow: / User-agent: FacebookBot Disallow: / User-agent: FriendlyCrawler Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: ia_archiver Disallow: / User-Agent: ImagesiftBot Disallow: / User-agent: img2dataset Disallow: / User-agent: magpie-crawler Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: Meta-ExternalFetcher Disallow: / User-agent: NewsNow Disallow: / User-agent: MJ12bot Disallow: / User-agent: news-please Disallow: / User-agent: OAI-SearchBot Disallow: / User-agent: omgili Disallow: / User-agent: omgilibot Disallow: / User-agent: peer39_crawler Disallow: / User-agent: peer39_crawler/1.0 Disallow: / User-agent: PerplexityBot Disallow: / User-agent: PetalBot Disallow: / User-agent: Scrapy Disallow: / User-agent: SemrushBot Disallow: / User-agent: SirdataBot Disallow: / User-agent: Timpibot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: VelenPublicWebCrawler Disallow: / User-agent: Webzio-Extended Disallow: / User-agent: Yeti Disallow: / User-agent: YouBot Disallow: / # Other Bot Rules User-agent: Twitterbot Allow: /*?maca=* # Facebook link sharing preview User-agent: facebookexternalhit Allow: / # Sitemaps Sitemap: https://www.dw.com/sitemap.xml
Please select one of the following options for your request.
None of these options suit your need?
You can also download our Quick Start Guide, visit the FAQ section, our Knowledge Base or Blog.
Meta Title
(Nice to have)