Zinio.com - SEO Check

Meta Tags

Medienliste

Überschriftenstruktur

Gefundene Links auf dieser Seite

HTTP-Header

Links von Wikipedia

• Christian Chávez
• Descobrir Catalunya
• King Tuff
• Ángelo Henríquez

Robots.txt

Sitemap: https://www.zinio.com/sitemap_index.xml

############################################################
# Robots.txt: Disallow and Crawl-delay rules
############################################################

########################################
# Disallow: Known Copiers & Other Bots
########################################
User-agent: SiteSnagger
User-agent: HTTrack
User-agent: Domain Re-Animator Bot
User-agent: Teleport
User-agent: TeleportPro
User-agent: EmailCollector
User-agent: EmailSiphon
User-agent: WebBandit
User-agent: WebZIP
User-agent: WebReaper
User-agent: WebStripper
User-agent: Web Downloader
User-agent: WebCopier
User-agent: Offline Explorer
User-agent: Offline Explorer Pro
User-agent: HTTrack Website Copier
User-agent: Offline Commander
User-agent: Leech
User-agent: WebSnake
User-agent: BlackWidow
User-agent: HTTP Weazel
User-agent: Microsoft.URL.Control
User-agent: Xenu
User-agent: Download Ninja

User-agent: Accelobot
User-agent: SapphireWebCrawler
User-agent: Charlotte
User-agent: kalooga
User-agent: ltx71
User-agent: Megaindex
User-agent: BLEXBot
User-agent: proximic
User-agent: domaincrawler
User-agent: UbiCrawler
User-agent: DOC
User-agent: Zao
User-agent: sitecheck.internetseer.com
User-agent: Zealbot
User-agent: MSIECrawler
User-agent: Fetch
User-agent: linko
User-agent: larbin
User-agent: libwww
User-agent: Maxthon
User-agent: CNCDialer

User-agent: GPTBot
User-agent: ChatGPT-User
User-agent: CCBot
User-agent: anthropic-ai
Disallow: /

########################################
# Crawl-delay: 1 second for all other bots
########################################

# Major Search-Engine Crawlers (excluding Google)
User-agent: Bingbot
User-agent: MSNBot
User-agent: DuckDuckBot
User-agent: Slurp
User-agent: BaiduSpider
User-agent: Baiduspider-video
User-agent: Sogou Spider
User-agent: Exabot

# SEO / Link-Analysis Crawlers
User-agent: SemrushBot
User-agent: MJ12bot
User-agent: BingPreview
User-agent: Screaming Frog SEO Spider
User-agent: DeepCrawl
User-agent: SearchmetricsBot
User-agent: Sistrix Crawler
User-agent: OpenLinkProfiler
User-agent: AhrefsSiteAudit
User-agent: AhrefsBot
User-agent: dotbot

# Archiving & Monitoring Bots
User-agent: ia_archiver
User-agent: ArchiveBot
User-agent: UptimeRobot
User-agent: Pingdom
User-agent: Site24x7
User-agent: StatusCake
User-agent: DotBot

# Generic / Miscellaneous Crawlers
User-agent: PetalBot
User-agent: YisouSpider
User-agent: Qwantify
User-agent: Seznambot
User-agent: DuckDuckGo-Crawler
User-agent: DuckDuckGo-AdCrawler
User-agent: Riddler
User-agent: BLEXBot-FeedCrawler
User-agent: ZoominfoBot
User-agent: AhrefsBot-WWW
User-agent: LinkedInBot-News
User-agent: MJ12bot-Dataprotection
User-agent: ZyBorg
User-agent: Siteliner
User-agent: Sentry.io
User-agent: ShopWiki
User-agent: Linguee
User-agent: Yandex
User-agent: YandexAdditional
User-agent: YandexAdditionalBot

# AI-Training / Data-Collection Bots
User-agent: AI2Bot
User-agent: Ai2Bot-Dolma
User-agent: aiHitBot
User-agent: Amazonbot
User-agent: Andibot
User-agent: Applebot
User-agent: Applebot-Extended
User-agent: bedrockbot
User-agent: Brightbot 1.0
User-agent: Bytespider
User-agent: Claude-SearchBot
User-agent: Claude-User
User-agent: Claude-Web
User-agent: ClaudeBot
User-agent: cohere-ai
User-agent: cohere-training-data-crawler
User-agent: Cotoyogi
User-agent: Crawlspace
User-agent: Diffbot
User-agent: DuckAssistBot
User-agent: FacebookBot
User-agent: Factset_spyderbot
User-agent: FirecrawlAgent
User-agent: FriendlyCrawler
User-agent: Google-CloudVertexBot
User-agent: Google-Extended
User-agent: GoogleOther
User-agent: GoogleOther-Image
User-agent: GoogleOther-Video
User-agent: iaskspider/2.0
User-agent: ICC-Crawler
User-agent: ImagesiftBot
User-agent: img2dataset
User-agent: ISSCyberRiskCrawler
User-agent: Kangaroo Bot
User-agent: meta-externalagent
User-agent: Meta-ExternalAgent
User-agent: meta-externalfetcher
User-agent: Meta-ExternalFetcher
User-agent: MistralAI-User/1.0
User-agent: NovaAct
User-agent: OAI-SearchBot
User-agent: omgili
User-agent: omgilibot
User-agent: Operator
User-agent: PanguBot
User-agent: Panscient
User-agent: panscient.com
User-agent: Perplexity-User
User-agent: PerplexityBot
User-agent: PhindBot
User-agent: QualifiedBot
User-agent: QuillBot
User-agent: quillbot.com
User-agent: SBIntuitionsBot
User-agent: Scrapy
User-agent: SemrushBot-OCOB
User-agent: SemrushBot-SWA
User-agent: Sidetrade indexer bot
User-agent: TikTokSpider
User-agent: Timpibot
User-agent: VelenPublicWebCrawler
User-agent: Webzio-Extended
User-agent: wpbot
User-agent: YouBot
Crawl-delay: 1

User-agent: *
#DIRECTORIES
Disallow: /api/*
Disallow: /*/api/*
Disallow: /reader/*
Disallow: /*/reader/*
Disallow: /checkout/
Disallow: /*/checkout/
Disallow: /search
Disallow: /*/search
Disallow: /*/publisher/*
Disallow: /publisher/*
Disallow: /publisher/*

#Articles
Disallow: /explore/free/*/*-i*/*-a*
Disallow: /explore/most-read/*/*-i*/*-a*
Disallow: /explore/trending/*/*-i*/*-a*
Disallow: /explore/for-you/*/*-i*/*-a*
Disallow: /explore/recommended-articles/*/*-i*/*-a*
Disallow: /*/explore/free/*/*-i*/*-a*
Disallow: /*/explore/most-read/*/*-i*/*-a*
Disallow: /*/explore/trending/*/*-i*/*-a*
Disallow: /*/explore/for-you/*/*-i*/*-a*
Disallow: /*/explore/recommended-articles/*/*-i*/*-a*

#CATEGORIES
Disallow: /adult
Disallow: /*/adult
#RECOMMENDATIONS
Disallow: /*/recommended/*
Disallow: /recommended/*
Disallow: /publication-similarities
Disallow: /*/publication-similarities
#PARAMETERS
Disallow: *lang=*
Disallow: *skuId=*
Disallow: *offer=*
Disallow: *offerId=*
Disallow: *bd=*
Disallow: *rf=*
Disallow: *pss=*
Disallow: *productId=*
Disallow: *categoryId=*
Disallow: *subscription=*
Disallow: *prnt=*
Allow: *page=*

Suchvorschau