# robots.txt for RankScope # https://rankscope.ai User-agent: * Allow: / Sitemap: https://rankscope.ai/sitemap.xml # Structured summary for LLMs — https://llmstxt.org # LLM-Content: https://rankscope.ai/llms.txt User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Slurp Allow: / User-agent: DuckDuckBot Allow: / # AI crawlers, explicitly allowed (GEO visibility). Tokens from each operator's # own documentation, checked 2026-10-23: https://rankscope.ai/blog/ai-crawlers # Search and user-initiated fetchers (decide whether we can be cited): User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: meta-webindexer User-agent: Amzn-SearchBot User-agent: MistralAI-Index User-agent: MistralAI-User User-agent: DuckAssistBot Allow: / # Training crawlers and training-control tokens (allowed by choice). # Google-Extended controls Gemini training and grounding; it does not affect Google Search. User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: meta-externalagent User-agent: MistralAI-Training User-agent: GoogleOther Allow: / # Rate limit aggressive SEO crawlers User-agent: AhrefsBot Crawl-delay: 10 User-agent: SemrushBot Crawl-delay: 10 # CCBot (Common Crawl) is allowed on purpose; see https://rankscope.ai/blog/ai-crawlers # Block bad bots User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: /
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)