# Allow all well-behaved bots (this can be risky—see note below) User-agent: * Disallow: # Allow OpenAI's GPTBot User-agent: GPTBot Allow: / # Allow Common Crawl (used by many AI models) User-agent: CCBot Allow: / # Allow Google's AI crawler (Bard/Gemini) User-agent: Google-Extended Allow: / # Allow Google's standard crawler (SEO) User-agent: Googlebot Allow: / # Allow Bing (Microsoft) User-agent: Bingbot Allow: / # Allow Anthropic's ClaudeBot User-agent: ClaudeBot Allow: / # Allow Perplexity AI User-agent: PerplexityBot Allow: / # Allow Amazon's AI bot User-agent: Amazonbot Allow: / # Block known bad or aggressive bots (case-sensitive) User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: YandexBot Disallow: / User-agent: PetalBot Disallow: / User-agent: Bytespider Disallow: / User-agent: Sogou Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: Baiduspider Disallow: / # Block any bots trying to disguise as browsers or missing UA User-agent: * Disallow: /?* Crawl-delay: 10 Sitemap: https://webflow.eco.com/sitemap.xml
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)