# This bot still requests /backend/corpus even though we ask not to User-agent: AhrefsBot Disallow: / # Don't fetch the corpus search results (fetch from Javascript) User-agent: * Disallow: /backend/corpus # Everything/-one else is ok to crawl User-agent: * Allow: /
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)