User-agent: * Disallow: /api/ # Allow access to the internal API to let SPA function properly Allow: /api/int/ Disallow: /search? Disallow: /expert-search? # this is ported from 'classic' site # Some docs say must be a whole number of seconds. # Crawlers differ whether this means delay-between-calls or whether it is max-requests-in-window. # Google ignore this value, but supposedly honored by yandex and bing. Crawl-delay: 1
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)