# Al Hayat TV Robots.txt # This file controls which parts of the website search engines can crawl # Allow all web crawlers to access most content User-agent: * # Allow main pages that should appear in search results Allow: / Allow: /gpt Allow: /hosts Allow: /books Allow: /videos Allow: /articles Allow: /about Allow: /contact # Block admin and debug pages from being indexed Disallow: /studio Disallow: /studio/ Disallow: /api/ Disallow: /admin/ Disallow: /debug/ Disallow: /test/ Disallow: /dev/ Disallow: /internal/ Disallow: /_next/ Disallow: /gptBackup Disallow: /sign-in Disallow: /sign-up Disallow: /profile # Block common files that shouldn't be indexed Disallow: *.json$ Disallow: *.xml$ Disallow: *.txt$ Disallow: *.log$ Disallow: /manifest.json Disallow: /service-worker.js Disallow: /sw.js Disallow: /workbox-*.js # Block private directories Disallow: /sanity/ Disallow: /.sanity/ Disallow: /src/ Disallow: /dist/ Disallow: /node_modules/ # Allow important resources Allow: /images/ Allow: /icons/ Allow: /public/ Allow: /colored-logo.svg Allow: /white-logo.svg Allow: /black-logo.svg Allow: /logo-20-years.png # Google-specific directives User-agent: Googlebot Allow: / Disallow: /studio Disallow: /api/ Disallow: /gptBackup # Bing-specific directives User-agent: Bingbot Allow: / Disallow: /studio Disallow: /api/ Disallow: /gptBackup # Sitemap location Sitemap: https://alhayat.tv/sitemap.xml # Crawl delay (be respectful to server resources) Crawl-delay: 1
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)