Show your SEO score to your visitors using the Seobility widget. The widget always displays the current SEO score of your homepage.
# robots.txt for http://www.wikipedia.org/ and friends # # Please note: There are a lot of pages on this site, and there are # some misbehaved spiders out there that go _way_ too fast. If you're # irresponsible, your access to the site may be blocked. # # Observed spamming large amounts of https://en.wikipedia.org/?curid=NNNNNN # and ignoring 429 ratelimit responses, claims to respect robots: # http://mj12bot.com/ User-agent: MJ12bot Disallow: / # advertising-related bots: User-agent: Mediapartners-Google* Disallow: / # Wikipedia work bots: User-agent: IsraBot Disallow: User-agent: Orthogaffe Disallow: # Crawlers that are kind enough to obey, but which we'd rather not have # unless they're feeding search engines. User-agent: UbiCrawler Disallow: / User-agent: DOC Disallow: / User-agent: Zao Disallow: / # Some bots are known to be trouble, particularly those designed to copy # entire sites. Please obey robots.txt. User-agent: sitecheck.internetseer.com Disallow: / User-agent: Zealbot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WebStripper Disallow: / User-agent: WebCopier Disallow: / User-agent: Fetch Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: WebZIP Disallow: / User-agent: linko Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: Xenu Disallow: / User-agent: larbin Disallow: / User-agent: libwww Disallow: / User-agent: ZyBORG Disallow: / User-agent: Download Ninja Disallow: / # Misbehaving: requests much too fast: User-agent: fast Disallow: / # # Sorry, wget in its recursive mode is a frequent problem. # Please read the man page and use it properly; there is a # --wait option you can use to set the delay between hits, # for instance. # User-agent: wget Disallow: / # # The 'grub' distributed client has been *very* poorly behaved. # User-agent: grub-client Disallow: / # # Doesn't follow robots.txt anyway, but... # User-agent: k2spider Disallow: / # # Hits many times per second, not acceptable # http://www.nameprotect.com/botinfo.html User-agent: NPBot Disallow: / # A capture bot, downloads gazillions of pages with no public benefit # http://www.webreaper.net/ User-agent: WebReaper Disallow: / # Per their statement, semrushbot respects crawl-delay directives # We want them to overall stay within reasonable request rates to # the backend (20 rps); keeping in mind that the crawl-delay will # be applied by site and not globally by the bot, 5 seconds seem # like a reasonable approximation User-agent: SemrushBot Crawl-delay: 5 # # Friendly, low-speed bots are welcome viewing article pages, but not # dynamically-generated pages please. # # Inktomi's "Slurp" can read a minimum delay between hits; if your # bot supports such a thing using the 'Crawl-delay' or another # instruction, please let us know. # # There is a special exception for API mobileview to allow dynamic # mobile web & app views to load section content. # These views aren't HTTP-cached but use parser cache aggressively # and don't expose special: pages etc. # # Another exception is for REST API documentation, located at # /api/rest_v1/?doc. # User-agent: * Allow: /w/api.php?action=mobileview& Allow: /w/load.php? Allow: /api/rest_v1/?doc Disallow: /w/ Disallow: /api/ Disallow: /trap/ Disallow: /wiki/Special: Disallow: /wiki/Spezial: Disallow: /wiki/Spesial: Disallow: /wiki/Special%3A Disallow: /wiki/Spezial%3A Disallow: /wiki/Spesial%3A # # ar: Disallow: /wiki/%D8%AE%D8%A7%D8%B5:Search Disallow: /wiki/%D8%AE%D8%A7%D8%B5%3ASearch # # dewiki: # T6937 # sensible deletion and meta user discussion pages: Disallow: /wiki/Wikipedia:L%C3%B6schkandidaten/ Disallow: /wiki/Wikipedia:Löschkandidaten/ Disallow: /wiki/Wikipedia:Vandalensperrung/ Disallow: /wiki/Wikipedia:Benutzersperrung/ Disallow: /wiki/Wikipedia:Vermittlungsausschuss/ Disallow: /wiki/Wikipedia:Administratoren/Probleme/ Disallow: /wiki/Wikipedia:Adminkandidaturen/ Disallow: /wiki/Wikipedia:Qualitätssicherung/ Disallow: /wiki/Wikipedia:Qualit%C3%A4tssicherung/ # 4937#5 Disallow: /wiki/Wikipedia:Vandalismusmeldung/ Disallow: /wiki/Wikipedia:Gesperrte_Lemmata/ Disallow: /wiki/Wikipedia:Löschprüfung/ Disallow: /wiki/Wikipedia:L%C3%B6schprüfung/ Disallow: /wiki/Wikipedia:Administratoren/Notizen/ Disallow: /wiki/Wikipedia:Schiedsgericht/Anfragen/ Disallow: /wiki/Wikipedia:L%C3%B6schpr%C3%BCfung/ # T14111 Disallow: /wiki/Wikipedia:Checkuser/ Disallow: /wiki/Wikipedia_Diskussion:Checkuser/ Disallow: /wiki/Wikipedia_Diskussion:Adminkandidaturen/ # T15961 Disallow: /wiki/Wikipedia:Spam-Blacklist-Log Disallow: /wiki/Wikipedia%3ASpam-Blacklist-Log Disallow: /wiki/Wikipedia_Diskussion:Spam-Blacklist-Log Disallow: /wiki/Wikipedia_Diskussion%3ASpam-Blacklist-Log # # enwiki: # Folks get annoyed when VfD discussions end up the number 1 google hit for # their name. See T6776 Disallow: /wiki/Wikipedia:Articles_for_deletion/ Disallow: /wiki/Wikipedia%3AArticles_for_deletion/ Disallow: /wiki/Wikipedia:Votes_for_deletion/ Disallow: /wiki/Wikipedia%3AVotes_for_deletion/ Disallow: /wiki/Wikipedia:Pages_for_deletion/ Disallow: /wiki/Wikipedia%3APages_for_deletion/ Disallow: /wiki/Wikipedia:Miscellany_for_deletion/ Disallow: /wiki/Wikipedia%3AMiscellany_for_deletion/ Disallow: /wiki/Wikipedia:Miscellaneous_deletion/ Disallow: /wiki/Wikipedia%3AMiscellaneous_deletion/ Disallow: /wiki/Wikipedia:Copyright_problems Disallow: /wiki/Wikipedia%3ACopyright_problems Disallow: /wiki/Wikipedia:Protected_titles/ Disallow: /wiki/Wikipedia%3AProtected_titles/ # T15398 Disallow: /wiki/Wikipedia:WikiProject_Spam/ Disallow: /wiki/Wikipedia%3AWikiProject_Spam/ # T16075 Disallow: /wiki/MediaWiki:Spam-blacklist Disallow: /wiki/MediaWiki%3ASpam-blacklist Disallow: /wiki/MediaWiki_talk:Spam-blacklist Disallow: /wiki/MediaWiki_talk%3ASpam-blacklist # T13261 Disallow: /wiki/Wikipedia:Requests_for_arbitration/ Disallow: /wiki/Wikipedia%3ARequests_for_arbitration/ Disallow: /wiki/Wikipedia:Requests_for_comment/ Disallow: /wiki/Wikipedia%3ARequests_for_comment/ Disallow: /wiki/Wikipedia:Requests_for_adminship/ Disallow: /wiki/Wikipedia%3ARequests_for_adminship/ # T12288 Disallow: /wiki/Wikipedia_talk:Articles_for_deletion/ Disallow: /wiki/Wikipedia_talk%3AArticles_for_deletion/ Disallow: /wiki/Wikipedia_talk:Votes_for_deletion/ Disallow: /wiki/Wikipedia_talk%3AVotes_for_deletion/ Disallow: /wiki/Wikipedia_talk:Pages_for_deletion/ Disallow: /wiki/Wikipedia_talk%3APages_for_deletion/ Disallow: /wiki/Wikipedia_talk:Miscellany_for_deletion/ Disallow: /wiki/Wikipedia_talk%3AMiscellany_for_deletion/ Disallow: /wiki/Wikipedia_talk:Miscellaneous_deletion/ Disallow: /wiki/Wikipedia_talk%3AMiscellaneous_deletion/ # T16793 Disallow: /wiki/Wikipedia:Changing_username Disallow: /wiki/Wikipedia%3AChanging_username Disallow: /wiki/Wikipedia:Changing_username/ Disallow: /wiki/Wikipedia%3AChanging_username/ Disallow: /wiki/Wikipedia_talk:Changing_username Disallow: /wiki/Wikipedia_talk%3AChanging_username Disallow: /wiki/Wikipedia_talk:Changing_username/ Disallow: /wiki/Wikipedia_talk%3AChanging_username/ # # eswiki: # T8746 Disallow: /wiki/Wikipedia:Consultas_de_borrado/ Disallow: /wiki/Wikipedia%3AConsultas_de_borrado/ # # fiwiki: # T10695 Disallow: /wiki/Wikipedia:Poistettavat_sivut Disallow: /wiki/K%C3%A4ytt%C3%A4j%C3%A4: Disallow: /wiki/Käyttäjä: Disallow: /wiki/Keskustelu_k%C3%A4ytt%C3%A4j%C3%A4st%C3%A4: Disallow: /wiki/Keskustelu_käyttäjästä: Disallow: /wiki/Wikipedia:Yll%C3%A4pit%C3%A4j%C3%A4t/ Disallow: /wiki/Wikipedia:Ylläpitäjät/ # # hewiki: Disallow: /wiki/%D7%9E%D7%99%D7%95%D7%97%D7%93:Search Disallow: /wiki/%D7%9E%D7%99%D7%95%D7%97%D7%93%3ASearch #T11517 Disallow: /wiki/ויקיפדיה:רשימת_מועמדים_למחיקה/ Disallow: /wiki/ויקיפדיה%3Aרשימת_מועמדים_למחיקה/ Disallow: /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94:%D7%A8%D7%A9%D7%99%D7%9E%D7%AA_%D7%9E%D7%95%D7%A2%D7%9E%D7%93%D7%99%D7%9D_%D7%9C%D7%9E%D7%97%D7%99%D7%A7%D7%94/ Disallow: /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%A8%D7%A9%D7%99%D7%9E%D7%AA_%D7%9E%D7%95%D7%A2%D7%9E%D7%93%D7%99%D7%9D_%D7%9C%D7%9E%D7%97%D7%99%D7%A7%D7%94/ Disallow: /wiki/ויקיפדיה:ערכים_לא_קיימים_ומוגנים Disallow: /wiki/ויקיפדיה%3Aערכים_לא_קיימים_ומוגנים Disallow: /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94:%D7%A2%D7%A8%D7%9B%D7%99%D7%9D_%D7%9C%D7%90_%D7%A7%D7%99%D7%99%D7%9E%D7%99%D7%9D_%D7%95%D7%9E%D7%95%D7%92%D7%A0%D7%99%D7%9D Disallow: /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%A2%D7%A8%D7%9B%D7%99%D7%9D_%D7%9C%D7%90_%D7%A7%D7%99%D7%99%D7%9E%D7%99%D7%9D_%D7%95%D7%9E%D7%95%D7%92%D7%A0%D7%99%D7%9D Disallow: /wiki/ויקיפדיה:דפים_לא_קיימים_ומוגנים Disallow: /wiki/ויקיפדיה%3Aדפים_לא_קיימים_ומוגנים Disallow: /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94:%D7%93%D7%A4%D7%99%D7%9D_%D7%9C%D7%90_%D7%A7%D7%99%D7%99%D7%9E%D7%99%D7%9D_%D7%95%D7%9E%D7%95%D7%92%D7%A0%D7%99%D7%9D Disallow: /wiki/%D7%95%D7%99%D7%A7%D7%99%D7%A4%D7%93%D7%99%D7%94%3A%D7%93%D7%A4%D7%99%D7%9D_%D7%9C%D7%90_%D7%A7%D7%99%D7%99%D7%9E%D7%99%D7%9D_%D7%95%D7%9E%D7%95%D7%92%D7%A0%D7%99%D7%9D # # huwiki: Disallow: /wiki/Speci%C3%A1lis:Search Disallow: /wiki/Speci%C3%A1lis%3ASearch # # itwiki: # T7545 Disallow: /wiki/Wikipedia:Pagine_da_cancellare Disallow: /wiki/Wikipedia%3APagine_da_cancellare Disallow: /wiki/Wikipedia:Utenti_problematici Disallow: /wiki/Wikipedia%3AUtenti_problematici Disallow: /wiki/Wikipedia:Vandalismi_in_corso Disallow: /wiki/Wikipedia%3AVandalismi_in_corso Disallow: /wiki/Wikipedia:Amministratori Disallow: /wiki/Wikipedia%3AAmministratori Disallow: /wiki/Wikipedia:Proposte_di_cancellazione_semplificata Disallow: /wiki/Wikipedia%3AProposte_di_cancellazione_semplificata Disallow: /wiki/Categoria:Da_cancellare_subito Disallow: /wiki/Categoria%3ADa_cancellare_subito Disallow: /wiki/Wikipedia:Sospette_violazioni_di_copyright Disallow: /wiki/Wikipedia%3ASospette_violazioni_di_copyright Disallow: /wiki/Categoria:Da_controllare_per_copyright Disallow: /wiki/Categoria%3ADa_controllare_per_copyright Disallow: /wiki/Progetto:Rimozione_contributi_sospetti Disallow: /wiki/Progetto%3ARimozione_contributi_sospetti Disallow: /wiki/Categoria:Da_cancellare_subito_per_violazione_integrale_copyright Disallow: /wiki/Categoria%3ADa_cancellare_subito_per_violazione_integrale_copyright Disallow: /wiki/Progetto:Cococo Disallow: /wiki/Progetto%3ACococo Disallow: /wiki/Discussioni_progetto:Cococo Disallow: /wiki/Discussioni_progetto%3ACococo # # jawiki Disallow: /wiki/%E7%89%B9%E5%88%A5:Search Disallow: /wiki/%E7%89%B9%E5%88%A5%3ASearch # T7239 Disallow: /wiki/Wikipedia:%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC/ Disallow: /wiki/Wikipedia%3A%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC/ Disallow: /wiki/Wikipedia:%E5%88%A9%E7%94%A8%E8%80%85%E3%83%9A%E3%83%BC%E3%82%B8%E3%81%AE%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC Disallow: /wiki/Wikipedia%3A%E5%88%A9%E7%94%A8%E8%80%85%E3%83%9A%E3%83%BC%E3%82%B8%E3%81%AE%E5%89%8A%E9%99%A4%E4%BE%9D%E9%A0%BC # nowiki # T13432 Disallow: /wiki/Bruker: Disallow: /wiki/Bruker%3A Disallow: /wiki/Brukerdiskusjon Disallow: /wiki/Wikipedia:Administratorer Disallow: /wiki/Wikipedia%3AAdministratorer Disallow: /wiki/Wikipedia-diskusjon:Administratorer Disallow: /wiki/Wikipedia-diskusjon%3AAdministratorer Disallow: /wiki/Wikipedia:Sletting Disallow: /wiki/Wikipedia%3ASletting Disallow: /wiki/Wikipedia-diskusjon:Sletting Disallow: /wiki/Wikipedia-diskusjon%3ASletting # # plwiki # T10067 Disallow: /wiki/Wikipedia:Strony_do_usuni%C4%99cia Disallow: /wiki/Wikipedia%3AStrony_do_usuni%C4%99cia Disallow: /wiki/Wikipedia:Do_usuni%C4%99cia Disallow: /wiki/Wikipedia%3ADo_usuni%C4%99cia Disallow: /wiki/Wikipedia:SDU/ Disallow: /wiki/Wikipedia%3ASDU/ Disallow: /wiki/Wikipedia:Strony_podejrzane_o_naruszenie_praw_autorskich Disallow: /wiki/Wikipedia%3AStrony_podejrzane_o_naruszenie_praw_autorskich # # ptwiki: # T7394 Disallow: /wiki/Wikipedia:Páginas_para_eliminar/ Disallow: /wiki/Wikipedia:P%C3%A1ginas_para_eliminar/ Disallow: /wiki/Wikipedia%3AP%C3%A1ginas_para_eliminar/ Disallow: /wiki/Wikipedia_Discussão:Páginas_para_eliminar/ Disallow: /wiki/Wikipedia_Discuss%C3%A3o:P%C3%A1ginas_para_eliminar/ Disallow: /wiki/Wikipedia_Discuss%C3%A3o%3AP%C3%A1ginas_para_eliminar/ # # rowiki: # T14546 Disallow: /wiki/Wikipedia:Pagini_de_%C5%9Fters Disallow: /wiki/Wikipedia%3APagini_de_%C5%9Fters Disallow: /wiki/Discu%C5%A3ie_Wikipedia:Pagini_de_%C5%9Fters Disallow: /wiki/Discu%C5%A3ie_Wikipedia%3APagini_de_%C5%9Fters # # ruwiki: Disallow: /wiki/%D0%A1%D0%BF%D0%B5%D1%86%D0%B8%D0%B0%D0%BB%D1%8C%D0%BD%D1%8B%D0%B5:Search Disallow: /wiki/%D0%A1%D0%BF%D0%B5%D1%86%D0%B8%D0%B0%D0%BB%D1%8C%D0%BD%D1%8B%D0%B5%3ASearch # # svwiki: # T12229 Disallow: /wiki/Wikipedia%3ASidor_f%C3%B6reslagna_f%C3%B6r_radering Disallow: /wiki/Wikipedia:Sidor_f%C3%B6reslagna_f%C3%B6r_radering Disallow: /wiki/Wikipedia:Sidor_föreslagna_för_radering Disallow: /wiki/Användare Disallow: /wiki/Anv%C3%A4ndare Disallow: /wiki/Användardiskussion Disallow: /wiki/Anv%C3%A4ndardiskussion Disallow: /wiki/Wikipedia:Skyddade_sidnamn Disallow: /wiki/Wikipedia%3ASkyddade_sidnamn # T13291 Disallow: /wiki/Wikipedia:Sidor_som_bör_raderas Disallow: /wiki/Wikipedia:Sidor_som_b%C3%B6r_raderas Disallow: /wiki/Wikipedia%3ASidor_som_b%C3%B6r_raderas # # zhwiki: # T7104 Disallow: /wiki/Wikipedia:删除投票/侵权 Disallow: /wiki/Wikipedia:%E5%88%A0%E9%99%A4%E6%8A%95%E7%A5%A8/%E4%BE%B5%E6%9D%83 Disallow: /wiki/Wikipedia:删除投票和请求 Disallow: /wiki/Wikipedia:%E5%88%A0%E9%99%A4%E6%8A%95%E7%A5%A8%E5%92%8C%E8%AF%B7%E6%B1%82 Disallow: /wiki/Category:快速删除候选 Disallow: /wiki/Category:%E5%BF%AB%E9%80%9F%E5%88%A0%E9%99%A4%E5%80%99%E9%80%89 Disallow: /wiki/Category:维基百科需要翻译的文章 Disallow: /wiki/Category:%E7%BB%B4%E5%9F%BA%E7%99%BE%E7%A7%91%E9%9C%80%E8%A6%81%E7%BF%BB%E8%AF%91%E7%9A%84%E6%96%87%E7%AB%A0 # # sister projects # # enwikinews: # T7340 Disallow: /wiki/Portal:Prepared_stories/ Disallow: /wiki/Portal%3APrepared_stories/ # # itwikinews # T11138 Disallow: /wiki/Wikinotizie:Richieste_di_cancellazione Disallow: /wiki/Wikinotizie:Sospette_violazioni_di_copyright Disallow: /wiki/Categoria:Da_cancellare_subito Disallow: /wiki/Categoria:Da_cancellare_subito_per_violazione_integrale_copyright Disallow: /wiki/Wikinotizie:Storie_in_preparazione # # enwikiquote: # T17095 Disallow: /wiki/Wikiquote:Votes_for_deletion/ Disallow: /wiki/Wikiquote%3AVotes_for_deletion/ Disallow: /wiki/Wikiquote_talk:Votes_for_deletion/ Disallow: /wiki/Wikiquote_talk%3AVotes_for_deletion/ Disallow: /wiki/Wikiquote:Votes_for_deletion_archive/ Disallow: /wiki/Wikiquote%3AVotes_for_deletion_archive/ Disallow: /wiki/Wikiquote_talk:Votes_for_deletion_archive/ Disallow: /wiki/Wikiquote_talk%3AVotes_for_deletion_archive/ # # enwikibooks Disallow: /wiki/Wikibooks:Votes_for_deletion # # working... Disallow: /wiki/Fundraising_2007/comments # # # #----------------------------------------------------------# # # #
Following keywords were found. You can check the keyword optimization of this page for each keyword.
Please select one of the following options for your request.
None of these options suit your need?
You can also download our Quick Start Guide, visit the FAQ section, our Knowledge Base or Blog.
Meta Title
(Nice to have)