# # robots.txt # # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # # This file will be ignored unless it is at the root of your host: # Used: http://example.com/robots.txt # Ignored: http://example.com/site/robots.txt # # For more information about the robots.txt standard, see: # http://www.robotstxt.org/robotstxt.html # Restrict all user agents from using search filters User-agent: * Crawl-delay: 10 Disallow: *?f%5B* Disallow: *&f%5B* # CSS, JS, Images Allow: /misc/*.css$ Allow: /misc/*.css? Allow: /misc/*.js$ Allow: /misc/*.js? Allow: /misc/*.gif Allow: /misc/*.jpg Allow: /misc/*.jpeg Allow: /misc/*.png Allow: /modules/*.css$ Allow: /modules/*.css? Allow: /modules/*.js$ Allow: /modules/*.js? Allow: /modules/*.gif Allow: /modules/*.jpg Allow: /modules/*.jpeg Allow: /modules/*.png Allow: /profiles/*.css$ Allow: /profiles/*.css? Allow: /profiles/*.js$ Allow: /profiles/*.js? Allow: /profiles/*.gif Allow: /profiles/*.jpg Allow: /profiles/*.jpeg Allow: /profiles/*.png Allow: /themes/*.css$ Allow: /themes/*.css? Allow: /themes/*.js$ Allow: /themes/*.js? Allow: /themes/*.gif Allow: /themes/*.jpg Allow: /themes/*.jpeg Allow: /themes/*.png # Directories Disallow: /includes/ Disallow: /misc/ Disallow: /modules/ Allow: /profiles/openscholar/themes/ Disallow: /profiles/ Disallow: /scripts/ Disallow: /themes/ # Files Disallow: /CHANGELOG.txt Disallow: /cron.php Disallow: /INSTALL.mysql.txt Disallow: /INSTALL.pgsql.txt Disallow: /INSTALL.sqlite.txt Disallow: /install.php Disallow: /INSTALL.txt Disallow: /LICENSE.txt Disallow: /MAINTAINERS.txt Disallow: /update.php Disallow: /UPGRADE.txt Disallow: /xmlrpc.php # Paths (clean URLs) Disallow: /admin/ Disallow: /comment/reply/ Disallow: /filter/tips/ Disallow: /node/add/ Disallow: /search/ Disallow: /user/register/ Disallow: /user/password/ Disallow: /user/login/ Disallow: /user/logout/ # Paths (no clean URLs) Disallow: /?q=admin/ Disallow: /?q=comment/reply/ Disallow: /?q=filter/tips/ Disallow: /?q=node/add/ Disallow: /?q=search/ Disallow: /?q=user/password/ Disallow: /?q=user/register/ Disallow: /?q=user/login/ Disallow: /?q=user/logout/ # Dynamically added disallow rules Disallow: /atweb/ Disallow: /kahne/ Disallow: /shair/ Disallow: /annualmeeting/ Disallow: /advisingcorner/ Disallow: /huit-intranet/ Disallow: /uds-sensusaccess/ Disallow: /ivy/ Disallow: /soch/ Disallow: /resources/ Disallow: /itcrb/ Disallow: /academictech/ Disallow: /admin-enews/ Disallow: /projectdelivery/ Disallow: /learning/ Disallow: /unifiedcommunications/ Disallow: /mixedmethodsworkshop/ Disallow: /cavanaughlab/ Disallow: /employers/ Disallow: /advising_materials/ Disallow: /bokcenter-videos/ Disallow: /a_harvard_education/ Disallow: /hacc/ Disallow: /fasscit/ Disallow: /amdp-globalmap/ Disallow: /debivortlab/ Disallow: /able/ Disallow: /eric-heller/ Disallow: /facultysearch/ Disallow: /graduate_student_site/ Disallow: /fep/ Disallow: /osp-nfs/ Disallow: /admin-login/ Disallow: /govwrites/ Disallow: /posts/ Disallow: /spierce/ Disallow: /hbi-protected/ Disallow: /govteaches/ Disallow: /hsdmintranet/ Disallow: /hura/ Disallow: /susansuleiman/ Disallow: /procurement/ Disallow: /procurement-splash/ Disallow: /harvard_peer_advising_fellows/ Disallow: /olveczky-internal/ Disallow: /internal/ Disallow: /hoekstra-lab-internal/ Disallow: /webinars/ Disallow: /minerals/ Disallow: /ali2ndsite/ Disallow: /mrct-landing/ Disallow: /cwd_bic/ Disallow: /hmsc_resources/ Disallow: /campus_of_the_future/ Disallow: /jsinger/ Disallow: /oebinternal/ Disallow: /hwp-sample-academic-department/ Disallow: /academic_resources_student_advisory_board/ Disallow: /libsearching/ Disallow: /fad-ccs/ Disallow: /hwp-sample-department-minimal/ Disallow: /spectra/ Disallow: /secretsofthesiege/ Disallow: /radcliffe/ Disallow: /internalcontrols/ Disallow: /financialmanagersforum/ Disallow: /myfac/ Disallow: /msotest/ Disallow: /ldcnetwork/ Disallow: /redirects/ Disallow: /fingerprinting/ Disallow: /grs/ Disallow: /complit-intranet/ Disallow: /titleixreviewcommittee/ Disallow: /grid/ Disallow: /evp/ Disallow: /tlfwebinars/ Disallow: /huit-pmo-1/ Disallow: /academic/ Disallow: /publicservice/ Disallow: /huit-pmo/ Disallow: /huitintranet2/ Disallow: /cloudrevamp/ Disallow: /execed/ Disallow: /cloud2/ Disallow: /friedmanlab/ Disallow: /chemcmm/ Disallow: /drclasmcaoredirect/ Disallow: /beijing/ Disallow: /fsan/ Disallow: /currier/ Disallow: /bok/ Disallow: /harvardshorts/ Disallow: /community/ Disallow: /ccva/ Disallow: /ogcfaq/ Disallow: /hrpractitioners/ Disallow: /student-test/ Disallow: /rbarro/ Disallow: /alberto-alesina/ Disallow: /james-stock/ Disallow: /concentrations/ Disallow: /rll-tutoring/ Disallow: /ypo/ Disallow: /rogerfu/ Disallow: /leap/ Disallow: /grouper_demo/ Disallow: /officemanual/ Disallow: /classicsintranet/ Disallow: /metro-redirect/ Disallow: /texere/ Disallow: /kasper/ Disallow: /lish_temp/ Disallow: /matt/ Disallow: /tix/ Disallow: /bokcenter/ Disallow: /tdmtheowlanswers/ Disallow: /zhangtest/ Disallow: /2018pdsymposium/ Disallow: /cepr-sdp/ Disallow: /advisingfortnight/ Disallow: /reu/ Disallow: /b2p/ Disallow: /gdpr/ Disallow: /chge/ Disallow: /shinesummit/ Disallow: /ctrrtaskforce-temp/ Disallow: /gdprprivacy/ Disallow: /statistics/ Disallow: /resilience/ Disallow: /hbi-2/ Disallow: /kramertest1/ Disallow: /title-ix/ Disallow: /hcs/ Disallow: /insights/ Disallow: /share_shadow/ Disallow: /firstyear/ Disallow: /fdd/ Disallow: /emedesigntoolkit/ Disallow: /dso-redirect/ Disallow: /harvardhillelboard/ Disallow: /webpublishing/ Disallow: /case/ Disallow: /resilience-redirect/ Disallow: /resilience-consortium/ Disallow: /upolicies/ Disallow: /diversity/ Disallow: /sis/ Disallow: /labadminmanual/ Disallow: /halc-redirect/ Disallow: /halccom-redirect/ Disallow: /iq-redirect/ Disallow: /brochure/ Disallow: /hscrb/ Disallow: /henrytestsite/ Disallow: /titleixdisclosure/ Disallow: /maryslanguagecenter/ Disallow: /zaentz/ Disallow: /flag/ Disallow: /signs/ Disallow: /enterprisearchitecture/ Disallow: /edlabs/ Disallow: /hcf-fy15/ Disallow: /gsf/ Disallow: /bostonharborislands/ Disallow: /beatyaleweek/ Disallow: /lcassets/ Disallow: /haatestsite/ Disallow: /osl-redirect/ Disallow: /fdo-redirect/ Disallow: /osl/ Disallow: /soch-redirect/ Disallow: /thegame-redirect/ Disallow: /wintersession-redirect/ Disallow: /arcsign/ Disallow: /institutionalresearch/ Disallow: /fasadmin/ Disallow: /procurement-travel/ Disallow: /styleguide/ Disallow: /liaisons/ Disallow: /mahindra/ Disallow: /it-security-new/ Disallow: /edredesign-portal/ Disallow: /covid-19/ Disallow: /semiticmuseum-redirect/ Disallow: /semiticmuseum-redirect/ Disallow: /hupd-redirect/ Disallow: /brazil-drclas-redirect/ Disallow: /mx-drclas-redirect/ Disallow: /ro-drclas-redirect/ Disallow: /drclasregionaloffice/ Disallow: /drclasbraziloffice/ Disallow: /drclasmcaoffice/ Disallow: /parents-fas-redirect/ Disallow: /parents/ Disallow: /drclas/ Disallow: /dmca/ Disallow: /hilt/ Disallow: /collegeorientation/ Disallow: /hds-rpp/ Disallow: /hcf-fy21/ Disallow: /hds-intranet/ Disallow: /osp/ Disallow: /gsf-fy21/ Disallow: /lichens/ Disallow: /huri-tcup-events/ Disallow: /hds-temporary2/ Disallow: /accessibilitykey/ Disallow: /engagement/ Disallow: /2021gordonlabvirtualreunion/ Disallow: /ofa/ Disallow: /huit/ Disallow: /economics/ Disallow: /seo/ Disallow: /drewfaust/ Disallow: /central-payroll/ Disallow: /thesis/ Disallow: /erg/ Disallow: /ovpr-test/ Disallow: /titleix/ Disallow: /mahindra-ihum-usi/ Disallow: /huitintranet/ Disallow: /oie-test/ Disallow: /econ-campus-reboot/ Disallow: /nra/ Disallow: /ash-innovations-redirect/ Disallow: /biocaribe/ Disallow: /kahlilchaarperez/ Disallow: /harvardworks/ Disallow: /coldwarlinkages/ Disallow: /risk-services/ Disallow: /revista/ Disallow: /it-academy/ Disallow: /hppm/ Disallow: /haa-intranet/ Disallow: /fas-registrar/ Disallow: /hms-grad-ed/ Disallow: /resourceguide/ Disallow: /harvard-allston-redirect/ Disallow: /afvs-alumni/ Disallow: /guidelines/ Disallow: /ocs/ Disallow: /ocsemployers/ Disallow: /fascovid/ Disallow: /fashrtestsite/ Disallow: /harvardombuds-redirect/ Disallow: /privacystatement/ Disallow: /postdocs/ Disallow: /fas/ Disallow: /biodivtheraputics/ Disallow: /kate-test/ Disallow: /vpr-documents/ Disallow: /abcd-openscholar/ Disallow: /eatest/ Disallow: /gov/ Disallow: /hds-papyrus/ Disallow: /testsite/ Disallow: /sarah-horton-test/ Disallow: /harvardglobal/ Disallow: /memoriam/ Disallow: /museums/ Disallow: /cavtest/ Disallow: /datasmart-redirect/ Disallow: /mso/ Disallow: /hmstest/ Disallow: /marshal/ Disallow: /jhsma/ Disallow: /bhi/ Disallow: /cfar/ Disallow: /apo/ Disallow: /huit-iam-docs-redirect/ Disallow: /huit-iam-docs/ Disallow: /iri/ Disallow: /datascience/ Disallow: /assetslibrary/ Disallow: /chevant/ Disallow: /guilhermeribeiro/ Disallow: /sylvaineguyot/ Disallow: /mariagrazialolla/ Disallow: /amoc/ Disallow: /public_interested_conference/ Disallow: /harvardallstonland-com-redirect/ Disallow: /growthlab-redirect/ Disallow: /huit-temp/ Disallow: /domain-test/ Disallow: /artlab/ Disallow: /ndab-inquiry/ Disallow: /language-center/ Disallow: /complit/ Disallow: /video-studio/ Disallow: /christiemcdonald/ Disallow: /elviradifabio/ Disallow: /linopertile/ Disallow: /luisfernandezcifuentes/ Disallow: /marygaylord/ Disallow: /susanrubinsuleiman/ Disallow: /climatechange/ Disallow: /localchildrenscabinets/ Disallow: /test-site-1/ Disallow: /test-site-2/ Disallow: /edredesign/ Disallow: /accessibility/ Disallow: /cpl/ Disallow: /phone-redirect/ Disallow: /huit-uc/ Disallow: /islands-evolving-in-isolation/ Disallow: /msi/ Disallow: /stattest/ Disallow: /boyle/ Disallow: /huhs/ Disallow: /admininnovation/ Disallow: /hds_wsrp/ Disallow: /pearson/ Disallow: /trademark/ Disallow: /minors/ Disallow: /morejoy/ Disallow: /mbb-community/ Disallow: /petitions/ Disallow: /ethnic/ Disallow: /hwp3/ Disallow: /writingcenter/ Disallow: /cchr/ Disallow: /fas-hr/ Disallow: /ash/ Disallow: /peoplesoft/ Disallow: /spm/ Disallow: /fas_finance/ Disallow: /artshumanities/ Disallow: /artshumastudents/ Disallow: /ofr/ Disallow: /hds-online-learning/ Disallow: /message-me/ Disallow: /odrip/ Disallow: /test123/ Disallow: /harvardallstonland/ Disallow: /hds/ Disallow: /carlwunsch/ Disallow: /tormanhc2/ Disallow: /employeeresourcegroups/ Disallow: /digital-millennium-copyright-act/ Disallow: /procurement-vendors/ Disallow: /projectteach/ Disallow: /online-accessibility-huit/ Disallow: /healthpolicy/ Disallow: /svetlana-boym/ Disallow: /rcc/ Disallow: /ppsf/ Disallow: /testredir/ Disallow: /faculty-diversity/ Disallow: // Disallow: /engagedscholarship/ Disallow: /embouju/ Disallow: /getzeldavis/ Disallow: /rodrigocetinapresuel/ Disallow: /hssa/ Disallow: /sociology/ Disallow: /religion/ Disallow: /hds_cswr/ Disallow: /ece/ Disallow: /redirecttest/ Disallow: /staceykatzbourns/ Disallow: /virginiegreene/ Disallow: /clemencejouetpastre/ Disallow: /andreeamarculescu/ Disallow: /ericmechoulan/ Disallow: /sergiodelgado/ Disallow: /chiarafrenquellucci/ Disallow: /giulianaminghelli/ Disallow: /mylenepriam/ Disallow: /joserabasa/ Disallow: /nicolausevcenko/ Disallow: /bradepps/ Disallow: /garciapena/ Disallow: /heritagespanish/ Disallow: /stephenbocskay/ Disallow: /francoise_lionnet/ Disallow: /quantsocworkshop/ Disallow: /solutionspace-redirect/ Disallow: /carolebergin/ Disallow: /janetbeizer/ Disallow: /csre/ Disallow: /cultureworkshop/ Disallow: /ess/ Disallow: /membership1636/ Disallow: /anna-baranczak/ Disallow: /daria-khitrova/ Disallow: /elections/ Disallow: /english/ Disallow: /george-grabowicz/ Disallow: /john-malmstad/ Disallow: /jonathan-bolton/ Disallow: /julie-buckler/ Disallow: /justin-weir/ Disallow: /michael-flier/ Disallow: /natalia-chirkov/ Disallow: /natalia-pokrovsky/ Disallow: /patricia-chaput/ Disallow: /stephanie-sandler/ Disallow: /steven-clancy/ Disallow: /veronika-egorova/ Disallow: /veronika-tuckerova/ Disallow: /william-todd/ Disallow: /hupd/ Disallow: /cai/ Disallow: /camhs/ Disallow: /drclas2/ Disallow: /adrianagutierrez/ Disallow: /danielaguirreoteiza/ Disallow: /dianasorensen/ Disallow: /dorissommer/ Disallow: /francescoerspamer/ Disallow: /jeffreyschnapp/ Disallow: /joaquimfranciscocoelho/ Disallow: /johannaliander/ Disallow: /josiah-blackmore/ Disallow: /luisgironnegron/ Disallow: /marialuisaparra/ Disallow: /marianosiskind/ Disallow: /nicolemills/ Disallow: /rll/ Disallow: /tomconley/ Disallow: /verenaandermattconley/ Disallow: /fasro/ Disallow: /bertarelli/ Disallow: /facultyresources/ Disallow: /fly/ Disallow: /iccb/ Disallow: /slavic/ Disallow: /barthelmy/ Disallow: /375years/ Disallow: /cid-redirect/ Disallow: /essjconference/ Disallow: /hbshealthcare/ Disallow: /thebehnreport/ Disallow: /cwd-catalog/ Disallow: /pfister/ Disallow: /aja/ Disallow: /evp2/ Disallow: /fromm/ Disallow: /semitic/ Disallow: /1636society/ Disallow: /chaucer/ Disallow: /servicetosociety/ Disallow: /romance/ Disallow: /desai/ Disallow: /early-evolution/ Disallow: /hii/ Disallow: /holm/ Disallow: /jesm/ Disallow: /mccarthylab/ Disallow: /moorcrofttest/ Disallow: /william-klemperer/ Disallow: /espp/ Disallow: /mqi-coaching/ Disallow: /ncrern/ Disallow: /volodymyr-dibrova/ Disallow: /odr/ Disallow: /makeart/ Disallow: /student-employment-office/ Disallow: /profdev/ Disallow: /kasperlab/ Disallow: /lowell/ Disallow: /phi-beta-kappa/ Disallow: /hcwp/ Disallow: /hwp/ Disallow: /digital-content-connect/ Disallow: /success/ Disallow: /history-artsarchitecture/ Disallow: /huri/ Disallow: /hsdmresourcelibrary/ Disallow: /hmnh/ Disallow: /ves/ Disallow: /dudleyundergrad/ Disallow: /zhanglab/ Disallow: /mgr/ Disallow: /bgltq_test/ Disallow: /dunster/ Disallow: /fof/ Disallow: /giribetlab/ Disallow: /dental/ Disallow: /moderngreekstudies/ Disallow: /moorcroftlab/ Disallow: /publishing/ Disallow: /wakeleylab/ Disallow: /huit-maintenance/ Disallow: /biewener/ Disallow: /cavanaugh/ Disallow: /cfs/ Disallow: /crompton/ Disallow: /davislab/ Disallow: /edwards/ Disallow: /farrell/ Disallow: /haig/ Disallow: /hankenlab/ Disallow: /hartllab/ Disallow: /hoekstra/ Disallow: /holbrook/ Disallow: /iwl/ Disallow: /kramerlab/ Disallow: /hds_library/ Disallow: /library/ Disallow: /linguistics/ Disallow: /malletlab/ Disallow: /mcz/ Disallow: /olveczky/ Disallow: /ortega-hernandezlab/ Disallow: /pbi/ Disallow: /peabody/ Disallow: /dpfister/ Disallow: /pierce/ Disallow: /aleksandra-kremer/ Disallow: /carriquiry/ Disallow: /cltl2022/ Disallow: /islands/ Disallow: /aizenberg/ Disallow: /biodivtherapeutics/ Disallow: /classics/ Disallow: /davieslab/ Disallow: /diatoms/ Disallow: /herbaria/ Disallow: /oeb/ Disallow: /oeb-reu/ Disallow: /taylorlab/ Disallow: /germanic/ Disallow: /mapa/ Disallow: /provingground/ Disallow: /hgsu/ Disallow: /myers/ Disallow: /hds2/ Disallow: /shakhnovich/ Disallow: /advisorypanel/ Disallow: /commencement/ Disallow: /dynan/ Disallow: /walker/ Disallow: /dudley-herschbach/ Disallow: /elias-corey/ Disallow: /friend-lab/ Disallow: /gordon/ Disallow: /martin-karplus/ Disallow: /chemistry/ Disallow: /chinaproject/ Disallow: /china-cn/ Disallow: /humanitarianinitiative/ Disallow: /econ/ Disallow: /humanresources/ Disallow: /it-security/ Disallow: /david-showalter/ Disallow: /histpol/ Disallow: /hms-masters-student-handbook/ Disallow: /htf/ Disallow: /quest/ Disallow: /sgrp/ Disallow: /stories/ Disallow: /tkg/ Disallow: /eps/ Disallow: /150/ Disallow: /camoes/ Disallow: /farlow100/ Disallow: /itsummit/ Disallow: /oralhealthprimarycare/ Allow: /files/pluralism/files Disallow: /files/*/files
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)