Tweekscycles.com - SEO Checker

Meta tags

Media list

Heading structure

Found links on this page

HTTP Response Header

Links from Wikipedia

Robots.txt

# Crawlers Setup
User-agent: *
Crawl-delay: 20

Disallow: */shop-by/
Allow: */shop-by/page/
Allow: */shop-by/categories/*/page/
Allow: /*/*/*/*/shop-by/brand/
Allow: /*/*/*/shop-by/brand/
Disallow: /*/*/*/*/shop-by/brand/*,*/
Disallow: /*/*/*/shop-by/brand/*,*/
Disallow: /uk/*/*/shop-by/brand/
Disallow: /us/*/*/shop-by/brand/
Disallow: /au/*/*/shop-by/brand/
Disallow: /jp/*/*/shop-by/brand/
Disallow: /ca/*/*/shop-by/brand/
Disallow: /eu/*/*/shop-by/brand/

# Directories
Disallow: /404/
Disallow: /app/
Disallow: /cgi-bin/
Disallow: /downloader/
Disallow: /includes/
Disallow: /lib/
Disallow: /pkginfo/
Disallow: /report/
Disallow: /magento/
Disallow: /stats/
Disallow: /var/

# Paths (clean URLs)
Disallow: /index.php/
Disallow: /catalog/product_compare/
Disallow: /catalog/category/view/
Disallow: /catalog/product/view/
Disallow: /catalogsearch/
Disallow: /checkout/
Disallow: /control/
Disallow: /contacts/
Disallow: /customer/
Disallow: /wishlist/
Disallow: /review/
Disallow: /sendfriend/
Disallow: /tag/
Disallow: /search/*
Disallow: /sales/

# Paths (no clean URLs)
Disallow: /*?p=*&

# Remove Parameters 

Disallow: /*?q=*
Disallow: /*?r=*
Disallow: /*?f=*
Disallow: /*?ki=*
Disallow: /*?awc*
Disallow: /*?cat*
Disallow: /*?bcd*
Disallow: /*?ved*
Disallow: /*?ssp*
Disallow: /*?brand*
Disallow: /*?dm_i*
Disallow: /*?size*
Disallow: /*?jhkj*
Disallow: /*?year*
Disallow: /*?aaaa*
Disallow: /*?dm_t*
Disallow: /*?badge*
Disallow: /*?width*
Disallow: /*?ratio*
Disallow: /*?teeth*
Disallow: /*?limit*
Disallow: /*?gender*
Disallow: /*?option*
Disallow: /*?fbclid*
Disallow: /*?method*
Disallow: /*?length*
Disallow: /*?wbraid*
Disallow: /*?travel*
Disallow: /*?secret*
Disallow: /*?&ilttc*
Disallow: /*?locale*
Disallow: /*?sefsef*
Disallow: /*?refine*
Disallow: /*?result*
Disallow: /*?mwg_rnd*
Disallow: /*?material*
Disallow: /*?diameter*
Disallow: /*?campaign*
Disallow: /*?compound*
Disallow: /*?_x_tr_sl*
Disallow: /*?hub_type*
Disallow: /*?operation*
Disallow: /*?grip_type*
Disallow: /*?&krm543tc*
Disallow: /*?discipline*
Disallow: /*?wheel_size*
Disallow: /*?utm_source*
Disallow: /*?brake_type*
Disallow: /*?drivetrain*
Disallow: /*?utm_medium*
Disallow: /*?mount_type*
Disallow: /*?cage_length*
Disallow: /*?utm_campaign*
Disallow: /*?colour_group*
Disallow: /*?tyre_fitment*
Disallow: /*?rim_material*
Disallow: /*?hub_drilling*
Disallow: /*?headset_type*
Disallow: /*?chainset_type*
Disallow: /*?bike_capacity*
Disallow: /*?darkschemeovr*
Disallow: /*?cassette_speed*
Disallow: /*?frame_material*
Disallow: /*?handlebar_rise*
Disallow: /*?cargo_capacity*
Disallow: /*?crank_arm_length*
Disallow: /*?battery_capacity*
Disallow: /*?bottom_bracket_type*



# Files
Disallow: /cron.php
Disallow: /cron.sh
Disallow: /error_log
Disallow: /install.php
Disallow: /LICENSE.html
Disallow: /LICENSE.txt
Disallow: /LICENSE_AFL.txt
Disallow: /STATUS.txt

# XML Sitemaps

Sitemap: https://www.tweekscycles.com/media/sitemaps/sitemap.xml

Search preview