Trees.org - SEO Check

Meta Tags

Medienliste

Überschriftenstruktur

Gefundene Links auf dieser Seite

HTTP-Header

Links von Wikipedia

• Freshney Place
• Ivonbrook Grange
• Joseph Taylor (folk singer)
• KMD Brands
• List of department stores of the United Kingdom
• Munchkin (company)
• Paulownia
• Tree planting
• Trees for the Future

Robots.txt

# ==============================
# GLOBAL RULES FOR ALL BOTS
# ==============================

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

# Block internal search result pages (thin & duplicate content)
Disallow: /*?s=
Disallow: /*&s=

# Block comment reply links (avoid crawl bloat)
Disallow: /*?replytocom=

# Block media attachment URLs unless you're optimizing media SEO
Disallow: /*?attachment_id=

# Block tracking and social sharing parameters (duplicate URLs)
Disallow: /*?share=
Disallow: /*?fbclid=
Disallow: /*?utm_*
Disallow: /*&utm_*

# Block non-SEO-relevant file types
Disallow: /*.php$
Disallow: /*.cgi$

# Block preview and default permalink structures (non-canonical)
Disallow: /*preview=true
Disallow: /?p=

# Block feeds (unless intentionally used for RSS SEO)
Disallow: /feed/
Disallow: /comments/feed/

# Optional: Block archives if not optimized for SEO
Disallow: /tag/

# ==============================
# SEO TOOL BOTS — CONTROLLED CRAWL
# ==============================

# AhrefsBot — slow it down to reduce server load
User-agent: AhrefsBot
Crawl-delay: 10

# SemrushBot — slow it down for crawl efficiency
User-agent: SemrushBot
Crawl-delay: 10

# ==============================
# BLOCK OTHER NON-VALUE BOTS
# ==============================

# MJ12bot — heavy crawler, no SEO value
User-agent: MJ12bot
Disallow: /

# DotBot — commercial crawler, unnecessary
User-agent: DotBot
Disallow: /

# Baiduspider — only allow if targeting China (not needed)
User-agent: Baiduspider
Disallow: /

# GPTBot — blocks AI content scraping for model training
User-agent: GPTBot
Disallow: /

# ==============================
# GOOGLE ADSBOT SPECIFIC RULE
# ==============================

# Google AdsBot — block internal search URLs only
User-agent: AdsBot-Google
Disallow: /*?s=

# ==============================
# SITEMAP LOCATION
# ==============================

Sitemap: https://trees.org/sitemap_index.xml

Suchvorschau