- Crawl & indexation
- 14tests fired in this category
- modules
- 2dedicated crawl & indexation checks
- every scan
- 299+tests across all categories
Why it matters
Crawlability is the foundation layer. Before content, schema, or performance can matter, crawlers need a stable map of canonical URLs that return usable responses.
How it works
FixWeb combines robots.txt, sitemap discovery, rendered page status, final URLs, canonical tags, and robots meta directives from the browser crawl.
Site impact
A single accidental noindex, broken sitemap, or cross-host canonical can suppress important pages even when the page looks fine to a human visitor.
How to improve
Publish a valid sitemap, reference it from robots.txt, keep canonical tags self-consistent, remove accidental noindex directives, and monitor 4xx/5xx responses on important templates.