Live Crawler
Live site crawl — 404 / 500 / broken-image / redirect-chain on the live URL.
One of 122 modules in the GateTest scan suite. Catches the issue before it reaches code review, and on paid tiers opens a pull request with the fix already written.
/blog/old-post → 3 redirects → 404
Why we catch it
Surfacing the user-visible problems static analysis usually pretends don't exist.
The Live Crawler module sits in this category alongside 6 related modules. Together they form one of the layers of a GateTest scan — checks fire in parallel, findings cluster by root cause, and on paid tiers the AI auto-fix loop reads each finding, writes the fix, validates against the scanner, and opens a PR.
How GateTest covers live crawler
- Forensic tier only. Forensic ($399) only — it is part of the deeper nuclear suite. Full and Scan + Fix do not run it. It also runs in the live-URL scanners — the website scan ($29 full report) and the WordPress health check ($19). No additional configuration.
- Free CLI.
npm i -g @gatetest/cli && gatetest --module liveCrawleragainst any local repo. No paywall on the scanning itself. - AI auto-fix PR. Scan + Fix tier opens a pull request with the fix, a regression test, and a pair-review by a second AI reviewer. Forensic Scan tier adds per-finding diagnosis and cross-finding attack-chain correlation.
- Honest confidence rating. Findings come with high / medium / low confidence so noisy patterns don't block the gate. The confidence-calibrator trainer reads customer suppressions and tightens rules over time.
Scan your repo for live crawler
Free preview of the headline findings. Pay per scan, not per seat — one-time scans never auto-renew.
Frequently asked questions
What does the Live Crawler module catch?
Live site crawl — 404 / 500 / broken-image / redirect-chain on the live URL. Example finding: /blog/old-post → 3 redirects → 404
Does GateTest fix Live Crawler issues automatically?
Yes — on the Scan + Fix tier ($199) and Forensic Scan tier ($399), the fix engine reads the finding, writes the fix, validates against the scanner, writes a regression test, and opens a pull request for your review.
Which tiers include the Live Crawler module?
Forensic ($399) only — it is part of the deeper nuclear suite. Full and Scan + Fix do not run it. It also runs in the live-URL scanners — the website scan ($29 full report) and the WordPress health check ($19).
Can I run the Live Crawler module from the CLI for free?
Yes — install with `npm i -g @gatetest/cli` and run `gatetest --module liveCrawler`. The local CLI is free; paid tiers add AI auto-fix and the cross-finding correlation work.