Separate people from machines
See what search engines actually fetch, and prove it was them.
Any request can claim to be a search engine. Verification checks the claim against the operator's published address ranges and a reverse lookup of the requesting address before it is counted as a crawler. Crawl reporting then rests on confirmed identity rather than a header anyone can set.
Search Crawlers
- Operator verification by published ranges
- Crawl volume by site section
- Status codes served to crawlers
- Time from publish to first crawl
How it helps
What Search Crawlers gives you
Verified, not claimed
Impersonating a well-known crawler is one of the oldest ways for automated traffic to look legitimate. A request that fails verification is classified as automation and reported there, not quietly counted as a crawl.
Crawl budget, by section
Crawl frequency per site area, what gets refetched daily, and what has not been touched in weeks. The pages a search engine ignores are usually a structural problem, and they are invisible in a report that counts only visits.
What the crawler was served
Status codes, redirects and response times as delivered to verified crawlers specifically. A section returning 404s or timing out for a crawler shows up here as a delivery fault, while it is still a fetch problem rather than a ranking question.
Traffic Quality
The rest of Traffic Quality
Classify every request as human, crawler, AI agent, bot or attack before it is counted.
Real People
The human-only view every other module counts and divides by.
Learn moreAI Crawlers
AI-agent crawl volume and the content areas being read — not the same as a referral.
Learn moreBots
Monitors, scrapers, feed readers, link previews and your own tooling, classified by behaviour.
Learn moreSecurity Traffic
Suspicious requests with challenge outcome and reputation context, read as analytics rather than alerts.
Learn moreBlocked Attacks
Attack volume summarised for analytics, with the forensics handed to the edge console.
Learn moreConnect a site today. Read tomorrow's brief instead of building it.
Connect a site and the first brief arrives with the day's changes already explained — traffic separated from bots, conversions attached to revenue, and the evidence behind every sentence one click away.
Real people separated from bots Every answer shows its evidence Reveliqo runs on Reveliqo