Log analysis
AI Crawler Log Analyzer
Stream supported access logs in your browser and aggregate recognized crawler requests by provider, evidence class, status, path, and reporting period.
Raw logs stay local · bounded parsing · cancel at any time
Workbench
Analyze a supported log export
Select the documented format, map required fields, and review coverage first.
Loading the browser-local log analyzer…
Methodology
Stream records, reconcile totals, preserve unknowns
Supported formats are decoded incrementally in a dedicated worker. Every accepted, rejected, matched, unmatched, and limit-excluded record is counted. User-agent and optional published-range evidence are classified separately before bounded page aggregates are produced.
Limitations
Recognition does not establish authenticity
Nonmatching lines mean “not recognized by this registry,” not human traffic. A matching user-agent can be spoofed, logs may be incomplete, and crawler activity does not establish referral, citation, training use, or policy compliance.