Policy testing
Robots AI Policy Simulator
Paste or upload robots.txt text, choose an AI product token and path, and see which group and rule determines the simulated policy result.
No live fetch · no upload · deterministic policy trace
Workbench
Simulate a robots decision
Use the exact file text and request path you want to evaluate.
Loading the browser-local simulator…
Methodology
Trace group selection and rule precedence
The parser distinguishes robots product tokens from observed HTTP user-agents, selects the applicable group, and applies the documented allow/disallow path precedence. The result includes the winning line and normalized path.
Limitations
Robots policy is voluntary guidance
The simulation describes the supplied text; it does not fetch a live file, verify deployment, enforce access control, or prove that any crawler will comply. Product tokens that appear only in robots documentation are not reported as HTTP identities.