🤖
Robots.txt Live Simulator & Validator
MarketingTest whether URLs are allowed or blocked by any robots.txt rules before you deploy. 100% client-side.
100% client-side
robots.txt simulator · Google-style path matching
Paste robots.txt, pick a crawler user-agent, and test URLs before deploy — longest matching Allow/Disallow wins, with wildcard and $ support.
Simulating as: Googlebot
Groups
2
Sitemaps
0
Allowed
6
Blocked
0
Simulation results (6)
| Status | URL | Path tested | Matched rule | |
|---|---|---|---|---|
| Allow | https://www.example.com/ | / | — | |
| Allow | https://www.example.com/admin/dashboard | /admin/dashboard | — | |
| Allow | https://www.example.com/docs/public/guide | /docs/public/guide | — | |
| Allow | https://www.example.com/private/share/link | /private/share/link | allow /private/share/ (L7) | |
| Allow | https://www.example.com/assets/app.js | /assets/app.js | — | |
| Allow | https://www.example.com/report.pdf | /report.pdf | — |
Sponsored