⚡ SEO & Schema · Client-side · No data sent to server

robots.txt Tester

Paste your robots.txt, choose a crawler, and test any URL or path to see whether it is allowed or blocked, and exactly which rule decided it. Uses the same longest-match and allow-wins logic Google applies. Runs entirely in your browser.

robots.txt

URLs or paths to test

Result
How the decision is made. Among the rules for the matching user-agent, the longest matching path wins; if an Allow and a Disallow tie, Allow wins. Wildcards * and end-anchor $ are supported. robots.txt controls crawling, not indexing: a blocked URL can still appear in results if linked elsewhere. Everything is computed in your browser.

Related seo & schema tools

Article Schema Generator Generate Article JSON-LD structured data. FAQ Schema Generator Generate FAQ JSON-LD structured data. HowTo Schema Generator Generate HowTo JSON-LD structured data. Product Schema Generator Generate Product JSON-LD structured data. Event Schema Generator Generate Event JSON-LD structured data. Breadcrumb Schema Generator Generate BreadcrumbList JSON-LD structured data.