Robots.txt Rule Tester
Test basic Allow and Disallow rules for a chosen crawler and path.
Your workspace
This tool is part of Pro.
Get all 60 tools and a higher daily allowance with Pro, or choose Pro Max for no daily run cap.
Explore plans ↗Result
About the Robots.txt Rule Tester
Test basic Allow and Disallow rules for a chosen crawler and path. This tool is designed for a specific part of your SEO workflow and works directly in a modern browser.
Check the details before publishing
Review generated files and directives in the context of your own website. Crawl controls do not protect private data. These tools process pasted source or user-entered URLs; they do not crawl remote websites or test your server.
Review before you publish
Use your own content instead of the example values. Confirm that the result matches your page and intended use. Processing stays in this tab; resetting or leaving the page clears the workspace.