Does the robots.txt rule tester upload my robots rules?

No. Inputs are processed in your browser, and pasted content is not sent to analytics or a server.

What should I paste into the robots.txt rule tester?

Enter a user agent, a URL path, and pasted robots.txt rules.

What can I copy or download?

You can copy the allow/disallow decision and winning rule.

What does the robots.txt rule tester not verify?

It does not fetch your live robots.txt, test rendered pages, guarantee indexing behavior, or model every crawler extension.

Robots.txt Rule Tester

Test a URL path against pasted robots.txt rules and explain the winning allow or disallow rule.

Also useful for: robots txt tester robots txt checker robots rule tester crawler allow disallow tester Robots.txt Rule Tester

Robots.txt Rule Tester

Runs in your browser. Inputs are not uploaded.

Robots.txt Rule Tester Example Run

Test whether a crawler can access a path.

Sample inputs
Test request
User agent: Googlebot
Path: /private/report.html

Rules
robots.txt rules:
User-agent: *
Disallow: /private/
Allow: /private/public/

Generated result
Summary: Googlebot is blocked for /private/report.html.

Stats
- Matching Rules: 1

Issues
- No issues found.

Output
User-agent: Googlebot
Path: /private/report.html
Decision: disallow
Winning rule: disallow: /private/

What the Robots.txt Rule Tester Checks

User-agent matching

The requested crawler is matched against explicit groups and wildcard groups.
Path rule matching

Allow and Disallow paths are compared with the test path.
Most specific rule

Matching rules are sorted so the longest applicable path wins, with allow winning ties.
Comment handling

Inline comments and blank lines are ignored while parsing rules.
Simplified scope

The tester does not fetch live robots.txt, evaluate crawl-delay, or emulate every crawler-specific extension.

Robots.txt Rule Tester Questions

View all questions

Q: Does the robots.txt rule tester upload my robots rules? A: No. Inputs are processed in your browser, and pasted content is not sent to analytics or a server.
Q: What should I paste into the robots.txt rule tester? A: Enter a user agent, a URL path, and pasted robots.txt rules.
Q: What can I copy or download? A: You can copy the allow/disallow decision and winning rule.
Q: What does the robots.txt rule tester not verify? A: It does not fetch your live robots.txt, test rendered pages, guarantee indexing behavior, or model every crawler extension.

Related Tools

Updates

v1.0.0 New 2026-05-17: Initial user-agent matching, path rule testing, and winning-rule explanation added.