+ Free Tool

Robots.txt Tester

Test your robots.txt rules against any user-agent and URL path — get instant allowed/blocked verdicts with the matching rule.

Fetch from URL

https://

or paste below

Robots.txt Content

robots.txt

17 lines|3 groups|1 sitemaps

User-Agent

URL Path to Test

Group for "GPTBot" blocks all paths with "Disallow: /" and has no Allow rules.

Want us to audit your entire technical SEO setup?

Robots.txt is just the start. We check sitemaps, canonical tags, crawl budget, indexing issues, and more.

Find the 3 leaks most likely to cost you demos.

A 48-hour conversion teardown before you commit

Clear scope, timeline, and next-step plan

Design, development, and CRO handled for you