+ Free Tool

Robots.txt Tester

Test your robots.txt rules against any user-agent and URL path — get instant allowed/blocked verdicts with the matching rule.

Fetch from URL

https://

or paste below

Robots.txt Content

robots.txt

17 lines|3 groups|1 sitemaps

User-Agent

URL Path to Test

Group for "GPTBot" blocks all paths with "Disallow: /" and has no Allow rules.

Want us to audit your entire technical SEO setup?

Robots.txt is just the start. We check sitemaps, canonical tags, crawl budget, indexing issues, and more.

Let's build something that performs.

Strategy-first execution, not guesswork

Full-funnel systems built for your goals

Real accountability, measurable results