Robots.txt Validator logoRobots.txt Validator

Will a crawler reach your URL?

Paste your robots.txt and the URLs you want to check. We’ll show you what’s allowed, what’s blocked, and the exact rule behind each result.

Start testing How it works

robots.txt content

Editor

Paste your robots.txt content above (plain text, not a file).