robots.txt Tester

Paste your robots.txt to catch crawl-blocking mistakes, missing sitemaps and syntax slips before Google does.