Not rocket science, but simple and efficient.
Just provide your main site URL, and it will get the corresponding live robots.txt file and analyse it for you, and tell you:
- if any unknown rule found
- if any contradiction between the rules found
- or unclear rule found
The big plus: you can do the test by simulating either Googlebot, Bingbot, Yandex, DuckDuckBot, Baiduspider, Slurp, Sogou, Exabot, ia_archiver, AhrefsBot, MJ12bot, SemrushBot, SEOkicks-Robot, BLEXBot, DotBot, rogerbot, SeznamBot, Screaming Frog, SiteCheckerBot, Wotbox and UptimeRobot
Free, No Download/Install required, No registration
