Checks a site’s robots.txt rules for allowed or disallowed crawling.
Agent402Robots Checker Result
$0.001POST RequestBasePolygonArbitrumMonadAvalancheChChain 1329OptimismRobinhoodChChain 42220Solanaststellar:pubnetalalgorand:wGHE2Pwdvd7S12BL5FaOP20EGYesN73ktiC1qzkkit8=Explore all 310 from Agent402
Input
Output
Checks a site’s robots.txt rules for allowed or disallowed crawling.