robots-txt-ai-crawler-audit

io.github.jmshinhwa/robots-txt-ai-crawler-audit

95

security score

Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI

1.0

MaintainedVerified

GitHub stars

1

Last commit

1 week ago

Transport

stdio

Security scan

Last scanned 2 weeks ago — static analysis of the published manifest.

lowManifest makes network requests.