Skip to content
mcp/harbor
Verified official

crawl readiness MCP

v0.2.3

io.github.grubbomatic/crawl-readiness

Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.

transport:stdio runtime:npm
View source Website

Target client

run in your project directory

Held in this page only — never stored, logged, or sent anywhere but back to your screen. 

claude mcp add crawl-readiness -e CRAWL_READINESS_API_KEY=<CRAWL_READINESS_API_KEY> -e CRAWL_READINESS_API_BASE=<CRAWL_READINESS_API_BASE> -- npx -y crawl-readiness-mcp

Adds it for this project only. Append --scope user to make it available everywhere. Claude Code docs

This listing does not declare its tools. Connect the server and your client will discover them on the handshake.