Skip to content
mcp/harbor
Claude Code

crawl readiness for Claude Code

io.github.grubbomatic/crawl-readiness

Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.

client:Claude Code transport:stdio runtime:npm

Install crawl readiness in Claude Code

run in your project directory

Held in this page only — never stored, logged, or sent anywhere but back to your screen. 

claude mcp add crawl-readiness -e CRAWL_READINESS_API_KEY=<CRAWL_READINESS_API_KEY> -e CRAWL_READINESS_API_BASE=<CRAWL_READINESS_API_BASE> -- npx -y crawl-readiness-mcp

Adds it for this project only. Append --scope user to make it available everywhere. Claude Code docs

crawl readiness in other clients

crawl readiness MCP server