Agent Crawl Readiness for Claude Code
io.github.sadri-dridi/agent-crawl-readiness
Bounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.
client:Claude Code
transport:streamable-http
tools:31
Install Agent Crawl Readiness in Claude Code
run in your project directory
claude mcp add --transport http agent-crawl-readiness https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-crawl-readiness/mcpAdds it for this project only. Append --scope user to make it available everywhere. Claude Code docs
What Claude Code can do once it is connected
- agent-crawl-readiness
- utc-time
- timezone
- validate-json
- normalize-url
- inspect-robots
- domain-shape
- citation
- compatibility
- status-catalog
- iana-zones
- web-fetch
- fetch-status
- github-repo-shape
- weather-hint
- memory-key-count
- file-path-ok
- browser-url-ok
- think-steps
- search-query-len
- hn-front-count
- lib-docs-hint
- playwright-url-ok
- figma-url-shape