Crawl Census for Claude.ai

io.github.taylorsmithgg/crawl-census

Ask before you fetch: will this domain serve your crawler, refuse it, or charge it?

client:Claude.ai transport:streamable-http tools:7

Install Crawl Census in Claude.ai

Settings → Connectors → Add custom connector

https://crawlcensus.com/mcp

Claude on the web takes a remote URL and completes OAuth in the browser. For a packaged server use Claude Desktop or Claude Code instead. Claude.ai docs

What Claude.ai can do once it is connected

scan_site
site_report
census_stats
crawl_preflight
agent_profile
census_facts
submit_domains

Crawl Census in other clients

Claude Code
Claude Desktop
Cursor
VS Code
Zed
Windsurf
Cline
Gemini CLI
Grok
ChatGPT
LangChain

Crawl Census MCP server