Claude.ai scrapewright crawl_site
How to: Claude.ai scrapewright crawl_site
Add scrapewright to Claude.ai
-
01
Open Settings → Connectors → Add custom connector and merge this in. Keep any servers already there.
https://scrapewright.app/mcp-
02
Save the file and restart Claude.ai.
-
03
Ask for something crawl_site does. Claude.ai lists the server's tools on connect and calls crawl_site itself — you do not invoke it by name.
-
04
If nothing happens, check the server is running and that scrapewright's identifier in your config matches the one above exactly.
Claude on the web takes a remote URL and completes OAuth in the browser. For a packaged server use Claude Desktop or Claude Code instead. Claude.ai docs
Set these first
scrapewright will not start until these are set, so crawl_site never becomes available.
-
ANTHROPIC_API_KEY -
SCRAPEWRIGHT_CACHE -
SCRAPEWRIGHT_OBEY_ROBOTS
Same tool, other clients
This list was read from the server itself, by connecting to it and calling tools/list on 24 September 2026. It is what
the server actually exposes, not what its listing claims.
Mutating and Read-only are read off each tool's name, not its schema — a hint, not a guarantee. The registry stores tool names only; connect the server for its live schemas.