TheCrawler MCP
v0.5.8io.github.manchittlab/thecrawler
Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.
transport:stdio
runtime:npm
Target client
run in your project directory
claude mcp add thecrawler -- npx -y thecrawler
Adds it for this project only. Append --scope user to make it available everywhere. Claude Code docs
This listing does not declare its tools. Connect the server and your client will discover them on the handshake.