TheCrawler for Grok
io.github.manchittlab/thecrawler
Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.
client:Grok
transport:stdio
runtime:npm
Install TheCrawler in Grok
.mcp.json (in your project root)
{
"mcpServers": {
"thecrawler": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"thecrawler"
]
}
}
}Grok Build reads Claude Code's .mcp.json and Claude Desktop's config unchanged, so a server you have already set up there needs nothing new. The Grok web app and X integration do not take custom servers. Grok docs