TheCrawler for VS Code
io.github.manchittlab/thecrawler
Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.
client:VS Code
transport:stdio
runtime:npm
Install TheCrawler in VS Code
.vscode/mcp.json
{
"servers": {
"thecrawler": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"thecrawler"
]
}
}
}Requires agent mode. MCP: Open User Configuration puts the same block in every workspace. VS Code docs