Website Crawler — Markdown Pages, Sitemaps & RAG Provenance for VS Code
io.github.kriton-dev/website-to-markdown
Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay
client:VS Code
transport:streamable-http
Install Website Crawler — Markdown Pages, Sitemaps & RAG Provenance in VS Code
.vscode/mcp.json
{
"servers": {
"website-to-markdown": {
"type": "http",
"url": "https://mcp.apify.com/?tools=hermeskd/website-to-markdown"
}
}
}Requires agent mode. MCP: Open User Configuration puts the same block in every workspace. VS Code docs