Website Crawler — Markdown Pages, Sitemaps & RAG Provenance for Claude.ai
io.github.kriton-dev/website-to-markdown
Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay
client:Claude.ai
transport:streamable-http
Install Website Crawler — Markdown Pages, Sitemaps & RAG Provenance in Claude.ai
Settings → Connectors → Add custom connector
https://mcp.apify.com/?tools=hermeskd/website-to-markdownClaude on the web takes a remote URL and completes OAuth in the browser. For a packaged server use Claude Desktop or Claude Code instead. Claude.ai docs