Skip to content
Cline

Website Crawler — Markdown Pages, Sitemaps & RAG Provenance for Cline

io.github.kriton-dev/website-to-markdown

Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay

client:Cline transport:streamable-http

Install Website Crawler — Markdown Pages, Sitemaps & RAG Provenance in Cline

~/Library/Application Support/Code/User/globalStorage/saoudrizwan.claude-dev/settings/cline_mcp_settings.json · windows: %APPDATA%\Code\User\globalStorage\saoudrizwan.claude-dev\settings\cline_mcp_settings.json

{
  "mcpServers": {
    "website-to-markdown": {
      "url": "https://mcp.apify.com/?tools=hermeskd/website-to-markdown"
    }
  }
}

Cline's MCP Servers pane edits this file for you if you would rather not find it. Cline docs

Website Crawler — Markdown Pages, Sitemaps & RAG Provenance in other clients