Website Crawler — Markdown Pages, Sitemaps & RAG Provenance for ChatGPT

io.github.kriton-dev/website-to-markdown

Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay

client:ChatGPT transport:streamable-http

Install Website Crawler — Markdown Pages, Sitemaps & RAG Provenance in ChatGPT

Settings → Connectors → Advanced → Developer mode

https://mcp.apify.com/?tools=hermeskd/website-to-markdown

Custom connectors are a paid-plan feature and take a remote URL only. ChatGPT cannot run a packaged server locally. ChatGPT docs