Website to Markdown Crawler: HTML to Markdown for LLM and RAG for LangChain
io.github.bepolabs/web-to-markdown
Turn a website into Markdown with headings, links and word counts.
client:LangChain
transport:streamable-http
Install Website to Markdown Crawler: HTML to Markdown for LLM and RAG in LangChain
pip install langchain-mcp-adapters
from langchain_mcp_adapters.client import MultiServerMCPClient
client = MultiServerMCPClient({
"web-to-markdown": {
"transport": "streamable_http",
"url": "https://mcp.apify.com?tools=bepolabs/web-to-markdown",
}
})
tools = await client.get_tools()
get_tools() returns the server's tools as LangChain tools, ready for an agent. LangChain docs