Skip to content
LangChain

Web Scraper to Markdown API for LangChain

io.github.br0ski777/web-scraper

Extract clean markdown from any URL. Removes boilerplate. For RAG pipelines. x402.

client:LangChain transport:sse

Install Web Scraper to Markdown API in LangChain

pip install langchain-mcp-adapters

from langchain_mcp_adapters.client import MultiServerMCPClient

client = MultiServerMCPClient({
        "web-scraper": {
            "transport": "streamable_http",
            "url": "https://web-scraper.api.klymax402.com/mcp",
        }
})

tools = await client.get_tools()

get_tools() returns the server's tools as LangChain tools, ready for an agent. LangChain docs

Web Scraper to Markdown API in other clients