Skip to content
mcp/harbor
LangChain

web scraping for LangChain

com.superagnt/web-scraping

Web scraping for AI agents: scrape, search, crawl, map any website to markdown + JSON. No browser.

client:LangChain transport:streamable-http

Install web scraping in LangChain

pip install langchain-mcp-adapters 

from langchain_mcp_adapters.client import MultiServerMCPClient

client = MultiServerMCPClient({
        "web-scraping": {
            "transport": "streamable_http",
            "url": "https://mcp.superagnt.com/mcp/web-scraping",
        }
})

tools = await client.get_tools()

get_tools() returns the server's tools as LangChain tools, ready for an agent. LangChain docs

web scraping in other clients

web scraping MCP server