web scraper for LangChain
io.github.dataleadspro/web-scraper
Fetch, crawl, and browse protected pages with anti-bot handling - renders in a real browser and
client:LangChain
transport:streamable-http
tools:4
Install web scraper in LangChain
pip install langchain-mcp-adapters
from langchain_mcp_adapters.client import MultiServerMCPClient
client = MultiServerMCPClient({
"web-scraper": {
"transport": "streamable_http",
"url": "https://data.dataleads.pro/mcp/web-scraper",
}
})
tools = await client.get_tools()
get_tools() returns the server's tools as LangChain tools, ready for an agent. LangChain docs