xpay Web Scraping for LangChain
io.github.xpaysh/web-scraping
35+ web scraping tools. Firecrawl, Bright Data, Jina, Olostep, ScrapeGraph, Notte, Riveter.
client:LangChain
transport:streamable-http
Install xpay Web Scraping in LangChain
pip install langchain-mcp-adapters
from langchain_mcp_adapters.client import MultiServerMCPClient
client = MultiServerMCPClient({
"web-scraping": {
"transport": "streamable_http",
"url": "https://scraping.mcp.xpay.sh/mcp?key={api_key}",
}
})
tools = await client.get_tools()
get_tools() returns the server's tools as LangChain tools, ready for an agent. LangChain docs