Webcrawl Anything for LangChain
io.github.brainfish-ai/webcrawl
Scrape, map, crawl, search and monitor the web. Runs locally with no API key, cites every source.
client:LangChain
transport:streamable-http
runtime:npm
Install Webcrawl Anything in LangChain
pip install langchain-mcp-adapters
from langchain_mcp_adapters.client import MultiServerMCPClient
client = MultiServerMCPClient({
"webcrawl": {
"transport": "streamable_http",
"url": "https://webcrawl.app/mcp",
}
})
tools = await client.get_tools()
get_tools() returns the server's tools as LangChain tools, ready for an agent. LangChain docs