Skip to content
LangChain

LiteLLM Multi-Model API for LangChain

io.github.berriai/litellm-mcp

Access 100+ LLMs with one API: GPT-4, Claude, Gemini, Mistral, and more.

client:LangChain transport:stdio runtime:pypi

Install LiteLLM Multi-Model API in LangChain

pip install langchain-mcp-adapters

from langchain_mcp_adapters.client import MultiServerMCPClient

client = MultiServerMCPClient({
        "litellm-mcp": {
            "transport": "stdio",
            "command": "uvx",
            "args": ["litellm-mcp"],
        }
})

tools = await client.get_tools()

get_tools() returns the server's tools as LangChain tools, ready for an agent. LangChain docs

LiteLLM Multi-Model API in other clients