Skip to content
LangChain

gguf mcp for LangChain

io.github.arose26/gguf-mcp

Inspect local GGUF/safetensors models: quantization, params, VRAM fit — headers only.

client:LangChain transport:stdio runtime:npm

Install gguf mcp in LangChain

pip install langchain-mcp-adapters

from langchain_mcp_adapters.client import MultiServerMCPClient

client = MultiServerMCPClient({
        "gguf-mcp": {
            "transport": "stdio",
            "command": "npx",
            "args": ["-y", "gguf-mcp"],
        }
})

tools = await client.get_tools()

get_tools() returns the server's tools as LangChain tools, ready for an agent. LangChain docs

gguf mcp in other clients