Skip to content
mcp/harbor
LangChain

agent eval for LangChain

io.github.rudrendupaul/agent-eval

Statistical regression testing for LLM agents: p-value, effect size, and CI on behavior change.

client:LangChain transport:stdio runtime:pypi

Install agent eval in LangChain

pip install langchain-mcp-adapters 

from langchain_mcp_adapters.client import MultiServerMCPClient

client = MultiServerMCPClient({
        "agent-eval": {
            "transport": "stdio",
            "command": "uvx",
            "args": ["agent-regress-cli"],
        }
})

tools = await client.get_tools()

get_tools() returns the server's tools as LangChain tools, ready for an agent. LangChain docs

agent eval in other clients

agent eval MCP server