evalpair for LangChain
io.github.srikarmk/evalpair
Run LLM eval suites on local or hosted models; compare runs with intervals and a noise floor.
client:LangChain
transport:stdio
runtime:pypi
Install evalpair in LangChain
pip install langchain-mcp-adapters
from langchain_mcp_adapters.client import MultiServerMCPClient
client = MultiServerMCPClient({
"evalpair": {
"transport": "stdio",
"command": "uvx",
"args": ["evalpair"],
}
})
tools = await client.get_tools()
get_tools() returns the server's tools as LangChain tools, ready for an agent. LangChain docs