evalgate for LangChain
io.github.ipezygj/evalgate
Statistical checks an agent runs before trusting an AI eval number (is #1 real, judge bias, more).
client:LangChain
transport:stdio
runtime:pypi
Install evalgate in LangChain
pip install langchain-mcp-adapters
from langchain_mcp_adapters.client import MultiServerMCPClient
client = MultiServerMCPClient({
"evalgate": {
"transport": "stdio",
"command": "uvx",
"args": ["eval-integrity"],
}
})
tools = await client.get_tools()
get_tools() returns the server's tools as LangChain tools, ready for an agent. LangChain docs