mcp eval runner for Gemini CLI
io.github.dbsectrainer/mcp-eval-runner
A standardized testing harness for MCP servers and agent workflows
client:Gemini CLI
transport:stdio
runtime:npm
Install mcp eval runner in Gemini CLI
~/.gemini/settings.json · windows: %USERPROFILE%\.gemini\settings.json
{
"mcpServers": {
"mcp-eval-runner": {
"command": "npx",
"args": [
"-y",
"mcp-eval-runner"
],
"env": {
"YOUR_API_KEY": "<YOUR_API_KEY>"
}
}
}
}
Gemini expands $VAR and ${VAR} inside env values, so a secret can live in your shell rather than this file. Gemini CLI docs