modelwatch for Gemini CLI
io.github.bch1212/modelwatch
Continuous behavioral drift monitoring for LLM apps — catches silent provider model updates.
client:Gemini CLI
transport:stdio
runtime:npm
Install modelwatch in Gemini CLI
~/.gemini/settings.json · windows: %USERPROFILE%\.gemini\settings.json
{
"mcpServers": {
"modelwatch": {
"command": "npx",
"args": [
"-y",
"modelwatch-mcp"
],
"env": {
"MODELWATCH_API_KEY": "<MODELWATCH_API_KEY>",
"MODELWATCH_API_BASE": "<MODELWATCH_API_BASE>"
}
}
}
}
Gemini expands $VAR and ${VAR} inside env values, so a secret can live in your shell rather than this file. Gemini CLI docs