modelwatch for VS Code
io.github.bch1212/modelwatch
Continuous behavioral drift monitoring for LLM apps — catches silent provider model updates.
client:VS Code
transport:stdio
runtime:npm
Install modelwatch in VS Code
.vscode/mcp.json
{
"inputs": [
{
"type": "promptString",
"id": "modelwatch-api-key",
"description": "MODELWATCH_API_KEY",
"password": true
},
{
"type": "promptString",
"id": "modelwatch-api-base",
"description": "MODELWATCH_API_BASE",
"password": true
}
],
"servers": {
"modelwatch": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"modelwatch-mcp"
],
"env": {
"MODELWATCH_API_KEY": "${input:modelwatch-api-key}",
"MODELWATCH_API_BASE": "${input:modelwatch-api-base}"
}
}
}
}VS Code prompts for each input the first time the server starts, so no secret is written to the file. VS Code docs