IA-QA Eval & RAG — 38 tools for Claude Desktop
io.github.jcjamet/ia-qa-eval
LLM & RAG evals: hallucination, eval contracts, semantic tests, tokens & model info. Free, no key.
client:Claude Desktop
transport:streamable-http
tools:39
Install IA-QA Eval & RAG — 38 tools in Claude Desktop
~/Library/Application Support/Claude/claude_desktop_config.json · windows: %APPDATA%\Claude\claude_desktop_config.json
{
"mcpServers": {
"ia-qa-eval": {
"command": "npx",
"args": [
"-y",
"mcp-remote",
"https://www.ia-qa.com/mcp/eval"
]
}
}
}
Claude Desktop has no remote transport in its config file, so this bridges through mcp-remote. Restart the app after saving. Claude Desktop docs
What Claude Desktop can do once it is connected
- get_testing_guidelines
- find_tool
- hallucination_check
- run_eval_contract
- run_semantic_tests
- generate_ci_workflow
- needle_haystack_generate
- generate_eval_yaml
- metamorphic_check
- test_skill
- skill_interview
- llm_output_validator
- compare_responses
- analyze_responses
- prompt_test_suite
- llm_format_check
- consistency_check
- llm_json_schema_check
- response_quality_score
- conversation_analyze
- cot_analyzer
- ab_test_report
- similarity_score
- run_vlm_test_suite