io.github.iris-eval/mcp-serverai

mcp-server

Verified · 20 days ago

The agent eval standard for MCP. Score every agent output for quality, safety, and cost.

Install

claude mcp add mcp-server -- npx -y @iris-eval/[email protected]

Requires: IRIS_API_KEY, IRIS_DB_PATH, IRIS_LOG_LEVEL

Our take

This server is an evaluation layer for MCP-based agents, aimed at scoring output quality, safety, and cost and enforcing budget or policy checks. It is for teams building or operating agents who need repeatable QA and governance, not for end-user chat workflows. Quality signal looks promising: the repo is substantial and includes tests, docs, examples, dashboard code, and security material, but the category is still young and buyers should expect some ecosystem churn around eval standards.

reviewed by hand · 2026-07-12

Something wrong or dead here? Report it

Verification record

last verified
20 days ago
github stars
7
last commit
23 days ago
archived
no
license
MIT
latest version
0.4.4
in registry since
2026-06-12

github.com/iris-eval/mcp-server

claude-flowai

claude-flow

Verified · 2 days ago

AI orchestration with hive-mind swarms, neural networks, and 87 MCP tools for enterprise dev.

hand-reviewed68k starschecked 2 days ago

tldrawai

tldraw

Verified · 4 days ago

Draw and visually collaborate with your agents on tldraw's canvas.

hand-reviewed50k starschecked 4 days ago

codebase-memory-mcpai

Codebase Memory

Verified · 21 days ago

Codebase knowledge graph for AI agents — 159 languages, sub-ms queries, 99% fewer tokens.

hand-reviewed36k stars5.8k dl/wkchecked 21 days ago

openmetadata-mcpai

OpenMetadata

Verified · 16 days ago

Official OpenMetadata MCP: governed context and business semantics for AI assistants and agents.

hand-reviewed15k starschecked 16 days ago

mobilerunai

mobilerun

Verified · 5 days ago

Control real Android and iOS devices with LLM agents — tap, swipe, type, automate flows.

hand-reviewed9.1k starschecked 5 days ago

praisonaiai

PraisonAI

Verified · 20 days ago

AI Agents Framework with Self Reflection and MCP support

hand-reviewed8.5k starschecked 20 days ago