io.github.OtherVibes/mcp-as-a-judgeai

mcp-as-a-judge

Stale · 8 mo silent

MCP as a Judge: a behavioral MCP that strengthens AI coding assistants via explicit LLM evaluations

Install

claude mcp add mcp-as-a-judge -- uvx mcp-as-a-judge

Our take

A behavioral MCP server that adds explicit LLM-based evaluation and judging around coding-assistant behavior. It is for researchers and advanced agent developers who want to score or shape model outputs, not for typical end-user automation. The premise is interesting but inherently evaluative and model-dependent, so results will need scrutiny and the project should be treated as experimental.

reviewed by hand · 2026-07-10

Something wrong or dead here? Report it

Verification record

last verified: 23 days ago
github stars: 17
last commit: 8 mo ago
archived: no
license: MIT
in registry since: 2025-09-20

github.com/OtherVibes/mcp-as-a-judge

More in ai

claude-flowai

claude-flow

Verified · 2 days ago

AI orchestration with hive-mind swarms, neural networks, and 87 MCP tools for enterprise dev.

hand-reviewed68k starschecked 2 days ago

tldrawai

tldraw

Verified · 4 days ago

Draw and visually collaborate with your agents on tldraw's canvas.

hand-reviewed50k starschecked 4 days ago

codebase-memory-mcpai

Codebase Memory

Verified · 21 days ago

Codebase knowledge graph for AI agents — 159 languages, sub-ms queries, 99% fewer tokens.

hand-reviewed36k stars5.8k dl/wkchecked 21 days ago

openmetadata-mcpai

OpenMetadata

Verified · 16 days ago

Official OpenMetadata MCP: governed context and business semantics for AI assistants and agents.

hand-reviewed15k starschecked 16 days ago

mobilerunai

mobilerun

Verified · 5 days ago

Control real Android and iOS devices with LLM agents — tap, swipe, type, automate flows.

hand-reviewed9.1k starschecked 5 days ago

praisonaiai

PraisonAI

Verified · 20 days ago

AI Agents Framework with Self Reflection and MCP support

hand-reviewed8.5k starschecked 20 days ago