io.github.HZYAI/ragscoreai

RAGScore

Verified · 8 days ago

Generate QA datasets & evaluate RAG systems with failure diagnosis. Any LLM.

Install

claude mcp add ragscore -- uvx ragscore

Requires: OPENAI_API_KEY, ANTHROPIC_API_KEY

Our take

RAG evaluation in two commands: generate QA pairs from your documents, fire them at your RAG endpoint, and get accuracy scores with per-question failure diagnosis. Works with any LLM including local Ollama, which keeps evaluation private, and the notebook API with built-in plots makes it genuinely quick to audit a pipeline. Young project from a new org — the methodology is LLM-as-judge with all the caveats that implies, so read the scored failures rather than trusting the single headline number.

reviewed by hand · 2026-07-05

Something wrong or dead here? Report it

Verification record

last verified
8 days ago
github stars
15
last commit
3 mo ago
archived
no
license
Apache-2.0
in registry since
2026-05-19

github.com/HZYAI/RagScore

claude-flowai

claude-flow

Verified · 2 days ago

AI orchestration with hive-mind swarms, neural networks, and 87 MCP tools for enterprise dev.

hand-reviewed68k starschecked 2 days ago

tldrawai

tldraw

Verified · 4 days ago

Draw and visually collaborate with your agents on tldraw's canvas.

hand-reviewed50k starschecked 4 days ago

codebase-memory-mcpai

Codebase Memory

Verified · 21 days ago

Codebase knowledge graph for AI agents — 159 languages, sub-ms queries, 99% fewer tokens.

hand-reviewed36k stars5.8k dl/wkchecked 21 days ago

openmetadata-mcpai

OpenMetadata

Verified · 16 days ago

Official OpenMetadata MCP: governed context and business semantics for AI assistants and agents.

hand-reviewed15k starschecked 16 days ago

mobilerunai

mobilerun

Verified · 5 days ago

Control real Android and iOS devices with LLM agents — tap, swipe, type, automate flows.

hand-reviewed9.1k starschecked 5 days ago

praisonaiai

PraisonAI

Verified · 20 days ago

AI Agents Framework with Self Reflection and MCP support

hand-reviewed8.5k starschecked 20 days ago