io.github.HZYAI/ragscoreai

RAGScore

Verified · 22 days ago

Generate QA datasets & evaluate RAG systems with failure diagnosis. Any LLM.

Install

claude mcp add ragscore -- uvx ragscore

Requires: OPENAI_API_KEY, ANTHROPIC_API_KEY

Our take

RAG evaluation in two commands: generate QA pairs from your documents, fire them at your RAG endpoint, and get accuracy scores with per-question failure diagnosis. Works with any LLM including local Ollama, which keeps evaluation private, and the notebook API with built-in plots makes it genuinely quick to audit a pipeline. Young project from a new org — the methodology is LLM-as-judge with all the caveats that implies, so read the scored failures rather than trusting the single headline number.

reviewed by hand · 2026-07-05

Something wrong or dead here? Report it

Verification record

last verified
22 days ago
github stars
15
last commit
6 mo ago
archived
no
license
Apache-2.0
in registry since
2026-05-19

github.com/HZYAI/RagScore

reaai

REA

Verified · 33 days ago

Reverse engineer anything from your terminal or agent with one CLI and MCP server.

hand-reviewed291k stars232k dl/wkchecked 33 days ago

rufloai

Ruflo

Verified · 9 days ago

Agent teams, swarms, memory and hooks for Claude Code and Codex, served over MCP.

hand-reviewed81k stars72k dl/wkchecked 9 days ago

claude-flowai

claude-flow

Verified · 2 mo ago

AI orchestration with hive-mind swarms, neural networks, and 87 MCP tools for enterprise dev.

hand-reviewed73k stars19k dl/wkchecked 2 mo ago

tldrawai

tldraw

Verified · 2 mo ago

Draw and visually collaborate with your agents on tldraw's canvas.

hand-reviewed50k starschecked 2 mo ago

codebase-memory-mcpai

Codebase Memory

Verified · 2 mo ago

Codebase knowledge graph for AI agents — 162 languages, sub-ms queries, 99% fewer tokens.

hand-reviewed45k stars12k dl/wkchecked 2 mo ago

openseoai

OpenSEO

Verified · 5 days ago

Keyword research, site audits, rank tracking and AI visibility for your AI agent.

hand-reviewed28k starschecked 5 days ago