Root Signals MCP Server

Example Use Cases

• 1

  Automatically evaluate and score LLM responses (e.g., clarity, conciseness, faithfulness) and receive justifications for improvement.

• 2

  Run RAG-aware evaluations using retrieval context to measure faithfulness and relevance against provided contexts.

• 3

  Enforce coding policy adherence and run multi-evaluator "judge" workflows to combine multiple quality checks into a single decision.

Description

This project bridges the Root Signals API and Model Context Protocol (MCP) clients, letting agents discover and run evaluators (e.g., clarity, faithfulness, coding policy adherence) over model outputs. It supports SSE and stdio transports for integration with MCP-capable clients like Cursor and includes tools to list evaluators/judges and run evaluations by ID or name. Benefits include automated, repeatable quality checks, RAG-aware evaluations with context, and an LLM-as-a-judge workflow to orchestrate multiple evaluators.