#llm-judge
Artwork: The Crucifixion of Saint Andrew by Caravaggio. Cleveland Museum of Art · Public domain
EvaluationBeyond 1–5 Scores: Binary Judges, Outcome Verification, and pass^k
Multi-point judge scales are subjective, transcript-only scoring misses system state, and a single trial can be a lucky run. Four changes that make agent evaluation trustworthy.
Artwork: Mäda Primavesi by Gustav Klimt. The Metropolitan Museum of Art · Public domain
EvaluationHybrid Agent Evaluation: Custom Judges + Azure Foundry Evaluators
Why we combined domain-specific custom LLM judges with Azure Foundry's built-in agent evaluators over a REST API — getting behavior metrics and scenario-fact groundedness from C# without a Python dependency.
Artwork: Wheat Field with Cypresses by Vincent van Gogh. The Metropolitan Museum of Art · Public domain
EvaluationEval-Driven Development: Red-Green-Refactor for AI Agents
Every agent change should be justified by a failing evaluation. A disciplined, TDD-style process for evolving AI agents without regressions.