Blog
Artwork: The Chess Players by Thomas Eakins. The Metropolitan Museum of Art · Public domain
AgentsWhat Changes When Coding Agents Can Act?
Governed Agentic SDLC is an integration problem: execution, identity, policy, evidence, evaluation, and human approval must reinforce one another while authority stays outside the model.
Artwork: Prisoners Exercising by Vincent van Gogh. Wikimedia Commons, Pushkin Museum of Fine Arts · Public domain
AgentsIsolated Execution for Coding Agents: Where the Sandbox Ends
Choose an agent sandbox by its complete boundary, not its runtime label. Kernel isolation, network paths, credentials, lifecycle controls, evidence, and broker privilege can each decide whether containment holds.
Artwork: The Judgment of Paris by Lucas Cranach the Elder. The Metropolitan Museum of Art · Public domain
EvaluationDeepEval vs Vally vs Waza vs convo-eval: A Technical Decision Guide
Match the evaluator to the evidence boundary: DeepEval for responses and traces, Vally for trajectories and workspaces, Waza for skills, and a licensed voice harness for deployed audio.
Artwork: The Spanish Singer by Edouard Manet. The Metropolitan Museum of Art · Public domain
EvaluationConversation Evaluation Through Voice-Agent Simulation
Persona-driven simulations catch deployed voice failures that text tests miss by retaining audio, timing, transcripts, tools, and outcomes. Keep deterministic gates primary and evaluate perceptual speech quality separately.
Artwork: Wheat Field with Cypresses by Vincent van Gogh. The Metropolitan Museum of Art · Public domain
EvaluationDeepEval: Pytest-Native Evaluation for LLM Applications and Agents
DeepEval is the strongest general-purpose starting point for Python LLM, RAG, and agent evaluation. Start with deterministic outcomes, then add calibrated semantic metrics where code falls short.
Artwork: Wheat Field with Cypresses by Vincent van Gogh. The Metropolitan Museum of Art · Public domain
EvaluationMicrosoft Vally: Declarative Trajectory Evaluation for AI Agents
Vally offers the strongest trajectory pipeline for coding and tool-using agents, but its pre-1.0 contracts and unresolved source and support model make a version-pinned pilot safer than an organization-wide gate.