Agentic AI in DevOps
#22 — From Agent Traces to Better Evals with Nikita Kabardin
An agent can pass its evals and still disappoint customers. Production traces help only when someone turns real successes and corrected failures into tests worth trusting.
Andrey Devyatkin, Vladimir Samoylov and Fernando Piviani join Langfuse engineer Nikita Kabardin to discuss golden datasets, human review of evals, reliable pull request workflows, context for autonomous agents, and permission…