Engineering Manager / Technical Lead
A topic hub collecting every article tagged Evaluation. Use it to explore related posts and follow this theme across the site.
5 articles
A practical, source-backed workflow for reviewing AI-generated responses for factual accuracy and relevance, scoring them with structured rubrics, and turning feedback into better prompts, evals, and product decisions.
A practical guide for implementing LangWatch evaluations in Agno and AgentOS systems, from first traces and batch experiments to structured-output scoring, production monitors, and background evaluation hooks.
LLM-as-a-judge can be one of the most useful patterns in agent evaluation, but only if you understand where it breaks: order bias, self-preference, verbosity bias, weak judges, and evidence-free scoring. This guide explains the pattern, the common traps, and the fixes that make it practical.
Why production agent evaluation is moving beyond output-only checks, how trace-aware grading complements scenario testing, and how LangWatch, LangSmith, and Langfuse compare.
Unit tests tell you if your code works. Scenario tests tell you if your agent behaves. But how do you measure quality across hundreds of examples and track it over time? LangWatch evaluations fill that gap.
Quick find
Search by topic, title, framework, or pattern.