How to build an evaluation set for an LLM application
The most important tool in AI engineering: how to collect test cases, define success criteria, score outputs automatically and by hand, and run evals on every change.
AI Desk3 min read
Tag
#Testing
Every The Latent Daily story, tool, model and resource tagged “Testing”.
2 items
LLM-as-a-judge explained: using AI models to grade AI output
Language models can score other models' answers at scale. How LLM-as-a-judge works, its known biases, and how to design rubrics and checks that make it reliable.
AI Desk3 min read