Guided project
An eval harness that shows a measured improvement
Build an evaluation harness for an LLM app you already have: a test set, automatic checks, a calibrated model judge and a regression gate in CI, then use it to show one change that measurably improves the app.
Advancedabout 12 hours6 steps
You will need
- An LLM app you built earlier, such as your RAG app or agent
- Python 3, a GitHub repository and an API key
Lessons it uses
What you will show
- The harness and test set in a repository
- Baseline and improved results by category
- A CI workflow that blocks regressions
Sign up free to see every step
The 6 steps, the rubric to check yourself against, and ideas to go further. It is free, takes a few seconds and needs no card.
Accounts are for learners aged 18 and over. Under 18? The quick answer and the first part of every lesson stay open: browse lessons by topic.