Skip to main content

Guided project

An eval harness that shows a measured improvement

Build an evaluation harness for an LLM app you already have: a test set, automatic checks, a calibrated model judge and a regression gate in CI, then use it to show one change that measurably improves the app.

Advancedabout 12 hours6 steps

On Generative AI & LLM Engineer: Quality engineer

You will need

  • An LLM app you built earlier, such as your RAG app or agent
  • Python 3, a GitHub repository and an API key

Lessons it uses

What you will show

  • The harness and test set in a repository
  • Baseline and improved results by category
  • A CI workflow that blocks regressions

Sign up free to see every step

The 6 steps, the rubric to check yourself against, and ideas to go further. It is free, takes a few seconds and needs no card.

Accounts are for learners aged 18 and over. Under 18? The quick answer and the first part of every lesson stay open: browse lessons by topic.

Today's AI turns are used

Lessons, roadmaps, videos, practice cards and the code playground stay free with your account, with no limit.