Skip to main content

Two coding agents use the same model, but one solves far more of your tasks. Why could that be, and how would you find out?

Agents and tools · Pro 2

Short answer

The difference is probably the harness, not the model. Check the tools and their descriptions, what context each agent sees, whether it runs tests before finishing, how it handles long tasks and when it stops. Run both on the same fixed task set, read the traces of failed tasks, and change one harness part at a time.

Deeper answer

With the model fixed, everything else is harness. Common gaps in the weaker agent are: too many tools or vague tool descriptions, so it picks the wrong one; a context window filled with old tool output, so it loses the goal; no verification, so it stops at the first answer that looks right; no progress file, so it forgets earlier work on long tasks; and stop rules that end the run too early or let it loop.

To find out, do not guess. Build or reuse a fixed task set with automatic checks. Run both agents with the same model, settings and budget. For each failure, read the trace and label the cause: wrong tool, lost context, no check, gave up, ran out of budget. The most common label tells you which harness part to change first. Then change only that part, rerun the same tasks and compare pass rate, cost and time. Run each task more than once, because agent runs vary.

What a strong answer covers

Answer it out loud in the mock interview about 2 min

Follow-ups to expect

Common mistakes

Learn it

Advanced harness engineering

Today's AI turns are used

Lessons, roadmaps, videos, practice cards and the code playground stay free with your account, with no limit.