Skip to main content

What is test-time compute, and how can you use it to get better answers?

LLM and transformer basics · Pro 1

Short answer

Test-time compute means spending more computing at answer time instead of training time. You can ask the model to reason step by step, sample several answers and keep the best using a checker or a majority vote, or use a reasoning model that thinks first. Each trades extra cost and waiting time for accuracy.

Deeper answer

Chain-of-thought prompting is the cheapest step and often a big gain on multi-step problems. Best-of-N needs a way to choose: a verifier such as tests for code, a majority vote for exact answers, or a judge for open text. OpenAI found a small model with a good maths verifier matched a model about 30 times larger.

Reasoning models are trained to think at length and expose an effort setting. The production pattern is routing: answer easy questions fast, and spend extra compute only when a check fails or samples disagree.

What a strong answer covers

Answer it out loud in the mock interview about 1 min

Follow-ups to expect

Common mistakes

Learn it

Reasoning models and test-time compute: when to let the model think longer

Today's AI turns are used

Lessons, roadmaps, videos, practice cards and the code playground stay free with your account, with no limit.