Skip to main content

What is attack success rate in AI red teaming, and what are its limits as a metric?

AI security · Pro 2

Short answer

Attack success rate is the share of attack attempts that reached their goal: if 12 of 400 jailbreak prompts got a harmful answer, it is 3%. It is useful for tracking versions on the same suite, by category. But it depends on the attacks chosen and how success is judged, and a low rate does not prove safety.

Deeper answer

Report it per category (prompt injection, data leakage, harmful content, tool misuse) and per severity, because one critical leak matters more than many mild failures. Keep the attack suite and the judge fixed when comparing versions, or the numbers are not comparable. Check the judge itself: an LLM judge should be compared with human labels on a sample.

Limits: attackers adapt and are not limited to your suite; a model can overfit to known attacks; multi-turn and indirect attacks are often under-tested; and non-determinism means repeating each attack several times gives a fairer picture. Pair the rate with severity, coverage of the threat model and time-to-fix for findings.

What a strong answer covers

Answer it out loud in the mock interview about 1.5 min

Follow-ups to expect

Common mistakes

Learn it

Security tests in CI for AI apps

Practice AI security questions

More on this topic

Today's AI turns are used

Lessons, roadmaps, videos, practice cards and the code playground stay free with your account, with no limit.