Skip to main content

A vendor says their ML intrusion detector is 99% accurate. Why might it still drown your SOC in false alarms?

AI security · Intermediate 2

Short answer

Because attacks are rare. If one event in 10,000 is malicious, a model that wrongly flags just 1% of normal events still raises about 100 false alarms for each real attack. Accuracy hides this. I would ask for precision, recall and the false positive rate on data like ours, and test it on our own logs first.

Deeper answer

This is the base rate problem. With a tiny share of positives, even a small false positive rate produces far more false alerts than true ones, so precision is low. Accuracy looks great because predicting 'normal' every time is already almost perfectly accurate.

Better questions for the vendor: precision and recall at the threshold they recommend, the false positives per day expected at our event volume, what data they tested on, and how the model handles drift and attackers who adapt. Then run a pilot on our own logs, label a sample of alerts, and tune the threshold to what analysts can handle. Combine ML scores with rules and context instead of alerting on the score alone.

What a strong answer covers

Answer it out loud in the mock interview about 1.5 min

Follow-ups to expect

Common mistakes

Learn it

Machine learning for threat detection

Practice AI security questions

More on this topic

Today's AI turns are used

Lessons, roadmaps, videos, practice cards and the code playground stay free with your account, with no limit.