Challenges in Handling Detection Errors in AI-Based Anomaly Detection: A study on How Cybersecurity Professionals Handle False Positives and False Negatives
2025 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE credits
Student thesis
Abstract [en]
False Positives (FPs) and False Negatives (FNs) remain common challenges in AI-based anomaly detection systems (ADS) used to identify cybersecurity threats. These issues continue to affect both detection accuracy and the analysts’ trust in the systems. While most research focuses on improving anomaly detection models, this study examined how cybersecurity professionals handle FPs and FNs in practice. Based on 31 written interviews with cybersecurity professionals, this study explored how these tools are used in reality situations. The analysis showed that AI-based anomaly detection systems can be helpful to search unusual activity but these systems are not fully trusted without human involvement. Participants mentioned challenges such as false alerts, unclear decision making, and the need to adjust the systems and collaborate with other teams. The findings suggest that the effectiveness of AI-based anomaly detection systems depends on factors that they are trust, clear communication and a good connection between the system’s output and what teams need in practice.
Place, publisher, year, edition, pages
2025. , p. 43
Keywords [en]
AI-based anomaly detection, false positives, false negatives, cybersecurity, anomaly detection systems, alert fatigue, human-AI interaction, operational security
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:his:diva-25902OAI: oai:DiVA.org:his-25902DiVA, id: diva2:2004321
Subject / course
Informationsteknologi
Educational program
Privacy, Information and Cyber Security - Master's Programme 120 ECTS
Supervisors
Examiners
2025-10-072025-10-072025-10-07Bibliographically approved