English
Related papers

Related papers: $K^4$: Online Log Anomaly Detection Via Unsupervis…

200 papers

Software log analysis can be laborious and time consuming. Time and labeled data are usually lacking in industrial settings. This paper studies unsupervised and time efficient methods for anomaly detection. We study two custom and two…

Software Engineering · Computer Science 2024-09-23 Jesse Nyyssölä , Mika Mäntylä

Anomaly detection (AD) is increasingly recognized as a key component for ensuring the resilience of future communication systems. While deep learning has shown state-of-the-art AD performance, its application in critical systems is hindered…

Machine Learning · Computer Science 2025-10-29 Lukas Schynol , Marius Pesavento

To improve logical anomaly detection, some previous works have integrated segmentation techniques with conventional anomaly detection methods. Although these methods are effective, they frequently lead to unsatisfactory segmentation results…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yu-Hsuan Hsieh , Shang-Hong Lai

Nowadays large computers extensively output logs to record the runtime status and it has become crucial to identify any suspicious or malicious activities from the information provided by the realtime logs. Thus, fast log anomaly detection…

Machine Learning · Computer Science 2024-04-16 Yifei Lin , Hanqiu Deng , Xingyu Li

Nowadays, information and communications technology systems are fundamental assets of our social and economical model, and thus they should be properly protected against the malicious activity of cybercriminals. Defence mechanisms are…

Cryptography and Security · Computer Science 2019-08-02 Gonzalo de la Torre-Abaitua , Luis F. Lago-Fernández , David Arroyo

We consider the paradigm of unsupervised anomaly detection, which involves the identification of anomalies within a dataset in the absence of labeled examples. Though distance-based methods are top-performing for unsupervised anomaly…

Machine Learning · Statistics 2025-08-04 Yuchao Cai , Hanfang Yang , Yuheng Ma , Hanyuan Hang

We propose a non-parametric anomaly detection algorithm for high dimensional data. We score each datapoint by its average $K$-NN distance, and rank them accordingly. We then train limited complexity models to imitate these scores based on…

Machine Learning · Computer Science 2015-02-09 Jing Qian , Jonathan Root , Venkatesh Saligrama

Anomaly detection (AD) plays a pivotal role in numerous web-based applications, including malware detection, anti-money laundering, device failure detection, and network fault analysis. Most methods, which rely on unsupervised learning, are…

Machine Learning · Computer Science 2024-02-07 Haihong Zhao , Chenyi Zi , Yang Liu , Chen Zhang , Yan Zhou , Jia Li

Log analysis is an important technique that engineers use for troubleshooting faults of large-scale service-oriented systems. In this study, we propose a novel semi-supervised log-based anomaly detection approach, LogDP, which utilizes the…

Software Engineering · Computer Science 2021-10-06 Yongzheng Xie , Hongyu Zhang , Bo Zhang , Muhammad Ali Babar , Sha Lu

As software systems grow increasingly intricate, the precise detection of anomalies have become both essential and challenging. Current log-based anomaly detection methods depend heavily on vast amounts of log data leading to inefficient…

Software Engineering · Computer Science 2024-09-17 Lingzhe Zhang , Tong Jia , Kangjin Wang , Mengxi Jia , Yang Yong , Ying Li

Anomaly detection aims at identifying images that deviate significantly from the norm. We focus on algorithms that embed the normal training examples in space and when given a test image, detect anomalies based on the features distance to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Ori Nizan , Ayellet Tal

Fully supervised log anomaly detection methods suffer the heavy burden of annotating massive unlabeled log data. Recently, many semi-supervised methods have been proposed to reduce annotation costs with the help of parsed templates.…

Software Engineering · Computer Science 2023-04-12 Hongcheng Guo , Yuhui Guo , Renjie Chen , Jian Yang , Jiaheng Liu , Zhoujun Li , Tieqiao Zheng , Weichao Hou , Liangfan Zheng , Bo Zhang

Automatic log file analysis enables early detection of relevant incidents such as system failures. In particular, self-learning anomaly detection techniques capture patterns in log data and subsequently report unexpected log event…

Machine Learning · Computer Science 2023-05-16 Max Landauer , Sebastian Onder , Florian Skopik , Markus Wurzenberger

Effective anomaly detection from logs is crucial for enhancing cybersecurity defenses by enabling the early identification of threats. Despite advances in anomaly detection, existing systems often fall short in areas such as post-detection…

Cryptography and Security · Computer Science 2025-04-04 Zhuoran Tan , Qiyuan Wang , Christos Anagnostopoulos , Shameem P. Parambath , Jeremy Singer , Sam Temple

Log files record computational events that reflect system state and behavior, making them a primary source of operational insights in modern computer systems. Automated anomaly detection on logs is therefore critical, yet most established…

Machine Learning · Computer Science 2026-02-04 Simon Dietz , Kai Klede , An Nguyen , Bjoern M Eskofier

Anomaly detection, an important branch of machine learning, plays a critical role in fraud detection, health care, intrusion detection, military surveillance, etc. As one of the most commonly used unsupervised anomaly detection algorithms,…

Quantum Physics · Physics 2023-08-09 MingChao Guo , ShiJie Pan , WenMin Li , Fei Gao , SuJuan Qin , XiaoLing Yu , XuanWen Zhang , QiaoYan Wen

Anomaly detection on time series is a fundamental task in monitoring the Key Performance Indicators (KPIs) of IT systems. Many of the existing approaches in the literature show good performance while requiring a lot of training resources.…

Machine Learning · Computer Science 2021-09-07 Shi-Ying Lan , Run-Qing Chen , Wan-Lei Zhao

Logs are essential for diagnosing failures and conducting retrospective studies, leading many software organizations to retain log messages for a long time. Nevertheless, the volume of generated log data grows rapidly as software systems…

Software Engineering · Computer Science 2026-03-24 Shiwen Shan , Yintong Huo , Hongzhan Zhong , Zhining Wang , Yuxin Su , Zibin Zheng

Event logs are widely used for anomaly detection and prediction in complex systems. Existing log-based anomaly detection methods usually consist of four main steps: log collection, log parsing, feature extraction, and anomaly detection,…

Machine Learning · Computer Science 2022-12-20 Zhong Li , Matthijs van Leeuwen

Anomaly detection is a significant and hence well-studied problem. However, developing effective anomaly detection methods for complex and high-dimensional data remains a challenge. As Generative Adversarial Networks (GANs) are able to…

Machine Learning · Computer Science 2018-12-07 Houssam Zenati , Manon Romain , Chuan Sheng Foo , Bruno Lecouat , Vijay Ramaseshan Chandrasekhar