English
Related papers

Related papers: What Information Contributes to Log-based Anomaly …

200 papers

Anomaly detection is concerned with identifying data patterns that deviate remarkably from the expected behaviour. This is an important research problem, due to its broad set of application domains, from data analysis to e-health,…

Machine Learning · Computer Science 2021-08-23 L. Erhan , M. Ndubuaku , M. Di Mauro , W. Song , M. Chen , G. Fortino , O. Bagdasar , A. Liotta

One of the most challenging problems in the field of intrusion detection is anomaly detection for discrete event logs. While most earlier work focused on applying unsupervised learning upon engineered features, most recent work has started…

Machine Learning · Computer Science 2021-06-04 Lun-Pin Yuan , Peng Liu , Sencun Zhu

Software-intensive systems produce logs for troubleshooting purposes. Recently, many deep learning models have been proposed to automatically detect system anomalies based on log data. These models typically claim very high detection…

Software Engineering · Computer Science 2022-02-16 Van-Hoang Le , Hongyu Zhang

The scarcity of high-quality public log datasets has become a critical bottleneck in advancing log-based anomaly detection techniques. Current datasets exhibit three fundamental limitations: (1) incomplete event coverage, (2) artificial…

Software Engineering · Computer Science 2025-04-17 Xinyu Li , Yingtong Huo , Chenxi Mao , Shiwen Shan , Yuxin Su , Dan Li , Zibin Zheng

Logs play a crucial role in system monitoring and debugging by recording valuable system information, including events and states. Although various methods have been proposed to detect anomalies in log sequences, they often overlook the…

Machine Learning · Computer Science 2023-09-13 Yufei Li , Yanchi Liu , Haoyu Wang , Zhengzhang Chen , Wei Cheng , Yuncong Chen , Wenchao Yu , Haifeng Chen , Cong Liu

Mechanical defects in real situations affect observation values and cause abnormalities in multivariate time series, such as sensor values or network data. To perceive abnormalities in such data, it is crucial to understand the temporal…

Machine Learning · Computer Science 2023-05-09 Yungi Jeong , Eunseok Yang , Jung Hyun Ryu , Imseong Park , Myungjoo Kang

For data-constrained, complex and dynamic industrial environments, there is a critical need for transferable and multimodal methodologies to enhance anomaly detection and therefore, prevent costs associated with system failures. Typically,…

Deep learning promises performant anomaly detection on time-variant datasets, but greatly suffers from low availability of suitable training datasets and frequently changing tasks. Deep transfer learning offers mitigation by letting…

Machine Learning · Computer Science 2021-06-10 Benjamin Maschler , Tim Knodel , Michael Weyrich

While anomaly detection in time series has been an active area of research for several years, most recent approaches employ an inadequate evaluation criterion leading to an inflated F1 score. We show that a rudimentary Random Guess method…

Machine Learning · Computer Science 2022-03-11 Keval Doshi , Shatha Abudalou , Yasin Yilmaz

Predictive business process monitoring focuses on predicting future characteristics of a running process using event logs. The foresight into process execution promises great potentials for efficient operations, better resource management,…

Machine Learning · Computer Science 2021-04-05 Zaharah A. Bukhsh , Aaqib Saeed , Remco M. Dijkman

Any modern system writes events into files, called log files. Those contain crucial information which are subject to various analyses. Examples range from cybersecurity, intrusion detection over usage analyses to trouble shooting. Before…

Machine Learning · Computer Science 2022-02-02 Nadine Ruecker , Andreas Maier

Log analysis is one of the main techniques that engineers use for troubleshooting large-scale software systems. Over the years, many supervised, semi-supervised, and unsupervised log analysis methods have been proposed to detect system…

Software Engineering · Computer Science 2024-04-22 Yongzheng Xie , Hongyu Zhang , Muhammad Ali Babar

This article introduces a novel method for detecting anomalies within log data from control system nodes at the European XFEL accelerator. Effective anomaly detection is crucial for providing operators with a clear understanding of each…

Cryptography and Security · Computer Science 2025-09-26 Antonin Sulc , Annika Eichler , Tim Wilksen

Transformer, as one of the most advanced neural network models in Natural Language Processing (NLP), exhibits diverse applications in the field of anomaly detection. To inspire research on Transformer-based anomaly detection, this review…

Machine Learning · Computer Science 2024-02-15 Mingrui Ma , Lansheng Han , Chunjie Zhou

Fully supervised log anomaly detection methods suffer the heavy burden of annotating massive unlabeled log data. Recently, many semi-supervised methods have been proposed to reduce annotation costs with the help of parsed templates.…

Software Engineering · Computer Science 2023-04-12 Hongcheng Guo , Yuhui Guo , Renjie Chen , Jian Yang , Jiaheng Liu , Zhoujun Li , Tieqiao Zheng , Weichao Hou , Liangfan Zheng , Bo Zhang

Event log analysis is an important task that security professionals undertake. Event logs record key information on activities that occur on computing devices, and due to the substantial number of events generated, they consume a large…

Artificial Intelligence · Computer Science 2025-02-04 Siraaj Akhtar , Saad Khan , Simon Parkinson

Transformer-based models for anomaly detection in multivariate time series can benefit from the self-attention mechanism due to its advantage in modeling long-term dependencies. However, Transformer-based anomaly detection models have…

Machine Learning · Computer Science 2023-12-05 Jie Liu , Qilin Li , Senjian An , Bradley Ezard , Ling Li

Organizations rely heavily on time series metrics to measure and model key aspects of operational and business performance. The ability to reliably detect issues with these metrics is imperative to identifying early indicators of major…

Machine Learning · Computer Science 2020-11-11 Sayan Chakraborty , Smit Shah , Kiumars Soltani , Anna Swigart , Luyao Yang , Kyle Buckingham

This paper proposes a structure-aware driven scheduling graph modeling method to improve the accuracy and representation capability of anomaly identification in scheduling behaviors of complex systems. The method first designs a…

Machine Learning · Computer Science 2025-12-23 Ning Lyu , Junjie Jiang , Lu Chang , Chihui Shao , Feng Chen , Chong Zhang

Log anomaly detection is a critical component in modern software system security and maintenance, serving as a crucial support and basis for system monitoring, operation, and troubleshooting. It aids operations personnel in timely…

Software Engineering · Computer Science 2024-07-31 Yingying He , Xiaobing Pei