English
Related papers

Related papers: Log-based Anomaly Detection of Enterprise Software…

200 papers

Modern software development and operations rely on monitoring to understand how systems behave in production. The data provided by application logs and runtime environment are essential to detect and diagnose undesired behavior and improve…

Software Engineering · Computer Science 2021-03-08 Jeanderson Barros Cândido , Maurício Finavaro Aniche , Arie van Deursen

Log-based anomaly detection is fundamentally constrained by training data sparsity. Our empirical study reveals that public benchmark datasets cover less than 10% of source code log templates. Consequently, models frequently misclassify…

Software Engineering · Computer Science 2026-04-14 Xinyu Li , Yintong Huo , Chenxi Mao , Shiwen Shan , Yuxin Su , Yanlin Wang , Zibin Zheng

System logs play a critical role in maintaining the reliability of software systems. Fruitful studies have explored automatic log-based anomaly detection and achieved notable accuracy on benchmark datasets. However, when applied to…

Software Engineering · Computer Science 2023-10-03 Jinyang Liu , Junjie Huang , Yintong Huo , Zhihan Jiang , Jiazhen Gu , Zhuangbin Chen , Cong Feng , Minzhi Yan , Michael R. Lyu

Organizations rely heavily on time series metrics to measure and model key aspects of operational and business performance. The ability to reliably detect issues with these metrics is imperative to identifying early indicators of major…

Machine Learning · Computer Science 2020-11-11 Sayan Chakraborty , Smit Shah , Kiumars Soltani , Anna Swigart , Luyao Yang , Kyle Buckingham

Event logs are widely used for anomaly detection and prediction in complex systems. Existing log-based anomaly detection methods usually consist of four main steps: log collection, log parsing, feature extraction, and anomaly detection,…

Machine Learning · Computer Science 2022-12-20 Zhong Li , Matthijs van Leeuwen

Time series anomaly detection has applications in a wide range of research fields and applications, including manufacturing and healthcare. The presence of anomalies can indicate novel or unexpected events, such as production faults, system…

Machine Learning · Computer Science 2024-09-04 Zahra Zamanzadeh Darban , Geoffrey I. Webb , Shirui Pan , Charu C. Aggarwal , Mahsa Salehi

Logs are semi-structured text generated by logging statements in software source code. In recent decades, software logs have become imperative in the reliability assurance mechanism of many software systems because they are often the only…

Software Engineering · Computer Science 2021-06-02 Shilin He , Pinjia He , Zhuangbin Chen , Tianyi Yang , Yuxin Su , Michael R. Lyu

Logs enable the monitoring of infrastructure status and the performance of associated applications. Logs are also invaluable for diagnosing the root causes of any problems that may arise. Log Anomaly Detection (LAD) pipelines automate the…

Machine Learning · Computer Science 2023-10-24 Dipak Wani , Samuel Ackerman , Eitan Farchi , Xiaotong Liu , Hau-wen Chang , Sarasi Lalithsena

With the widespread adoption of cloud services, especially the extensive deployment of plenty of Web applications, it is important and challenging to detect anomalies from the packet payload. For example, the anomalies in the packet payload…

Signal Processing · Electrical Eng. & Systems 2021-05-20 Jiaxin Liu , Xucheng Song , Yingjie Zhou , Xi Peng , Yanru Zhang , Pei Liu , Dapeng Wu

The multi-source data generated by distributed systems, provide a holistic description of the system. Harnessing the joint distribution of the different modalities by a learning model can be beneficial for critical applications for…

Machine Learning · Computer Science 2021-01-14 Jasmin Bogatinovski , Sasho Nedelkoski

Prompt and accurate detection of system anomalies is essential to ensure the reliability of software systems. Unlike manual efforts that exploit all available run-time information, existing approaches usually leverage only a single type of…

Software Engineering · Computer Science 2023-02-16 Baitong Li , Tianyi Yang , Zhuangbin Chen , Yuxin Su , Yongqiang Yang , Michael R. Lyu

Within today's large-scale systems, one anomaly can impact millions of users. Detecting such events in real-time is essential to maintain the quality of services. It allows the monitoring team to prevent or diminish the impact of a failure.…

Artificial Intelligence · Computer Science 2023-04-25 Arthur Vervaet

Deep Learning (DL) is vulnerable to out-of-distribution and adversarial examples resulting in incorrect outputs. To make DL more robust, several posthoc (or runtime) anomaly detection techniques to detect (and discard) these anomalous…

Machine Learning · Computer Science 2021-02-23 Saikiran Bulusu , Bhavya Kailkhura , Bo Li , Pramod K. Varshney , Dawn Song

Logs are widely used to record runtime information of software systems, such as the timestamp and the importance of an event, the unique ID of the source of the log, and a part of the state of a task's execution. The rich information of…

Software Engineering · Computer Science 2022-01-04 Sina Gholamian , Paul A. S. Ward

Deep learning (DL) techniques are on the rise in the software engineering research community. More and more approaches have been developed on top of DL models, also due to the unprecedented amount of software-related data that can be used…

Software Engineering · Computer Science 2021-03-23 Alejandro Mazuera-Rozo , Anamaria Mojica-Hanke , Mario Linares-Vásquez , Gabriele Bavota

Anomaly detection becomes increasingly important for the dependability and serviceability of IT services. As log lines record events during the execution of IT services, they are a primary source for diagnostics. Thereby, unsupervised…

Machine Learning · Computer Science 2021-09-21 Thorsten Wittkopp , Alexander Acker , Sasho Nedelkoski , Jasmin Bogatinovski , Dominik Scheinert , Wu Fan , Odej Kao

The rapid progress of modern computing systems has led to a growing interest in informative run-time logs. Various log-based anomaly detection techniques have been proposed to ensure software reliability. However, their implementation in…

Software Engineering · Computer Science 2023-08-21 Yintong Huo , Yichen Li , Yuxin Su , Pinjia He , Zifan Xie , Michael R. Lyu

Anomaly detection based on system logs plays an important role in intelligent operations, which is a challenging task due to the extremely complex log patterns. Existing methods detect anomalies by capturing the sequential dependencies in…

Machine Learning · Computer Science 2023-07-10 Ling Chen , Chaodu Song , Xu Wang , Dachao Fu , Feifei Li

System logs are a critical resource for monitoring and managing distributed systems, providing insights into failures and anomalous behavior. Traditional log analysis techniques, including template-based and sequence-driven approaches,…

Artificial Intelligence · Computer Science 2025-12-16 Anfeng Peng , Ajesh Koyatan Chathoth , Stephen Lee

With the increasing prevalence of scalable file systems in the context of High Performance Computing (HPC), the importance of accurate anomaly detection on runtime logs is increasing. But as it currently stands, many state-of-the-art…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-20 Chris Egersdoerfer , Dong Dai , Di Zhang