English
Related papers

Related papers: Impact of Log Parsing on Deep Learning-Based Anoma…

200 papers

Anomalies or failures in large computer systems, such as the cloud, have an impact on a large number of users that communicate, compute, and store information. Therefore, timely and accurate anomaly detection is necessary for reliability,…

Artificial Intelligence · Computer Science 2021-02-24 Harold Ott , Jasmin Bogatinovski , Alexander Acker , Sasho Nedelkoski , Odej Kao

Log data have facilitated various tasks of software development and maintenance, such as testing, debugging and diagnosing. Due to the unstructured nature of logs, log parsing is typically required to transform log messages into structured…

Software Engineering · Computer Science 2024-03-26 Zhihan Jiang , Jinyang Liu , Junjie Huang , Yichen Li , Yintong Huo , Jiazhen Gu , Zhuangbin Chen , Jieming Zhu , Michael R. Lyu

Anomaly detection is an important problem that has been well-studied within diverse research areas and application domains. The aim of this survey is two-fold, firstly we present a structured and comprehensive overview of research methods…

Machine Learning · Computer Science 2019-01-24 Raghavendra Chalapathy , Sanjay Chawla

Log analysis is one of the main techniques that engineers use for troubleshooting large-scale software systems. Over the years, many supervised, semi-supervised, and unsupervised log analysis methods have been proposed to detect system…

Software Engineering · Computer Science 2024-04-22 Yongzheng Xie , Hongyu Zhang , Muhammad Ali Babar

With the increasing prevalence of scalable file systems in the context of High Performance Computing (HPC), the importance of accurate anomaly detection on runtime logs is increasing. But as it currently stands, many state-of-the-art…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-20 Chris Egersdoerfer , Dong Dai , Di Zhang

Growth in system complexity increases the need for automated log analysis techniques, such as Log-based Anomaly Detection (LAD). While deep learning (DL) methods have been widely used for LAD, traditional machine learning (ML) techniques…

Software Engineering · Computer Science 2025-06-24 Shan Ali , Chaima Boufaied , Domenico Bianculli , Paula Branco , Lionel Briand

Logs provide users with useful insights to help with a variety of development and operations tasks. The problem is that logs are often unstructured, making their analysis a complex task. This is mainly due to the lack of guidelines and best…

Software Engineering · Computer Science 2021-11-01 Issam Sedki , Abdelwahab Hamou-Lhadj , Otmane Ait-Mohamed

Logs are ubiquitous digital footprints, playing an indispensable role in system diagnostics, security analysis, and performance optimization. The extraction of actionable insights from logs is critically dependent on the log parsing…

Software Engineering · Computer Science 2024-08-27 Aoxiao Zhong , Dengyao Mo , Guiyang Liu , Jinbu Liu , Qingda Lu , Qi Zhou , Jiesheng Wu , Quanzheng Li , Qingsong Wen

Due to the complexity and size of modern software systems, the amount of logs generated is tremendous. Hence, it is infeasible to manually investigate these data in a reasonable time, thereby requiring automating log analysis to derive…

Software Engineering · Computer Science 2024-02-09 Stefan Petrescu , Floris den Hengst , Alexandru Uta , Jan S. Rellermeyer

The rapid progress of modern computing systems has led to a growing interest in informative run-time logs. Various log-based anomaly detection techniques have been proposed to ensure software reliability. However, their implementation in…

Software Engineering · Computer Science 2023-08-21 Yintong Huo , Yichen Li , Yuxin Su , Pinjia He , Zifan Xie , Michael R. Lyu

Log analysis is one of the main techniques engineers use to troubleshoot faults of large-scale software systems. During the past decades, many log analysis approaches have been proposed to detect system anomalies reflected by logs. They…

Software Engineering · Computer Science 2022-09-19 Yongzheng Xie , Hongyu Zhang , Muhammad Ali Babar

Logging code plays an important role in software systems by recording key events and behaviors, which are essential for debugging and monitoring. However, insecure logging practices can inadvertently expose sensitive information or enable…

Software Engineering · Computer Science 2026-04-23 He Yang Yuan , Xin Wang , Kundi Yao , An Ran Chen , Zishuo Ding , Zhenhao Li

Anomaly detection presents a unique challenge in machine learning, due to the scarcity of labeled anomaly data. Recent work attempts to mitigate such problems by augmenting training of deep anomaly detection models with additional labeled…

Machine Learning · Computer Science 2021-05-18 Ziyu Ye , Yuxin Chen , Haitao Zheng

Anomaly detection becomes increasingly important for the dependability and serviceability of IT services. As log lines record events during the execution of IT services, they are a primary source for diagnostics. Thereby, unsupervised…

Machine Learning · Computer Science 2021-09-21 Thorsten Wittkopp , Alexander Acker , Sasho Nedelkoski , Jasmin Bogatinovski , Dominik Scheinert , Wu Fan , Odej Kao

Log files record computational events that reflect system state and behavior, making them a primary source of operational insights in modern computer systems. Automated anomaly detection on logs is therefore critical, yet most established…

Machine Learning · Computer Science 2026-02-04 Simon Dietz , Kai Klede , An Nguyen , Bjoern M Eskofier

System logs are some of the most important information for the maintenance of software systems, which have become larger and more complex in recent years. The goal of log-based anomaly detection is to automatically detect system anomalies…

Machine Learning · Computer Science 2024-02-19 Yuuki Yamanaka , Tomokatsu Takahashi , Takuya Minami , Yoshiaki Nakajima

Computer network anomaly detection and log analysis, as an important topic in the field of network security, has been a key task to ensure network security and system reliability. First, existing network anomaly detection and log analysis…

Machine Learning · Computer Science 2024-09-17 Shuzhan Wang , Ruxue Jiang , Zhaoqi Wang , Yan Zhou

System logs are a critical resource for monitoring and managing distributed systems, providing insights into failures and anomalous behavior. Traditional log analysis techniques, including template-based and sequence-driven approaches,…

Artificial Intelligence · Computer Science 2025-12-16 Anfeng Peng , Ajesh Koyatan Chathoth , Stephen Lee

Modern software systems generate extensive heterogeneous log data with dynamic formats, fragmented event sequences, and varying temporal patterns, making anomaly detection both crucial and challenging. To address these complexities, we…

Artificial Intelligence · Computer Science 2025-12-17 Przemek Pospieszny , Wojciech Mormul , Karolina Szyndler , Sanjeev Kumar

Distributed databases are fundamental infrastructures of today's large-scale software systems such as cloud systems. Detecting anomalies in distributed databases is essential for maintaining software availability. Existing approaches,…

Software Engineering · Computer Science 2024-06-13 Lingzhe Zhang , Tong Jia , Mengxi Jia , Ying Li , Yong Yang , Zhonghai Wu