English
Related papers

Related papers: LogPurge: Log Data Purification for Anomaly Detect…

200 papers

This project explores large language models (LLMs) for anomaly detection across heterogeneous log sources. Traditional intrusion detection systems suffer from high false positive rates, semantic blindness, and data scarcity, as logs are…

Cryptography and Security · Computer Science 2026-02-09 Yassine Chagna , Antal Goldschmidt

Anomaly detection becomes increasingly important for the dependability and serviceability of IT services. As log lines record events during the execution of IT services, they are a primary source for diagnostics. Thereby, unsupervised…

Machine Learning · Computer Science 2021-09-21 Thorsten Wittkopp , Alexander Acker , Sasho Nedelkoski , Jasmin Bogatinovski , Dominik Scheinert , Wu Fan , Odej Kao

Modern distributed systems produce massive, heterogeneous logs essential for reliability, security, and anomaly detection. Converting these free-form messages into structured templates (log parsing) is challenging due to evolving formats…

Software Engineering · Computer Science 2026-04-23 Amir Shetaia , Sean Kauffman

Logs have been an imperative resource to ensure the reliability and continuity of many software systems, especially large-scale distributed systems. They faithfully record runtime information to facilitate system troubleshooting and…

Software Engineering · Computer Science 2022-01-12 Zhuangbin Chen , Jinyang Liu , Wenwei Gu , Yuxin Su , Michael R. Lyu

The system log generated in a computer system refers to large-scale data that are collected simultaneously and used as the basic data for determining errors, intrusion and abnormal behaviors. The aim of system log anomaly detection is to…

Machine Learning · Computer Science 2023-07-25 Yukyung Lee , Jina Kim , Pilsung Kang

Mining information from logs is an old and still active research topic. In recent years, with the rapid emerging of cloud computing, log mining becomes increasingly important to industry. This paper focus on one major mission of log mining:…

Machine Learning · Computer Science 2011-09-09 Nan Wang , Jizhong Han , Jinyun Fang

Log analysis is one of the main techniques that engineers use for troubleshooting large-scale software systems. Over the years, many supervised, semi-supervised, and unsupervised log analysis methods have been proposed to detect system…

Software Engineering · Computer Science 2024-04-22 Yongzheng Xie , Hongyu Zhang , Muhammad Ali Babar

Log messages are now widely used in software systems. They are important for classification as millions of logs are generated each day. Most logs are unstructured which makes classification a challenge. In this paper, Deep Learning (DL)…

Machine Learning · Computer Science 2021-04-08 Amir Farzad , T. Aaron Gulliver

Logs are extensively used during the development and maintenance of software systems. They collect runtime events and allow tracking of code execution, which enables a variety of critical tasks such as troubleshooting and fault detection.…

Machine Learning · Computer Science 2020-03-20 Sasho Nedelkoski , Jasmin Bogatinovski , Alexander Acker , Jorge Cardoso , Odej Kao

Fully supervised log anomaly detection methods suffer the heavy burden of annotating massive unlabeled log data. Recently, many semi-supervised methods have been proposed to reduce annotation costs with the help of parsed templates.…

Software Engineering · Computer Science 2023-04-12 Hongcheng Guo , Yuhui Guo , Renjie Chen , Jian Yang , Jiaheng Liu , Zhoujun Li , Tieqiao Zheng , Weichao Hou , Liangfan Zheng , Bo Zhang

Software systems often record important runtime information in system logs for troubleshooting purposes. There have been many studies that use log data to construct machine learning models for detecting system anomalies. Through our…

Software Engineering · Computer Science 2021-09-01 Van-Hoang Le , Hongyu Zhang

Log analysis is one of the main techniques engineers use to troubleshoot faults of large-scale software systems. During the past decades, many log analysis approaches have been proposed to detect system anomalies reflected by logs. They…

Software Engineering · Computer Science 2022-09-19 Yongzheng Xie , Hongyu Zhang , Muhammad Ali Babar

Log anomaly detection refers to the task that distinguishes the anomalous log messages from normal log messages. Transformer-based large language models (LLMs) are becoming popular for log anomaly detection because of their superb ability…

Machine Learning · Computer Science 2025-03-20 Zhuoyi Yang , Ian G. Harris

Artificial Intelligence for IT Operations (AIOps) describes the process of maintaining and operating large IT systems using diverse AI-enabled methods and tools for, e.g., anomaly detection and root cause analysis, to support the…

Artificial Intelligence · Computer Science 2022-07-08 Jasmin Bogatinovski , Gjorgji Madjarov , Sasho Nedelkoski , Jorge Cardoso , Odej Kao

The detection of anomalies is essential mining task for the security and reliability in computer systems. Logs are a common and major data source for anomaly detection methods in almost every computer system. They collect a range of…

Machine Learning · Computer Science 2020-08-24 Sasho Nedelkoski , Jasmin Bogatinovski , Alexander Acker , Jorge Cardoso , Odej Kao

Network log data analysis plays a critical role in detecting security threats and operational anomalies. Traditional log analysis methods for anomaly detection and root cause analysis rely heavily on expert knowledge or fully supervised…

Networking and Internet Architecture · Computer Science 2025-09-09 Xuanhao Luo , Shivesh Madan Nath Jha , Akruti Sinha , Zhizhen Li , Yuchen Liu

Logs are semi-structured text files that represent software's execution paths and states during its run-time. Therefore, detecting anomalies in software logs reflect anomalies in the software's execution path or state. So, it has become a…

Software Engineering · Computer Science 2024-08-06 Shayan Hashemi , Mika Mäntylä

Detecting anomalous events in online computer systems is crucial to protect the systems from malicious attacks or malfunctions. System logs, which record detailed information of computational events, are widely used for system status…

Cryptography and Security · Computer Science 2021-03-09 Haixuan Guo , Shuhan Yuan , Xintao Wu

Software systems usually record important runtime information in their logs. Logs help practitioners understand system runtime behaviors and diagnose field failures. As logs are usually very large in size, automated log analysis is needed…

Software Engineering · Computer Science 2020-01-10 Hetong Dai , Heng Li , Weiyi Shang , Tse-Hsun Chen , Che-Shao Chen

Logs produced by extensive software systems are integral to monitoring system behaviors. Advanced log analysis facilitates the detection, alerting, and diagnosis of system faults. Log parsing, which entails transforming raw log messages…

Software Engineering · Computer Science 2025-03-27 Wei Zhang , Xiangyuan Guan , Lu Yunhong , Jie Zhang , Shuangyong Song , Xianfu Cheng , Zhenhe Wu , Zhoujun Li