English
Related papers

Related papers: What Information Contributes to Log-based Anomaly …

200 papers

Detecting rare events is essential in various fields, e.g., in cyber security or maintenance. Often, human experts are supported by anomaly detection systems as continuously monitoring the data is an error-prone and tedious task. However,…

Machine Learning · Computer Science 2023-02-08 Max Schemmer , Joshua Holstein , Niklas Bauer , Niklas Kühl , Gerhard Satzger

Many organisations manage service quality and monitor a large set devices and servers where each entity is associated with telemetry or physical sensor data series. Recently, various methods have been proposed to detect behavioural…

Social and Information Networks · Computer Science 2023-05-10 Len Feremans , Boris Cule , Bart Goethals

This paper examines the effectiveness of combining active learning and transfer learning for anomaly detection in cross-domain time-series data. Our results indicate that there is an interaction between clustering and active learning and in…

Machine Learning · Computer Science 2025-08-07 John D. Kelleher , Matthew Nicholson , Rahul Agrahari , Clare Conran

The paper develops a Transformer architecture for estimating dynamic factors from multivariate time series data under flexible identification assumptions. Performance on small datasets is improved substantially by using a conventional…

Econometrics · Economics 2026-01-21 Oliver Snellman

Recent efforts towards video anomaly detection (VAD) try to learn a deep autoencoder to describe normal event patterns with small reconstruction errors. The video inputs with large reconstruction errors are regarded as anomalies at the test…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yuandu Lai , Yahong Han , Yaowei Wang

Fault detection is a key challenge in the management of complex systems. In the context of SparkCognition's efforts towards predictive maintenance in large scale industrial systems, this problem is often framed in terms of anomaly detection…

Machine Learning · Computer Science 2024-05-29 Elad Liebman

Deviations from expected behavior during runtime, known as anomalies, have become more common due to the systems' complexity, especially for microservices. Consequently, analyzing runtime monitoring data, such as logs, traces for…

Software Engineering · Computer Science 2024-08-16 Monika Steidl , Benedikt Dornauer , Michael Felderer , Rudolf Ramler , Mircea-Cristian Racasan , Marko Gattringer

The rapidly evolving cloud platforms and the escalating complexity of network traffic demand proper network traffic monitoring and anomaly detection to ensure network security and performance. This paper introduces a large language model…

Networking and Internet Architecture · Computer Science 2025-04-28 Ze Yang , Yihong Jin , Juntian Liu , Xinhe Xu , Yihan Zhang , Shuyang Ji

In the research area of anomaly detection, novel and promising methods are frequently developed. However, most existing studies exclusively focus on the detection task only and ignore the interpretability of the underlying models as well as…

Machine Learning · Computer Science 2023-01-16 Cheng Feng , Pingge Hu

In the current IT world, developers write code while system operators run the code mostly as a black box. The connection between both worlds is typically established with log messages: the developer provides hints to the (unknown) operator,…

Software Engineering · Computer Science 2022-04-07 Jasmin Bogatinovski , Sasho Nedelkoski , Alexander Acker , Jorge Cardoso , Odej Kao

Anomaly detection in sequential data has been studied for a long time because of its potential in various applications, such as detecting abnormal system behaviors from log data. Although many approaches can achieve good performance on…

Machine Learning · Computer Science 2022-10-11 He Cheng , Depeng Xu , Shuhan Yuan , Xintao Wu

Network log data analysis plays a critical role in detecting security threats and operational anomalies. Traditional log analysis methods for anomaly detection and root cause analysis rely heavily on expert knowledge or fully supervised…

Networking and Internet Architecture · Computer Science 2025-09-09 Xuanhao Luo , Shivesh Madan Nath Jha , Akruti Sinha , Zhizhen Li , Yuchen Liu

The detection of anomalies in non-stationary time-series streams is a critical but challenging task across numerous industrial and scientific domains. Traditional models, trained offline, suffer significant performance degradation when…

Machine Learning · Computer Science 2025-09-01 Ashok Devireddy , Shunping Huang

Logs enable the monitoring of infrastructure status and the performance of associated applications. Logs are also invaluable for diagnosing the root causes of any problems that may arise. Log Anomaly Detection (LAD) pipelines automate the…

Machine Learning · Computer Science 2023-10-24 Dipak Wani , Samuel Ackerman , Eitan Farchi , Xiaotong Liu , Hau-wen Chang , Sarasi Lalithsena

In data systems, activities or events are continuously collected in the field to trace their proper executions. Logging, which means recording sequences of events, can be used for analyzing system failures and malfunctions, and identifying…

Machine Learning · Computer Science 2021-06-29 Tomer Meirman , Roni Stern , Gilad Katz

Smart manufacturing systems are being deployed at a growing rate because of their ability to interpret a wide variety of sensed information and act on the knowledge gleaned from system observations. In many cases, the principal goal of the…

Machine Learning · Computer Science 2022-06-14 Mustafa Abdallah , Byung-Gun Joung , Wo Jae Lee , Charilaos Mousoulis , John W. Sutherland , Saurabh Bagchi

Automated log analysis is crucial to ensure high availability and reliability of complex systems. The advent of LLMs in NLP has ushered in a new era of language model-driven automated log analysis, garnering significant interest. Within…

Software Engineering · Computer Science 2025-01-22 Lipeng Ma , Weidong Yang , Yixuan Li , Ben Fei , Mingjie Zhou , Shuhao Li , Sihang Jiang , Bo Xu , Yanghua Xiao

Distributed databases are fundamental infrastructures of today's large-scale software systems such as cloud systems. Detecting anomalies in distributed databases is essential for maintaining software availability. Existing approaches,…

Software Engineering · Computer Science 2024-06-13 Lingzhe Zhang , Tong Jia , Mengxi Jia , Ying Li , Yong Yang , Zhonghai Wu

Although event logs are a powerful source to gain insight about the behavior of the underlying business process, existing work primarily focuses on finding patterns in the activity sequences of an event log, while ignoring event attribute…

Machine Learning · Computer Science 2023-12-25 Marco Bjarne Schuster , Boris Wiegand , Jilles Vreeken

This research aims to know traffic anomalies as early as possible. A traffic anomaly refers to a generic incident on the road that influences traffic flow and calls for urgent traffic management measures. `Knowing'' the occurrence of a…

Machine Learning · Computer Science 2025-04-25 Haocheng Duan , Hao Wu , Sean Qian