English
Related papers

Related papers: Multivariate Log-based Anomaly Detection for Distr…

200 papers

This paper introduces a new methodology for detecting anomalies in time series data, with a primary application to monitoring the health of (micro-) services and cloud resources. The main novelty in our approach is that instead of modeling…

Machine Learning · Computer Science 2020-07-31 Fadhel Ayed , Lorenzo Stella , Tim Januschowski , Jan Gasthaus

Anomaly detection in database management systems (DBMSs) is difficult because of increasing number of statistics (stat) and event metrics in big data system. In this paper, I propose an automatic DBMS diagnosis system that detects anomaly…

Machine Learning · Statistics 2018-01-26 Doyup Lee

The log-based analysis and trouble-shooting has remained prevalent and commonly used approach for centralized and time-haring systems. However, for parallel and distributed systems where happen-before relations are not directly available…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-09 K. R. Chowdhary , Rajendra Purohit

Software logs record system activities, aiding maintainers in identifying the underlying causes for failures and enabling prompt mitigation actions. However, maintainers need to inspect a large volume of daily logs to identify the anomalous…

Software Engineering · Computer Science 2023-08-16 Yintong Huo , Cheryl Lee , Yuxin Su , Shiwen Shan , Jinyang Liu , Michael R. Lyu

Data centers play a key role in today's Internet. Cloud applications are mainly hosted on multi-tenant warehouse-scale data centers. Anomalies pose a serious threat to data centers' operations. If not controlled properly, a simple anomaly…

Networking and Internet Architecture · Computer Science 2019-06-18 Ashkan Aghdai , Kang Xi , H. Jonathan Chao

Anomaly detection based on system logs plays an important role in intelligent operations, which is a challenging task due to the extremely complex log patterns. Existing methods detect anomalies by capturing the sequential dependencies in…

Machine Learning · Computer Science 2023-07-10 Ling Chen , Chaodu Song , Xu Wang , Dachao Fu , Feifei Li

Log messages record important system runtime information and are useful for detecting anomalous behaviors and managing modern software systems. Many supervised and unsupervised learning methods have been proposed recently for log-based…

Machine Learning · Computer Science 2025-04-07 Yiyuan Xiong , Shaofeng Cai

Several techniques for multivariate time series anomaly detection have been proposed recently, but a systematic comparison on a common set of datasets and metrics is lacking. This paper presents a systematic and comprehensive evaluation of…

Machine Learning · Computer Science 2021-09-24 Astha Garg , Wenyu Zhang , Jules Samaran , Savitha Ramasamy , Chuan-Sheng Foo

Log-based anomaly detection (LAD) is critical for ensuring the reliability of large-scale distributed systems. However, most existing LAD approaches assume centralized training, which is often impractical due to privacy constraints and the…

Software Engineering · Computer Science 2025-12-10 Yihan Liao , Jacky Keung , Zhenyu Mao , Jingyu Zhang , Jialong Li

The main difficulty in high-dimensional anomaly detection tasks is the lack of anomalous data for training. And simply collecting anomalous data from the real world, common distributions, or the boundary of normal data manifold may face the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Songmin Dai , Jide Li , Lu Wang , Congcong Zhu , Yifan Wu , Xiaoqiang Li

In the era of rapid Internet development, log data has become indispensable for recording the operations of computer devices and software. These data provide valuable insights into system behavior and necessitate thorough analysis. Recent…

Cryptography and Security · Computer Science 2024-09-19 Caihong Wang , Du Xu , Zonghang Li

In large IT systems, software deployment is a crucial process in online services as their code is regularly updated. However, a faulty code change may degrade the target service's performance and cause cascading outages in downstream…

Machine Learning · Computer Science 2024-06-07 Jingchao Ni , Gauthier Guinet , Peihong Jiang , Laurent Callot , Andrey Kan

In data systems, activities or events are continuously collected in the field to trace their proper executions. Logging, which means recording sequences of events, can be used for analyzing system failures and malfunctions, and identifying…

Machine Learning · Computer Science 2021-06-29 Tomer Meirman , Roni Stern , Gilad Katz

Modern software systems have become increasingly complex, which makes them difficult to test and validate. Detecting software partial anomalies in complex systems at runtime can assist with handling unintended software behaviors, avoiding…

Software Engineering · Computer Science 2022-04-27 Shiyi Kong , Jun Ai , Minyan Lu , Shuguang Wang , W. Eric Wong

Logs are extensively used during the development and maintenance of software systems. They collect runtime events and allow tracking of code execution, which enables a variety of critical tasks such as troubleshooting and fault detection.…

Machine Learning · Computer Science 2020-03-20 Sasho Nedelkoski , Jasmin Bogatinovski , Alexander Acker , Jorge Cardoso , Odej Kao

This paper addresses the increasingly prominent problem of anomaly detection in distributed systems. It proposes a detection method based on federated contrastive learning. The goal is to overcome the limitations of traditional centralized…

Machine Learning · Computer Science 2025-06-25 Renzi Meng , Heyi Wang , Yumeng Sun , Qiyuan Wu , Lian Lian , Renhan Zhang

Prompt and accurate detection of system anomalies is essential to ensure the reliability of software systems. Unlike manual efforts that exploit all available run-time information, existing approaches usually leverage only a single type of…

Software Engineering · Computer Science 2023-02-15 Cheryl Lee , Tianyi Yang , Zhuangbin Chen , Yuxin Su , Yongqiang Yang , Michael R. Lyu

Event logs are widely used for anomaly detection and prediction in complex systems. Existing log-based anomaly detection methods usually consist of four main steps: log collection, log parsing, feature extraction, and anomaly detection,…

Machine Learning · Computer Science 2022-12-20 Zhong Li , Matthijs van Leeuwen

With the ubiquitous computing of providing services and applications at anywhere and anytime, cloud computing is the best option as it offers flexible and pay-per-use based services to its customers. Nevertheless, security and privacy are…

Cryptography and Security · Computer Science 2017-11-09 Nour Moustafa , Gideon Creech , Elena Sitnikova , Marwa Keshk

Software systems often record important runtime information in logs to help with troubleshooting. Log-based anomaly detection has become a key research area that aims to identify system issues through log data, ultimately enhancing the…

Software Engineering · Computer Science 2025-04-15 Wei Guan , Jian Cao , Shiyou Qian , Jianqi Gao , Chun Ouyang