English
Related papers

Related papers: Distributed Log-driven Anomaly Detection System ba…

200 papers

Logs have been an imperative resource to ensure the reliability and continuity of many software systems, especially large-scale distributed systems. They faithfully record runtime information to facilitate system troubleshooting and…

Software Engineering · Computer Science 2022-01-12 Zhuangbin Chen , Jinyang Liu , Wenwei Gu , Yuxin Su , Michael R. Lyu

Event logs are widely used to record the status of high-tech systems, making log anomaly detection important for monitoring those systems. Most existing log anomaly detection methods take a log event count matrix or log event sequences as…

Software Engineering · Computer Science 2024-01-25 Zhong Li , Jiayang Shi , Matthijs van Leeuwen

With the widespread adoption of cloud services, especially the extensive deployment of plenty of Web applications, it is important and challenging to detect anomalies from the packet payload. For example, the anomalies in the packet payload…

Signal Processing · Electrical Eng. & Systems 2021-05-20 Jiaxin Liu , Xucheng Song , Yingjie Zhou , Xi Peng , Yanru Zhang , Pei Liu , Dapeng Wu

Log-system is an important mechanism for recording the runtime status and events of Web service systems, and anomaly detection in logs is an effective method of detecting problems. However, manual anomaly detection in logs is inefficient,…

Machine Learning · Computer Science 2024-11-26 Jiawei Lu , Chengrong Wu

Anomaly detection becomes increasingly important for the dependability and serviceability of IT services. As log lines record events during the execution of IT services, they are a primary source for diagnostics. Thereby, unsupervised…

Machine Learning · Computer Science 2021-09-21 Thorsten Wittkopp , Alexander Acker , Sasho Nedelkoski , Jasmin Bogatinovski , Dominik Scheinert , Wu Fan , Odej Kao

The multi-source data generated by distributed systems, provide a holistic description of the system. Harnessing the joint distribution of the different modalities by a learning model can be beneficial for critical applications for…

Machine Learning · Computer Science 2021-01-14 Jasmin Bogatinovski , Sasho Nedelkoski

Most log-based anomaly detectors assume logs are stable, though logs are often unstable due to software or environmental changes. Anomaly detection on unstable logs (ULAD) is therefore a more realistic, yet under-investigated challenge.…

Software Engineering · Computer Science 2025-10-10 Fatemeh Hadadi , Qinghua Xu , Domenico Bianculli , Lionel Briand

The detection of anomalies is essential mining task for the security and reliability in computer systems. Logs are a common and major data source for anomaly detection methods in almost every computer system. They collect a range of…

Machine Learning · Computer Science 2020-08-24 Sasho Nedelkoski , Jasmin Bogatinovski , Alexander Acker , Jorge Cardoso , Odej Kao

Multivariate anomaly detection can be used to identify outages within large volumes of telemetry data for computing systems. However, developing an efficient anomaly detector that can provide users with relevant information is a challenging…

Machine Learning · Computer Science 2022-02-15 Bruno Wassermann , David Ohana , Ronen Schaffer , Robert Shahla , Elliot K. Kolodner , Eran Raichstein , Michal Malka

Most enterprise applications use logging as a mechanism to diagnose anomalies, which could help with reducing system downtime. Anomaly detection using software execution logs has been explored in several prior studies, using both classical…

Machine Learning · Computer Science 2023-11-01 Nadun Wijesinghe , Hadi Hemmati

Fog and mobile edge computing (MEC) will play a key role in the upcoming fifth generation (5G) mobile networks to support decentralized applications, data analytics and management into the network itself by using a highly distributed…

Log messages record important system runtime information and are useful for detecting anomalous behaviors and managing modern software systems. Many supervised and unsupervised learning methods have been proposed recently for log-based…

Machine Learning · Computer Science 2025-04-07 Yiyuan Xiong , Shaofeng Cai

One of the most challenging problems in the field of intrusion detection is anomaly detection for discrete event logs. While most earlier work focused on applying unsupervised learning upon engineered features, most recent work has started…

Machine Learning · Computer Science 2021-06-04 Lun-Pin Yuan , Peng Liu , Sencun Zhu

An anomaly detection method based on deep autoencoders is proposed to address anomalies that often occur in enterprise-level ETL data streams. The study first analyzes multiple types of anomalies in ETL processes, including delays, missing…

Machine Learning · Computer Science 2025-11-04 Xin Chen , Saili Uday Gadgil , Kangning Gao , Yi Hu , Cong Nie

Modern cloud computing systems contain hundreds to thousands of computing and storage servers. Such a scale, combined with ever-growing system complexity, is causing a key challenge to failure and resource management for dependable cloud…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-17 Haili Wang , Jingda Guo , Xu Ma , Song Fu , Qing Yang , Yunzhong Xu

System logs are some of the most important information for the maintenance of software systems, which have become larger and more complex in recent years. The goal of log-based anomaly detection is to automatically detect system anomalies…

Machine Learning · Computer Science 2024-02-19 Yuuki Yamanaka , Tomokatsu Takahashi , Takuya Minami , Yoshiaki Nakajima

Due to the veracity and heterogeneity in network traffic, detecting anomalous events is challenging. The computational load on global servers is a significant challenge in terms of efficiency, accuracy, and scalability. Our primary…

Machine Learning · Computer Science 2023-03-15 William Marfo , Deepak K. Tosh , Shirley V. Moore

As software systems grow increasingly intricate, the precise detection of anomalies have become both essential and challenging. Current log-based anomaly detection methods depend heavily on vast amounts of log data leading to inefficient…

Software Engineering · Computer Science 2024-09-17 Lingzhe Zhang , Tong Jia , Kangjin Wang , Mengxi Jia , Yang Yong , Ying Li

Random walk based distance measures for graphs such as commute-time distance are useful in a variety of graph algorithms, such as clustering, anomaly detection, and creating low dimensional embeddings. Since such measures hinge on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-16 Aniruddha Basak , Kamalika Das , Ole J. Mengshoel

Artificial Intelligence for IT Operations (AIOps) describes the process of maintaining and operating large IT systems using diverse AI-enabled methods and tools for, e.g., anomaly detection and root cause analysis, to support the…

Artificial Intelligence · Computer Science 2022-07-08 Jasmin Bogatinovski , Gjorgji Madjarov , Sasho Nedelkoski , Jorge Cardoso , Odej Kao