English
Related papers

Related papers: Multivariate Log-based Anomaly Detection for Distr…

200 papers

Anomaly detection is a longstanding and active research area that has many applications in domains such as finance, security, and manufacturing. However, the efficiency and performance of anomaly detection algorithms are challenged by the…

Machine Learning · Computer Science 2025-04-16 Yang Cao , Haolong Xiang , Hang Zhang , Ye Zhu , Kai Ming Ting

Log-based anomaly detection is critical for ensuring the stability and reliability of web systems. One of the key problems in this task is the lack of sufficient labeled logs, which limits the rapid deployment in new systems. Existing works…

Machine Learning · Computer Science 2026-03-27 Xinlong Zhao , Tong Jia , Minghua He , Xixuan Yang , Ying Li

Detection of anomalous situations for complex mission-critical systems hold paramount importance when their service continuity needs to be ensured. A major challenge in detecting anomalies from the operational data arises due to the…

Machine Learning · Computer Science 2025-05-20 Shanay Mehta , Shlok Mehendale , Nicole Fernandes , Jyotirmoy Sarkar , Santonu Sarkar , Snehanshu Saha

Log files record computational events that reflect system state and behavior, making them a primary source of operational insights in modern computer systems. Automated anomaly detection on logs is therefore critical, yet most established…

Machine Learning · Computer Science 2026-02-04 Simon Dietz , Kai Klede , An Nguyen , Bjoern M Eskofier

The reliability of cloud platforms is of significant relevance because society increasingly relies on complex software systems running on the cloud. To improve it, cloud providers are automating various maintenance tasks, with failure…

Software Engineering · Computer Science 2022-04-07 Jasmin Bogatinovski , Sasho Nedelkoski , Li Wu , Jorge Cardoso , Odej Kao

The rapid progress of modern computing systems has led to a growing interest in informative run-time logs. Various log-based anomaly detection techniques have been proposed to ensure software reliability. However, their implementation in…

Software Engineering · Computer Science 2023-08-21 Yintong Huo , Yichen Li , Yuxin Su , Pinjia He , Zifan Xie , Michael R. Lyu

System logs are a critical resource for monitoring and managing distributed systems, providing insights into failures and anomalous behavior. Traditional log analysis techniques, including template-based and sequence-driven approaches,…

Artificial Intelligence · Computer Science 2025-12-16 Anfeng Peng , Ajesh Koyatan Chathoth , Stephen Lee

In this paper we describe our work on designing a web based, distributed data analysis system based on the popular MapReduce framework deployed on a small cloud; developed specifically for analyzing web server logs. The log analysis system…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-13 Galip Aydin , Ibrahim Riza Hallac

In recent years, there has been a growing interest in identifying anomalous structure within multivariate data streams. We consider the problem of detecting collective anomalies, corresponding to intervals where one or more of the data…

Methodology · Statistics 2019-09-05 Alexander T M Fisch , Idris A Eckley , Paul Fearnhead

Log analysis is one of the main techniques that engineers use for troubleshooting large-scale software systems. Over the years, many supervised, semi-supervised, and unsupervised log analysis methods have been proposed to detect system…

Software Engineering · Computer Science 2024-04-22 Yongzheng Xie , Hongyu Zhang , Muhammad Ali Babar

This paper considers the real-time detection of anomalies in high-dimensional systems. The goal is to detect anomalies quickly and accurately so that the appropriate countermeasures could be taken in time, before the system possibly gets…

Machine Learning · Computer Science 2020-07-16 Mahsa Mozaffari , Yasin Yilmaz

Log anomaly detection (LAD) is essential to ensure safe and stable operation of software systems. Although current LAD methods exhibit significant potential in addressing challenges posed by unstable log events and temporal sequence…

Software Engineering · Computer Science 2024-10-23 Jiyu Tian , Mingchu Li , Zumin Wang , Liming Chen , Jing Qin , Runfa Zhang

The rapid growth of deep learning (DL) has spurred interest in enhancing log-based anomaly detection. This approach aims to extract meaning from log events (log message templates) and develop advanced DL models for anomaly detection.…

Machine Learning · Computer Science 2024-02-01 Lin Yang , Junjie Chen , Shutao Gao , Zhihao Gong , Hongyu Zhang , Yue Kang , Huaan Li

The sophistication and diversity of contemporary cyberattacks have rendered the use of proxies, gateways, firewalls, and encrypted tunnels as a standalone defensive strategy inadequate. Consequently, the proactive identification of data…

Machine Learning · Computer Science 2024-09-24 Liyang Wang , Yu Cheng , Hao Gong , Jiacheng Hu , Xirui Tang , Iris Li

Detecting anomalies in discrete event logs is critical for ensuring system reliability, security, and efficiency. Traditional window-based methods for log anomaly detection often suffer from context bias and fuzzy localization, which hinder…

Software Engineering · Computer Science 2025-01-22 Jiaxing Qi , Chang Zeng , Zhongzhi Luan , Shaohan Huang , Shu Yang , Yao Lu , Hailong Yang , Depei Qian

Artificial intelligence operations (AIOps) play a pivotal role in identifying, mitigating, and analyzing anomalous system behaviors and alerts. However, the research landscape in this field remains limited, leaving significant gaps…

Machine Learning · Computer Science 2023-12-13 Daksh Dave , Gauransh Sawhney , Dhruv Khut , Sahil Nawale , Pushkar Aggrawal , Prasenjit Bhavathankar

As the IT industry advances, system log data becomes increasingly crucial. Many computer systems rely on log texts for management due to restricted access to source code. The need for log anomaly detection is growing, especially in…

Machine Learning · Computer Science 2023-11-10 Gunho No , Yukyung Lee , Hyeongwon Kang , Pilsung Kang

Deep Learning (DL) is vulnerable to out-of-distribution and adversarial examples resulting in incorrect outputs. To make DL more robust, several posthoc (or runtime) anomaly detection techniques to detect (and discard) these anomalous…

Machine Learning · Computer Science 2021-02-23 Saikiran Bulusu , Bhavya Kailkhura , Bo Li , Pramod K. Varshney , Dawn Song

Software systems often record important runtime information in system logs for troubleshooting purposes. There have been many studies that use log data to construct machine learning models for detecting system anomalies. Through our…

Software Engineering · Computer Science 2021-09-01 Van-Hoang Le , Hongyu Zhang

Detection of anomalies among a large number of processes is a fundamental task that has been studied in multiple research areas, with diverse applications spanning from spectrum access to cyber-security. Anomalous events are characterized…

Information Theory · Computer Science 2022-08-12 Benjamin Wolff , Tomer Gafni , Guy Revach , Nir Shlezinger , Kobi Cohen