English
Related papers

Related papers: Leveraging Log Instructions in Log-based Anomaly D…

200 papers

The reliability of cloud platforms is of significant relevance because society increasingly relies on complex software systems running on the cloud. To improve it, cloud providers are automating various maintenance tasks, with failure…

Software Engineering · Computer Science 2022-04-07 Jasmin Bogatinovski , Sasho Nedelkoski , Li Wu , Jorge Cardoso , Odej Kao

Nowadays large computers extensively output logs to record the runtime status and it has become crucial to identify any suspicious or malicious activities from the information provided by the realtime logs. Thus, fast log anomaly detection…

Machine Learning · Computer Science 2024-04-16 Yifei Lin , Hanqiu Deng , Xingyu Li

This paper introduces a scalable Anomaly Detection Service with a generalizable API tailored for industrial time-series data, designed to assist Site Reliability Engineers (SREs) in managing cloud infrastructure. The service enables…

Machine Learning · Computer Science 2025-01-29 Nimesh Jha , Shuxin Lin , Srideepika Jayaraman , Kyle Frohling , Christodoulos Constantinides , Dhaval Patel

Log analysis is an important technique that engineers use for troubleshooting faults of large-scale service-oriented systems. In this study, we propose a novel semi-supervised log-based anomaly detection approach, LogDP, which utilizes the…

Software Engineering · Computer Science 2021-10-06 Yongzheng Xie , Hongyu Zhang , Bo Zhang , Muhammad Ali Babar , Sha Lu

Distributed databases are fundamental infrastructures of today's large-scale software systems such as cloud systems. Detecting anomalies in distributed databases is essential for maintaining software availability. Existing approaches,…

Software Engineering · Computer Science 2024-06-13 Lingzhe Zhang , Tong Jia , Mengxi Jia , Ying Li , Yong Yang , Zhonghai Wu

Log anomaly detection is essential for system reliability, but it is extremely challenging to do considering it involves class imbalance. Additionally, the models trained in one domain are not applicable to other domains, necessitating the…

Machine Learning · Computer Science 2026-01-22 Krishna Sharma , Vivek Yelleti

Software and System logs record runtime information about processes executing within a system. These logs have become the most critical and ubiquitous forms of observability data that help developers understand system behavior, monitor…

Artificial Intelligence · Computer Science 2023-02-01 Qian Cheng , Amrita Saha , Wenzhuo Yang , Chenghao Liu , Doyen Sahoo , Steven Hoi

Log-based anomaly detection (LogAD) is critical for maintaining the reliability and availability of large-scale online service systems. While machine learning, deep learning, and large language models (LLMs)-based methods have advanced the…

Software Engineering · Computer Science 2025-10-28 Junjie Huang , Minghua He , Jinyang Liu , Yintong Huo , Domenico Bianculli , Michael R. Lyu

Anomalies represent deviations from the intended system operation and can lead to decreased efficiency as well as partial or complete system failure. As the causes of anomalies are often unknown due to complex system dynamics, efficient…

Machine Learning · Computer Science 2021-08-31 Benjamin Lindemann , Benjamin Maschler , Nada Sahlab , Michael Weyrich

Logs enable the monitoring of infrastructure status and the performance of associated applications. Logs are also invaluable for diagnosing the root causes of any problems that may arise. Log Anomaly Detection (LAD) pipelines automate the…

Machine Learning · Computer Science 2023-10-24 Dipak Wani , Samuel Ackerman , Eitan Farchi , Xiaotong Liu , Hau-wen Chang , Sarasi Lalithsena

The scarcity of high-quality public log datasets has become a critical bottleneck in advancing log-based anomaly detection techniques. Current datasets exhibit three fundamental limitations: (1) incomplete event coverage, (2) artificial…

Software Engineering · Computer Science 2025-04-17 Xinyu Li , Yingtong Huo , Chenxi Mao , Shiwen Shan , Yuxin Su , Dan Li , Zibin Zheng

Anomaly detection is the task of identifying abnormal behavior of a system. Anomaly detection in computational workflows is of special interest because of its wide implications in various domains such as cybersecurity, finance, and social…

Machine Learning · Computer Science 2023-10-03 Hongwei Jin , Krishnan Raghavan , George Papadimitriou , Cong Wang , Anirban Mandal , Ewa Deelman , Prasanna Balaprakash

With the growing reliance on the ubiquitous availability of IT systems and services, these systems become more global, scaled, and complex to operate. To maintain business viability, IT service providers must put in place reliable and cost…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-08 Anna Levin , Shelly Garion , Elliot K. Kolodner , Dean H. Lorenz , Katherine Barabash , Mike Kugler , Niall McShane

Identification of anomalous events within system logs constitutes a pivotal element within the frame- work of cybersecurity defense strategies. However, this process faces numerous challenges, including the management of substantial data…

Cryptography and Security · Computer Science 2025-10-21 Zeng Zhang , Wenjie Yin , Xiaoqi Li

Anomaly detection in computational workflows is critical for ensuring system reliability and security. However, traditional rule-based methods struggle to detect novel anomalies. This paper leverages large language models (LLMs) for…

Software Engineering · Computer Science 2024-07-26 Hongwei Jin , George Papadimitriou , Krishnan Raghavan , Pawel Zuk , Prasanna Balaprakash , Cong Wang , Anirban Mandal , Ewa Deelman

Most log-based anomaly detectors assume logs are stable, though logs are often unstable due to software or environmental changes. Anomaly detection on unstable logs (ULAD) is therefore a more realistic, yet under-investigated challenge.…

Software Engineering · Computer Science 2025-10-10 Fatemeh Hadadi , Qinghua Xu , Domenico Bianculli , Lionel Briand

As the Industrial Internet of Things (IIoT) grows, systems are increasingly being monitored by arrays of sensors returning time-series data at ever-increasing 'volume, velocity and variety' (i.e. Industrial Big Data). An obvious use for…

Machine Learning · Computer Science 2019-10-29 Neil Caithness , David Wallom

Anomaly detection techniques are essential in automating the monitoring of IT systems and operations. These techniques imply that machine learning algorithms are trained on operational data corresponding to a specific period of time and…

Machine Learning · Computer Science 2024-04-12 Lorena Poenaru-Olaru , Natalia Karpova , Luis Cruz , Jan Rellermeyer , Arie van Deursen

In response to the demand for higher computational power, the number of computing nodes in high performance computers (HPC) increases rapidly. Exascale HPC systems are expected to arrive by 2020. With drastic increase in the number of HPC…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-21 Siavash Ghiasvand , Florina M. Ciorba

Anomaly detection is concerned with identifying data patterns that deviate remarkably from the expected behaviour. This is an important research problem, due to its broad set of application domains, from data analysis to e-health,…

Machine Learning · Computer Science 2021-08-23 L. Erhan , M. Ndubuaku , M. Di Mauro , W. Song , M. Chen , G. Fortino , O. Bagdasar , A. Liotta