English
Related papers

Related papers: A layered architecture for log analysis in complex…

200 papers

Dynamical systems, prevalent in various scientific and engineering domains, are susceptible to anomalies that can significantly impact their performance and reliability. This paper addresses the critical challenges of anomaly detection,…

Machine Learning · Computer Science 2025-07-18 Yue Sun , Rick S. Blum , Parv Venkitasubramaniam

Computer network anomaly detection and log analysis, as an important topic in the field of network security, has been a key task to ensure network security and system reliability. First, existing network anomaly detection and log analysis…

Machine Learning · Computer Science 2024-09-17 Shuzhan Wang , Ruxue Jiang , Zhaoqi Wang , Yan Zhou

Anomaly detection in event logs is a promising approach for intrusion detection in enterprise networks. By building a statistical model of usual activity, it aims to detect multiple kinds of malicious behavior, including stealthy tactics,…

Cryptography and Security · Computer Science 2022-06-29 Corentin Larroche , Johan Mazel , Stephan Clémençon

Software-intensive systems produce logs for troubleshooting purposes. Recently, many deep learning models have been proposed to automatically detect system anomalies based on log data. These models typically claim very high detection…

Software Engineering · Computer Science 2022-02-16 Van-Hoang Le , Hongyu Zhang

Software systems often record important runtime information in logs to help with troubleshooting. Log-based anomaly detection has become a key research area that aims to identify system issues through log data, ultimately enhancing the…

Software Engineering · Computer Science 2025-04-15 Wei Guan , Jian Cao , Shiyou Qian , Jianqi Gao , Chun Ouyang

Anomaly detection is a crucial and challenging subject that has been studied within diverse research areas. In this work, we explore the task of log anomaly detection (especially computer system logs and user behavior logs) by analyzing…

Machine Learning · Computer Science 2021-01-08 Yicheng Guo , Yujin Wen , Congwei Jiang , Yixin Lian , Yi Wan

Software logs record system activities, aiding maintainers in identifying the underlying causes for failures and enabling prompt mitigation actions. However, maintainers need to inspect a large volume of daily logs to identify the anomalous…

Software Engineering · Computer Science 2023-08-16 Yintong Huo , Cheryl Lee , Yuxin Su , Shiwen Shan , Jinyang Liu , Michael R. Lyu

I/O efficiency is crucial to productivity in scientific computing, but the increasing complexity of the system and the applications makes it difficult for practitioners to understand and optimize I/O behavior at scale. Data-driven machine…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-19 Mihailo Isakov , Mikaela Currier , Eliakin del Rosario , Sandeep Madireddy , Prasanna Balaprakash , Philip Carns , Robert B. Ross , Glenn K. Lockwood , Michel A. Kinsy

System logs play a critical role in maintaining the reliability of software systems. Fruitful studies have explored automatic log-based anomaly detection and achieved notable accuracy on benchmark datasets. However, when applied to…

Software Engineering · Computer Science 2023-10-03 Jinyang Liu , Junjie Huang , Yintong Huo , Zhihan Jiang , Jiazhen Gu , Zhuangbin Chen , Cong Feng , Minzhi Yan , Michael R. Lyu

Detecting failures and identifying their root causes promptly and accurately is crucial for ensuring the availability of microservice systems. A typical failure troubleshooting pipeline for microservices consists of two phases: anomaly…

Software Engineering · Computer Science 2024-05-16 Luan Pham , Huong Ha , Hongyu Zhang

The analysis of logs is a vital activity undertaken for fault or cyber incident detection, investigation and technical forensics analysis for system and cyber resilience. The potential application of AI algorithms for Log analysis could…

Machine Learning · Computer Science 2023-04-21 Jonathan Pan

Anomaly detection is a crucial task in complex distributed systems. A thorough understanding of the requirements and challenges of anomaly detection is pivotal to the security of such systems, especially for real-world deployment. While…

Artificial Intelligence (AI) has recently attracted a lot of attention, transitioning from research labs to a wide range of successful deployments in many fields, which is particularly true for Deep Learning (DL) techniques. Ultimately, DL…

Artificial Intelligence · Computer Science 2022-03-01 Lixuan Yang , Dario Rossi

Classification algorithms have been widely adopted to detect anomalies for various systems, e.g., IoT, cloud and face recognition, under the common assumption that the data source is clean, i.e., features and labels are correctly set.…

Machine Learning · Computer Science 2019-11-12 Zilong Zhao , Robert Birke , Rui Han , Bogdan Robu , Sara Bouchenak , Sonia Ben Mokhtar , Lydia Y. Chen

Recently, AIOps (Artificial Intelligence for IT Operations) has been well studied in academia and industry to enable automated and effective software service management. Plenty of efforts have been dedicated to AIOps, including anomaly…

Software Engineering · Computer Science 2022-08-09 Zeyan Li , Nengwen Zhao , Shenglin Zhang , Yongqian Sun , Pengfei Chen , Xidao Wen , Minghua Ma , Dan Pei

Modern software development and operations rely on monitoring to understand how systems behave in production. The data provided by application logs and runtime environment are essential to detect and diagnose undesired behavior and improve…

Software Engineering · Computer Science 2021-03-08 Jeanderson Barros Cândido , Maurício Finavaro Aniche , Arie van Deursen

Modern telecom systems are monitored with performance and system logs from multiple application layers and components. Detecting anomalous events from these logs is key to identify security breaches, resource over-utilization,…

Machine Learning · Computer Science 2022-12-22 Abhishek Sarkar , Tanmay Sen , Srimanta Kundu , Arijit Sarkar , Abdul Wazed

The rapid progress of modern computing systems has led to a growing interest in informative run-time logs. Various log-based anomaly detection techniques have been proposed to ensure software reliability. However, their implementation in…

Software Engineering · Computer Science 2023-08-21 Yintong Huo , Yichen Li , Yuxin Su , Pinjia He , Zifan Xie , Michael R. Lyu

Intrusion detection systems (IDS) monitor system logs and network traffic to recognize malicious activities in computer networks. Evaluating and comparing IDSs with respect to their detection accuracies is thereby essential for their…

Cryptography and Security · Computer Science 2023-05-16 Max Landauer , Florian Skopik , Maximilian Frank , Wolfgang Hotwagner , Markus Wurzenberger , Andreas Rauber

Log-based anomaly detection is a essential task for ensuring the reliability and performance of software systems. However, the performance of existing anomaly detection methods heavily relies on labeling, while labeling a large volume of…

Machine Learning · Computer Science 2025-10-10 Chiming Duan , Minghua He , Pei Xiao , Tong Jia , Xin Zhang , Zhewei Zhong , Xiang Luo , Yan Niu , Lingzhe Zhang , Yifan Wu , Siyu Yu , Weijie Hong , Ying Li , Gang Huang