English
Related papers

Related papers: Experience Report: Deep Learning-based System Log …

200 papers

The rapid progress of modern computing systems has led to a growing interest in informative run-time logs. Various log-based anomaly detection techniques have been proposed to ensure software reliability. However, their implementation in…

Software Engineering · Computer Science 2023-08-21 Yintong Huo , Yichen Li , Yuxin Su , Pinjia He , Zifan Xie , Michael R. Lyu

Deep learning approaches to anomaly detection have recently improved the state of the art in detection performance on complex datasets such as large collections of images or text. These results have sparked a renewed interest in the anomaly…

Analysis of an organization's computer network activity is a key component of early detection and mitigation of insider threat, a growing concern for many organizations. Raw system logs are a prototypical example of streaming data that can…

Neural and Evolutionary Computing · Computer Science 2017-12-19 Aaron Tuor , Samuel Kaplan , Brian Hutchinson , Nicole Nichols , Sean Robinson

Computer network anomaly detection and log analysis, as an important topic in the field of network security, has been a key task to ensure network security and system reliability. First, existing network anomaly detection and log analysis…

Machine Learning · Computer Science 2024-09-17 Shuzhan Wang , Ruxue Jiang , Zhaoqi Wang , Yan Zhou

This systematic review focuses on anomaly detection for connected and autonomous vehicles. The initial database search identified 2160 articles, of which 203 were included in this review after rigorous screening and assessment. This study…

Machine Learning · Computer Science 2024-05-07 J. R. V. Solaas , N. Tuptuk , E. Mariconti

Logs constitute a form of evidence signaling the operational status of software systems. Automated log anomaly detection is crucial for ensuring the reliability of modern software systems. However, existing approaches face significant…

Log messages record important system runtime information and are useful for detecting anomalous behaviors and managing modern software systems. Many supervised and unsupervised learning methods have been proposed recently for log-based…

Machine Learning · Computer Science 2025-04-07 Yiyuan Xiong , Shaofeng Cai

Anomalies represent rare observations (e.g., data records or events) that deviate significantly from others. Over several decades, research on anomaly mining has received increasing interests due to the implications of these occurrences in…

Machine Learning · Computer Science 2022-04-21 Xiaoxiao Ma , Jia Wu , Shan Xue , Jian Yang , Chuan Zhou , Quan Z. Sheng , Hui Xiong , Leman Akoglu

Anomaly detection is a significant problem faced in several research areas. Detecting and correctly classifying something unseen as anomalous is a challenging problem that has been tackled in many different manners over the years.…

Machine Learning · Computer Science 2021-09-15 Federico Di Mattia , Paolo Galeone , Michele De Simoni , Emanuele Ghelfi

Distributed databases are fundamental infrastructures of today's large-scale software systems such as cloud systems. Detecting anomalies in distributed databases is essential for maintaining software availability. Existing approaches,…

Software Engineering · Computer Science 2024-06-13 Lingzhe Zhang , Tong Jia , Mengxi Jia , Ying Li , Yong Yang , Zhonghai Wu

Machine learning-based medical anomaly detection is an important problem that has been extensively studied. Numerous approaches have been proposed across various medical application domains and we observe several similarities across these…

Machine Learning · Computer Science 2021-04-14 Tharindu Fernando , Harshala Gammulle , Simon Denman , Sridha Sridharan , Clinton Fookes

Anomaly detection is a popular and vital task in various research contexts, which has been studied for several decades. To ensure the safety of people's lives and assets, video surveillance has been widely deployed in various public spaces,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Jing Ren , Feng Xia , Yemeng Liu , Ivan Lee

Software systems often record important runtime information in logs to help with troubleshooting. Log-based anomaly detection has become a key research area that aims to identify system issues through log data, ultimately enhancing the…

Software Engineering · Computer Science 2025-04-15 Wei Guan , Jian Cao , Shiyou Qian , Jianqi Gao , Chun Ouyang

Deep learning (DL) has emerged as a crucial tool in network anomaly detection (NAD) for cybersecurity. While DL models for anomaly detection excel at extracting features and learning patterns from data, they are vulnerable to data…

We propose a supervised anomaly detection method based on neural density estimators, where the negative log likelihood is used for the anomaly score. Density estimators have been widely used for unsupervised anomaly detection. By the recent…

Machine Learning · Statistics 2019-04-15 Tomoharu Iwata , Yuki Yamanaka

Detecting system anomalies based on log data is important for ensuring the security and reliability of computer systems. Recently, deep learning models have been widely used for log anomaly detection. The core idea is to model the log…

Machine Learning · Computer Science 2023-12-12 Xiao Han , Shuhan Yuan , Mohamed Trabelsi

Log data anomaly detection is a core component in the area of artificial intelligence for IT operations. However, the large amount of existing methods makes it hard to choose the right approach for a specific system. A better understanding…

Databases · Computer Science 2021-11-29 Thorsten Wittkopp , Philipp Wiesner , Dominik Scheinert , Odej Kao

Anomaly detection is a crucial task in complex distributed systems. A thorough understanding of the requirements and challenges of anomaly detection is pivotal to the security of such systems, especially for real-world deployment. While…

In order to detect unknown intrusions and runtime errors of computer programs, the cyber-security community has developed various detection techniques. Anomaly detection is an approach that is designed to profile the normal runtime behavior…

Cryptography and Security · Computer Science 2021-06-03 Byunggu Yu , Junwhan Kim

Log analysis is an important technique that engineers use for troubleshooting faults of large-scale service-oriented systems. In this study, we propose a novel semi-supervised log-based anomaly detection approach, LogDP, which utilizes the…

Software Engineering · Computer Science 2021-10-06 Yongzheng Xie , Hongyu Zhang , Bo Zhang , Muhammad Ali Babar , Sha Lu