English
Related papers

Related papers: Experience Report: Deep Learning-based System Log …

200 papers

Anomaly detection is of paramount importance in many real-world domains, characterized by evolving behavior. Lifelong learning represents an emerging trend, answering the need for machine learning models that continuously adapt to new…

Machine Learning · Computer Science 2024-04-03 Kamil Faber , Roberto Corizzo , Bartlomiej Sniezynski , Nathalie Japkowicz

AI systems produce large volumes of logs as they interact with tools and users. Analysing these logs can help understand model capabilities, propensities, and behaviours, or assess whether an evaluation worked as intended. Researchers have…

Automated analysis methods are crucial aids for monitoring and defending a network to protect the sensitive or confidential data it hosts. This work introduces a flexible, powerful, and unsupervised approach to detecting anomalous behavior…

Neural and Evolutionary Computing · Computer Science 2017-12-05 Aaron Tuor , Ryan Baerwolf , Nicolas Knowles , Brian Hutchinson , Nicole Nichols , Rob Jasper

In response to the demand for higher computational power, the number of computing nodes in high performance computers (HPC) increases rapidly. Exascale HPC systems are expected to arrive by 2020. With drastic increase in the number of HPC…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-21 Siavash Ghiasvand , Florina M. Ciorba

Nowadays large computers extensively output logs to record the runtime status and it has become crucial to identify any suspicious or malicious activities from the information provided by the realtime logs. Thus, fast log anomaly detection…

Machine Learning · Computer Science 2024-04-16 Yifei Lin , Hanqiu Deng , Xingyu Li

Graph-level anomaly detection has become a critical topic in diverse areas, such as financial fraud detection and detecting anomalous activities in social networks. While most research has focused on anomaly detection for visual data such…

Machine Learning · Computer Science 2022-08-05 Chen Qiu , Marius Kloft , Stephan Mandt , Maja Rudolph

Numerous Deep Learning (DL)-based approaches have gained attention in software Log Anomaly Detection (LAD), yet class imbalance in training data remains a challenge, with anomalies often comprising less than 1% of datasets like Thunderbird.…

Software Engineering · Computer Science 2024-10-31 Xiaoxue Ma , Huiqi Zou , Pinjia He , Jacky Keung , Yishu Li , Xiao Yu , Federica Sarro

The constant increase of devices connected to the Internet, and therefore of cyber-attacks, makes it necessary to analyze network traffic in order to recognize malicious activity. Traditional packet-based analysis methods are insufficient…

The reliability of cloud platforms is of significant relevance because society increasingly relies on complex software systems running on the cloud. To improve it, cloud providers are automating various maintenance tasks, with failure…

Software Engineering · Computer Science 2022-04-07 Jasmin Bogatinovski , Sasho Nedelkoski , Li Wu , Jorge Cardoso , Odej Kao

Given a long list of anomaly detection algorithms developed in the last few decades, how do they perform with regard to (i) varying levels of supervision, (ii) different types of anomalies, and (iii) noisy and corrupted data? In this work,…

Machine Learning · Computer Science 2022-09-20 Songqiao Han , Xiyang Hu , Hailiang Huang , Mingqi Jiang , Yue Zhao

Neural network-based anomaly detection methods have shown to achieve high performance. However, they require a large amount of training data for each task. We propose a neural network-based meta-learning method for supervised anomaly…

Machine Learning · Statistics 2021-03-02 Tomoharu Iwata , Atsutoshi Kumagai

Currently, deep learning-based visual inspection has been highly successful with the help of supervised learning methods. However, in real industrial scenarios, the scarcity of defect samples, the cost of annotation, and the lack of a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Xian Tao , Xinyi Gong , Xin Zhang , Shaohua Yan , Chandranath Adak

Log anomaly detection is essential for system reliability, but it is extremely challenging to do considering it involves class imbalance. Additionally, the models trained in one domain are not applicable to other domains, necessitating the…

Machine Learning · Computer Science 2026-01-22 Krishna Sharma , Vivek Yelleti

With the increase in the learning capability of deep convolution-based architectures, various applications of such models have been proposed over time. In the field of anomaly detection, improvements in deep learning opened new prospects of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Jin-Ha Lee , Marcella Astrid , Muhammad Zaigham Zaheer , Seung-Ik Lee

Anomaly detection has a wide range of real-world applications, such as bank fraud detection and cyber intrusion detection. In the past decade, a variety of anomaly detection models have been developed, which lead to big progress towards…

Machine Learning · Computer Science 2022-02-17 Shuhan Yuan , Xintao Wu

Software and System logs record runtime information about processes executing within a system. These logs have become the most critical and ubiquitous forms of observability data that help developers understand system behavior, monitor…

Artificial Intelligence · Computer Science 2023-02-01 Qian Cheng , Amrita Saha , Wenzhuo Yang , Chenghao Liu , Doyen Sahoo , Steven Hoi

It is widely recognized that deep neural networks are sensitive to bias in the data. This means that during training these models are likely to learn spurious correlations between data and labels, resulting in limited generalization…

Machine Learning · Computer Science 2024-12-06 Vito Paolo Pastore , Massimiliano Ciranni , Davide Marinelli , Francesca Odone , Vittorio Murino

Artificial intelligence operations (AIOps) play a pivotal role in identifying, mitigating, and analyzing anomalous system behaviors and alerts. However, the research landscape in this field remains limited, leaving significant gaps…

Machine Learning · Computer Science 2023-12-13 Daksh Dave , Gauransh Sawhney , Dhruv Khut , Sahil Nawale , Pushkar Aggrawal , Prasenjit Bhavathankar

Log data provides crucial insights for tasks like monitoring, root cause analysis, and anomaly detection. Due to the vast volume of logs, automated log parsing is essential to transform semi-structured log messages into structured…

Machine Learning · Computer Science 2025-05-16 Viktor Beck , Max Landauer , Markus Wurzenberger , Florian Skopik , Andreas Rauber

Time series anomaly detection has applications in a wide range of research fields and applications, including manufacturing and healthcare. The presence of anomalies can indicate novel or unexpected events, such as production faults, system…

Machine Learning · Computer Science 2024-09-04 Zahra Zamanzadeh Darban , Geoffrey I. Webb , Shirui Pan , Charu C. Aggarwal , Mahsa Salehi