English
Related papers

Related papers: Experience Report: Deep Learning-based System Log …

200 papers

Anomaly detection is a significant and hence well-studied problem. However, developing effective anomaly detection methods for complex and high-dimensional data remains a challenge. As Generative Adversarial Networks (GANs) are able to…

Machine Learning · Computer Science 2018-12-07 Houssam Zenati , Manon Romain , Chuan Sheng Foo , Bruno Lecouat , Vijay Ramaseshan Chandrasekhar

The problem of detecting a novel class at run time is known as Open Set Detection & is important for various real-world applications like medical application, autonomous driving, etc. Open Set Detection within context of deep learning…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Risheek Garrepalli

Unsupervised Deep Learning (DL) techniques have been widely used in various security-related anomaly detection applications, owing to the great promise of being able to detect unforeseen threats and superior performance provided by Deep…

Cryptography and Security · Computer Science 2021-09-24 Dongqi Han , Zhiliang Wang , Wenqi Chen , Ying Zhong , Su Wang , Han Zhang , Jiahai Yang , Xingang Shi , Xia Yin

Time series anomaly detection is extensively studied in statistics, economics, and computer science. Over the years, numerous methods have been proposed for time series anomaly detection using deep learning-based methods. Many of these…

Machine Learning · Computer Science 2022-08-25 Shahroz Tariq , Binh M. Le , Simon S. Woo

In data systems, activities or events are continuously collected in the field to trace their proper executions. Logging, which means recording sequences of events, can be used for analyzing system failures and malfunctions, and identifying…

Machine Learning · Computer Science 2021-06-29 Tomer Meirman , Roni Stern , Gilad Katz

This paper describes the use of neural networks to enhance simulations for subsequent training of anomaly-detection systems. Simulations can provide edge conditions for anomaly detection which may be sparse or non-existent in real-world…

Neural and Evolutionary Computing · Computer Science 2020-11-06 Philip Feldman

Logs enable the monitoring of infrastructure status and the performance of associated applications. Logs are also invaluable for diagnosing the root causes of any problems that may arise. Log Anomaly Detection (LAD) pipelines automate the…

Machine Learning · Computer Science 2023-10-24 Dipak Wani , Samuel Ackerman , Eitan Farchi , Xiaotong Liu , Hau-wen Chang , Sarasi Lalithsena

Intrusion detection systems (IDS) monitor system logs and network traffic to recognize malicious activities in computer networks. Evaluating and comparing IDSs with respect to their detection accuracies is thereby essential for their…

Cryptography and Security · Computer Science 2023-05-16 Max Landauer , Florian Skopik , Maximilian Frank , Wolfgang Hotwagner , Markus Wurzenberger , Andreas Rauber

This paper presents a simple yet effective method for anomaly detection. The main idea is to learn small perturbations to perturb normal data and learn a classifier to classify the normal data and the perturbed data into two different…

Machine Learning · Computer Science 2023-02-07 Jinyu Cai , Jicong Fan

Logs are semi-structured text generated by logging statements in software source code. In recent decades, software logs have become imperative in the reliability assurance mechanism of many software systems because they are often the only…

Software Engineering · Computer Science 2021-06-02 Shilin He , Pinjia He , Zhuangbin Chen , Tianyi Yang , Yuxin Su , Michael R. Lyu

Software Log anomaly event detection with masked event prediction has various technical approaches with countless configurations and parameters. Our objective is to provide a baseline of settings for similar studies in the future. The…

Software Engineering · Computer Science 2022-08-04 Jesse Nyyssölä , Mika Mäntylä , Martín Varela

Modern information and communication systems have become increasingly challenging to manage. The ubiquitous system logs contain plentiful information and are thus widely exploited as an alternative source for system management. As log files…

Information Retrieval · Computer Science 2024-02-15 Tianzhu Zhang , Han Qiu , Gabriele Castellano , Myriana Rifai , Chung Shue Chen , Fabio Pianese

Existing anomaly detection paradigms overwhelmingly focus on training detection models using exclusively normal data or unlabeled data (mostly normal samples). One notorious issue with these approaches is that they are weak in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Guansong Pang , Choubo Ding , Chunhua Shen , Anton van den Hengel

In this article, we propose using deep learning and transformer architectures combined with classical machine learning algorithms to detect and identify text anomalies in texts. Deep learning model provides a very crucial context…

Computation and Language · Computer Science 2022-11-28 Amir Jafari

Deep Neural Networks (DNNs) are used in a wide variety of applications. However, as in any software application, DNN-based apps are afflicted with bugs. Previous work observed that DNN bug fix patterns are different from traditional bug fix…

Software Engineering · Computer Science 2021-12-09 Mohammad Wardat , Breno Dantas Cruz , Wei Le , Hridesh Rajan

Corner cases are the main bottlenecks when applying Artificial Intelligence (AI) systems to safety-critical applications. An AI system should be intelligent enough to detect such situations so that system developers can prepare for…

Machine Learning · Computer Science 2019-07-02 Vidyasagar Sadhu , Teruhisa Misu , Dario Pompili

In the past two decades, most research on anomaly detection has focused on improving the accuracy of the detection, while largely ignoring the explainability of the corresponding methods and thus leaving the explanation of outcomes to…

Machine Learning · Computer Science 2023-07-12 Zhong Li , Yuxuan Zhu , Matthijs van Leeuwen

Anomaly detection is a branch of data analysis and machine learning which aims at identifying observations that exhibit abnormal behaviour. Be it measurement errors, disease development, severe weather, production quality default(s) (items)…

Machine Learning · Statistics 2024-07-11 Pavlo Mozharovskyi , Romain Valla

Smart manufacturing systems are being deployed at a growing rate because of their ability to interpret a wide variety of sensed information and act on the knowledge gleaned from system observations. In many cases, the principal goal of the…

Machine Learning · Computer Science 2022-06-14 Mustafa Abdallah , Byung-Gun Joung , Wo Jae Lee , Charilaos Mousoulis , John W. Sutherland , Saurabh Bagchi

In the era of rapid Internet development, log data has become indispensable for recording the operations of computer devices and software. These data provide valuable insights into system behavior and necessitate thorough analysis. Recent…

Cryptography and Security · Computer Science 2024-09-19 Caihong Wang , Du Xu , Zonghang Li