English
Related papers

Related papers: Detecting Log Anomalies with Multi-Head Attention …

200 papers

Anomaly detection in computational workflows is critical for ensuring system reliability and security. However, traditional rule-based methods struggle to detect novel anomalies. This paper leverages large language models (LLMs) for…

Software Engineering · Computer Science 2024-07-26 Hongwei Jin , George Papadimitriou , Krishnan Raghavan , Pawel Zuk , Prasanna Balaprakash , Cong Wang , Anirban Mandal , Ewa Deelman

Logs play a crucial role in system monitoring and debugging by recording valuable system information, including events and states. Although various methods have been proposed to detect anomalies in log sequences, they often overlook the…

Machine Learning · Computer Science 2023-09-13 Yufei Li , Yanchi Liu , Haoyu Wang , Zhengzhang Chen , Wei Cheng , Yuncong Chen , Wenchao Yu , Haifeng Chen , Cong Liu

One of the most challenging problems in the field of intrusion detection is anomaly detection for discrete event logs. While most earlier work focused on applying unsupervised learning upon engineered features, most recent work has started…

Machine Learning · Computer Science 2021-06-04 Lun-Pin Yuan , Peng Liu , Sencun Zhu

This work considers the problem of detecting signals from multiple sequentially observed data streams, where only one stream can be observed at every time instant. The goal is to detect signals as quickly as possible while controlling the…

Methodology · Statistics 2026-04-07 Yiming Xing , Georgios Fellouris

Anomalies or failures in large computer systems, such as the cloud, have an impact on a large number of users that communicate, compute, and store information. Therefore, timely and accurate anomaly detection is necessary for reliability,…

Artificial Intelligence · Computer Science 2021-02-24 Harold Ott , Jasmin Bogatinovski , Alexander Acker , Sasho Nedelkoski , Odej Kao

Topological Data Analysis (TDA) gives practioners the ability to analyse the global structure of cybersecurity data. We use TDA for anomaly detection in host-based logs collected with the open-source Logging Made Easy (LME) project. We…

Machine Learning · Computer Science 2022-04-28 Thomas Davies

Computer network anomaly detection and log analysis, as an important topic in the field of network security, has been a key task to ensure network security and system reliability. First, existing network anomaly detection and log analysis…

Machine Learning · Computer Science 2024-09-17 Shuzhan Wang , Ruxue Jiang , Zhaoqi Wang , Yan Zhou

Software systems log massive amounts of data, recording important runtime information. Such logs are used, for example, for log-based anomaly detection, which aims to automatically detect abnormal behaviors of the system under analysis by…

Software Engineering · Computer Science 2024-08-20 Zanis Ali Khan , Donghwan Shin , Domenico Bianculli , Lionel Briand

Detecting anomalous events in online computer systems is crucial to protect the systems from malicious attacks or malfunctions. System logs, which record detailed information of computational events, are widely used for system status…

Cryptography and Security · Computer Science 2021-03-09 Haixuan Guo , Shuhan Yuan , Xintao Wu

Automating the analysis of surveillance video footage is of great interest when urban environments or industrial sites are monitored by a large number of cameras. As anomalies are often context-specific, it is hard to predefine events of…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Bo Li , Sam Leroux , Pieter Simoens

In spite of the rapid advancements in unsupervised log anomaly detection techniques, the current mainstream models still necessitate specific training for individual system datasets, resulting in costly procedures and limited scalability…

Software Engineering · Computer Science 2024-01-17 Runqiang Zang , Hongcheng Guo , Jian Yang , Jiaheng Liu , Zhoujun Li , Tieqiao Zheng , Xu Shi , Liangfan Zheng , Bo Zhang

In recent years, there has been a growing interest in identifying anomalous structure within multivariate data streams. We consider the problem of detecting collective anomalies, corresponding to intervals where one or more of the data…

Methodology · Statistics 2019-09-05 Alexander T M Fisch , Idris A Eckley , Paul Fearnhead

Detection of anomalous situations for complex mission-critical systems hold paramount importance when their service continuity needs to be ensured. A major challenge in detecting anomalies from the operational data arises due to the…

Machine Learning · Computer Science 2025-05-20 Shanay Mehta , Shlok Mehendale , Nicole Fernandes , Jyotirmoy Sarkar , Santonu Sarkar , Snehanshu Saha

Anomaly detection is the process of identifying unexpected events or ab-normalities in data, and it has been applied in many different areas such as system monitoring, fraud detection, healthcare, intrusion detection, etc. Providing…

Machine Learning · Computer Science 2023-01-11 Ming-Chang Lee , Jia-Chun Lin , Ernst Gunnar Gran

Anomalies are intuitively easy for human experts to understand, but they are hard to define mathematically. Therefore, in order to have performance guarantees in unsupervised anomaly detection, priors need to be assumed on what the…

Machine Learning · Statistics 2020-04-08 Tiago Pimentel , Marianne Monteiro , Adriano Veloso , Nivio Ziviani

Due to the complexity of modern IT services, failures can be manifold, occur at any stage, and are hard to detect. For this reason, anomaly detection applied to monitoring data such as logs allows gaining relevant insights to improve IT…

Machine Learning · Computer Science 2023-01-26 Thorsten Wittkopp , Dominik Scheinert , Philipp Wiesner , Alexander Acker , Odej Kao

Anomaly detection for non-linear dynamical system plays an important role in ensuring the system stability. However, it is usually complex and has to be solved by large-scale simulation which requires extensive computing resources. In this…

Signal Processing · Electrical Eng. & Systems 2020-06-08 Yue Tan , Chunjing Hu , Kuan Zhang , Kan Zheng , Ethan A. Davis , Jae Sung Park

Intrusion detection for computer network systems becomes one of the most critical tasks for network administrators today. It has an important role for organizations, governments and our society due to its valuable resources on computer…

Machine Learning · Computer Science 2017-03-30 Loic Bontemps , Van Loi Cao , James McDermott , Nhien-An Le-Khac

In critical applications of anomaly detection including computer security and fraud prevention, the anomaly detector must be configurable by the analyst to minimize the effort on false positives. One important way to configure the anomaly…

Machine Learning · Computer Science 2018-09-19 Shubhomoy Das , Md Rakibul Islam , Nitthilan Kannappan Jayakodi , Janardhan Rao Doppa

Log analysis is one of the main techniques that engineers use for troubleshooting large-scale software systems. Over the years, many supervised, semi-supervised, and unsupervised log analysis methods have been proposed to detect system…

Software Engineering · Computer Science 2024-04-22 Yongzheng Xie , Hongyu Zhang , Muhammad Ali Babar