English
Related papers

Related papers: Good Enough to Learn: LLM-based Anomaly Detection …

200 papers

Large Language Models (LLMs) are versatile and demonstrate impressive generalization ability by mining and learning information from extensive unlabeled text. However, they still exhibit reasoning mistakes, often stemming from knowledge…

Computation and Language · Computer Science 2024-08-22 Kai Xiong , Xiao Ding , Li Du , Jiahao Ying , Ting Liu , Bing Qin , Yixin Cao

Anomaly detection (AD) is a fundamental task of critical importance across numerous domains. Current systems increasingly operate in rapidly evolving environments that generate diverse yet interconnected data modalities -- such as time…

Machine Learning · Computer Science 2025-12-02 Zhongyuan Wu , Jingyuan Wang , Zexuan Cheng , Yilong Zhou , Weizhi Wang , Juhua Pu , Chao Li , Changqing Ma

This project explores large language models (LLMs) for anomaly detection across heterogeneous log sources. Traditional intrusion detection systems suffer from high false positive rates, semantic blindness, and data scarcity, as logs are…

Cryptography and Security · Computer Science 2026-02-09 Yassine Chagna , Antal Goldschmidt

Pre-trained language models based on masked language modeling (MLM) excel in natural language understanding (NLU) tasks. While fine-tuned MLM-based encoders consistently outperform causal language modeling decoders of comparable size,…

Computation and Language · Computer Science 2024-06-07 David Dukić , Jan Šnajder

The detection of anomalies is essential mining task for the security and reliability in computer systems. Logs are a common and major data source for anomaly detection methods in almost every computer system. They collect a range of…

Machine Learning · Computer Science 2020-08-24 Sasho Nedelkoski , Jasmin Bogatinovski , Alexander Acker , Jorge Cardoso , Odej Kao

Large language models (LLMs) have shown their potential in long-context understanding and mathematical reasoning. In this paper, we study the problem of using LLMs to detect tabular anomalies and show that pre-trained LLMs are zero-shot…

Machine Learning · Computer Science 2024-06-25 Aodong Li , Yunhan Zhao , Chen Qiu , Marius Kloft , Padhraic Smyth , Maja Rudolph , Stephan Mandt

This article introduces a novel method for detecting anomalies within log data from control system nodes at the European XFEL accelerator. Effective anomaly detection is crucial for providing operators with a clear understanding of each…

Cryptography and Security · Computer Science 2025-09-26 Antonin Sulc , Annika Eichler , Tim Wilksen

Detection of anomalous situations for complex mission-critical systems hold paramount importance when their service continuity needs to be ensured. A major challenge in detecting anomalies from the operational data arises due to the…

Machine Learning · Computer Science 2025-05-20 Shanay Mehta , Shlok Mehendale , Nicole Fernandes , Jyotirmoy Sarkar , Santonu Sarkar , Snehanshu Saha

One of the most challenging problems in the field of intrusion detection is anomaly detection for discrete event logs. While most earlier work focused on applying unsupervised learning upon engineered features, most recent work has started…

Machine Learning · Computer Science 2021-06-04 Lun-Pin Yuan , Peng Liu , Sencun Zhu

Network log data analysis plays a critical role in detecting security threats and operational anomalies. Traditional log analysis methods for anomaly detection and root cause analysis rely heavily on expert knowledge or fully supervised…

Networking and Internet Architecture · Computer Science 2025-09-09 Xuanhao Luo , Shivesh Madan Nath Jha , Akruti Sinha , Zhizhen Li , Yuchen Liu

Effective log anomaly detection is critical to sustaining reliability in large-scale IT infrastructures. Transformer-based models require substantial resources and labeled data, exacerbating the cold-start problem in target domains where…

Software Engineering · Computer Science 2025-12-11 Jingwei Ye , Zhi Wang , Chenbin Su , Jieshuai Yang , Jiayi Ding , Chunbo Liu , Ge Chu

Anomaly detection in large industrial cooling systems is very challenging due to the high data dimensionality, inconsistent sensor recordings, and lack of labels. The state of the art for automated anomaly detection in these systems…

Detecting system anomalies based on log data is important for ensuring the security and reliability of computer systems. Recently, deep learning models have been widely used for log anomaly detection. The core idea is to model the log…

Machine Learning · Computer Science 2023-12-12 Xiao Han , Shuhan Yuan , Mohamed Trabelsi

Anomaly detection in supercomputers is a very difficult problem due to the big scale of the systems and the high number of components. The current state of the art for automated anomaly detection employs Machine Learning methods or…

Machine Learning · Computer Science 2020-07-30 Andrea Borghesi , Andrea Bartolini , Michele Lombardi , Michela Milano , Luca Benini

Multimodal large language models (MLLMs) have recently demonstrated remarkable reasoning and perceptual abilities for anomaly detection. However, most approaches remain confined to image-level anomaly detection and textual reasoning, while…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yizhou Jin , Yuezhu Feng , Jinjin Zhang , Peng Wang , Qingjie Liu , Yunhong Wang

Advanced Persistent Threats (APTs) pose a major cybersecurity challenge due to their stealth and ability to mimic normal system behavior, making detection particularly difficult in highly imbalanced datasets. Traditional anomaly detection…

Cryptography and Security · Computer Science 2025-02-14 Sidahmed Benabderrahmane , Petko Valtchev , James Cheney , Talal Rahwan

Most of the existing methods for anomaly detection use only positive data to learn the data distribution, thus they usually need a pre-defined threshold at the detection stage to determine whether a test instance is an outlier.…

Machine Learning · Computer Science 2019-03-19 Kai Tian , Shuigeng Zhou , Jianping Fan , Jihong Guan

Anomaly detection in complex industrial environments poses unique challenges, particularly in contexts characterized by data sparsity and evolving operational conditions. Predictive maintenance (PdM) in such settings demands methodologies…

Machine Learning · Computer Science 2025-03-12 Alicia Russell-Gilbert , Sudip Mittal , Shahram Rahimi , Maria Seale , Joseph Jabour , Thomas Arnold , Joshua Church

Anomaly detection is to recognize samples that differ in some respect from the training observations. These samples which do not conform to the distribution of normal data are called outliers or anomalies. In real-world anomaly detection…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Vahid Reza Khazaie , Anthony Wong , Yalda Mohsenzadeh

Foundation models, e.g., large language models (LLMs), trained on internet-scale data possess zero-shot generalization capabilities that make them a promising technology towards detecting and mitigating out-of-distribution failure modes of…

Robotics · Computer Science 2024-07-12 Rohan Sinha , Amine Elhafsi , Christopher Agia , Matthew Foutter , Edward Schmerling , Marco Pavone