English
Related papers

Related papers: LogLLaMA: Transformer-based log anomaly detection …

200 papers

Anomalies represent deviations from the intended system operation and can lead to decreased efficiency as well as partial or complete system failure. As the causes of anomalies are often unknown due to complex system dynamics, efficient…

Machine Learning · Computer Science 2021-08-31 Benjamin Lindemann , Benjamin Maschler , Nada Sahlab , Michael Weyrich

Logs are important in modern software development with runtime information. Log parsing is the first step in many log-based analyses, that involve extracting structured information from unstructured log data. Traditional log parsers face…

Software Engineering · Computer Science 2024-04-30 Zeyang Ma , An Ran Chen , Dong Jae Kim , Tse-Hsun Chen , Shaowei Wang

Modern computing systems, such as HDFS and Spark, produce vast quantities of logs that developers use for tasks like anomaly detection and error analysis. To simplify log analysis, template generation methods have been proposed to…

Databases · Computer Science 2025-08-14 Fei Teng , Haoyang Li , Lei Chen

Recent studies have shown the ability of large language models to perform a variety of tasks, including time series forecasting. The flexible nature of these models allows them to be used for many applications. In this paper, we present a…

Machine Learning · Computer Science 2024-11-04 Sarah Alnegheimish , Linh Nguyen , Laure Berti-Equille , Kalyan Veeramachaneni

Detecting design pattern instances in unfamiliar codebases remains a challenging yet essential task for improving software quality and maintainability. Traditional static analysis tools often struggle with the complexity, variability, and…

Software Engineering · Computer Science 2025-02-26 Christian Schindler , Andreas Rausch

Anomaly detection (AD) is an important machine learning task with many real-world uses, including fraud detection, medical diagnosis, and industrial monitoring. Within natural language processing (NLP), AD helps detect issues like spam,…

Computation and Language · Computer Science 2025-10-13 Tiankai Yang , Yi Nian , Shawn Li , Ruiyao Xu , Yuangang Li , Jiaqi Li , Zhuo Xiao , Xiyang Hu , Ryan Rossi , Kaize Ding , Xia Hu , Yue Zhao

Automatic log file analysis enables early detection of relevant incidents such as system failures. In particular, self-learning anomaly detection techniques capture patterns in log data and subsequently report unexpected log event…

Machine Learning · Computer Science 2023-05-16 Max Landauer , Sebastian Onder , Florian Skopik , Markus Wurzenberger

Transformer, as one of the most advanced neural network models in Natural Language Processing (NLP), exhibits diverse applications in the field of anomaly detection. To inspire research on Transformer-based anomaly detection, this review…

Machine Learning · Computer Science 2024-02-15 Mingrui Ma , Lansheng Han , Chunjie Zhou

Logs are ubiquitous digital footprints, playing an indispensable role in system diagnostics, security analysis, and performance optimization. The extraction of actionable insights from logs is critically dependent on the log parsing…

Software Engineering · Computer Science 2024-08-27 Aoxiao Zhong , Dengyao Mo , Guiyang Liu , Jinbu Liu , Qingda Lu , Qi Zhou , Jiesheng Wu , Quanzheng Li , Qingsong Wen

We propose a novel use of Large Language Models (LLMs) as unsupervised anomaly detectors in particle physics. Using lightweight LLM-like networks with encoder-based architectures trained to reconstruct background events via masked-token…

High Energy Physics - Experiment · Physics 2026-01-28 Ambre Visive , Polina Moskvitina , Clara Nellist , Roberto Ruiz de Austri , Sascha Caron

The massive amount of data available in operational mobile networks offers an invaluable opportunity for operators to detect and analyze possible anomalies and predict network performance. In particular, application of advanced machine…

Networking and Internet Architecture · Computer Science 2020-12-01 Jessica Moysen , Furqan Ahmed , Mario García-Lozano , Jarno Niemelä

Anomaly detection in complex industrial environments poses unique challenges, particularly in contexts characterized by data sparsity and evolving operational conditions. Predictive maintenance (PdM) in such settings demands methodologies…

Machine Learning · Computer Science 2025-03-12 Alicia Russell-Gilbert , Sudip Mittal , Shahram Rahimi , Maria Seale , Joseph Jabour , Thomas Arnold , Joshua Church

With growing public safety demands, text-based person anomaly search has emerged as a critical task, aiming to retrieve individuals with abnormal behaviors via natural language descriptions. Unlike conventional person search, this task…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Hao Ju , Hu Zhang , Zhedong Zheng

Log messages record important system runtime information and are useful for detecting anomalous behaviors and managing modern software systems. Many supervised and unsupervised learning methods have been proposed recently for log-based…

Machine Learning · Computer Science 2025-04-07 Yiyuan Xiong , Shaofeng Cai

Foundation models, e.g., large language models (LLMs), trained on internet-scale data possess zero-shot generalization capabilities that make them a promising technology towards detecting and mitigating out-of-distribution failure modes of…

Robotics · Computer Science 2024-07-12 Rohan Sinha , Amine Elhafsi , Christopher Agia , Matthew Foutter , Edward Schmerling , Marco Pavone

The detection of anomalies is essential mining task for the security and reliability in computer systems. Logs are a common and major data source for anomaly detection methods in almost every computer system. They collect a range of…

Machine Learning · Computer Science 2020-08-24 Sasho Nedelkoski , Jasmin Bogatinovski , Alexander Acker , Jorge Cardoso , Odej Kao

Most log-based anomaly detectors assume logs are stable, though logs are often unstable due to software or environmental changes. Anomaly detection on unstable logs (ULAD) is therefore a more realistic, yet under-investigated challenge.…

Software Engineering · Computer Science 2025-10-10 Fatemeh Hadadi , Qinghua Xu , Domenico Bianculli , Lionel Briand

Vision anomaly detection, particularly in unsupervised settings, often struggles to distinguish between normal samples and anomalies due to the wide variability in anomalies. Recently, an increasing number of studies have focused on…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Dong Chen , Zhengqing Hu , Peiguang Fan , Yueting Zhuang , Yafei Li , Qidong Liu , Xiaoheng Jiang , Mingliang Xu

As software systems grow increasingly intricate, the precise detection of anomalies have become both essential and challenging. Current log-based anomaly detection methods depend heavily on vast amounts of log data leading to inefficient…

Software Engineering · Computer Science 2024-09-17 Lingzhe Zhang , Tong Jia , Kangjin Wang , Mengxi Jia , Yang Yong , Ying Li

The widespread adoption of Large Language Models (LLMs) in critical applications has introduced severe reliability and security risks, as LLMs remain vulnerable to notorious threats such as hallucinations, jailbreak attacks, and backdoor…

Cryptography and Security · Computer Science 2026-04-07 Shide Zhou , Kailong Wang , Ling Shi , Haoyu Wang