English
Related papers

Related papers: LogLLaMA: Transformer-based log anomaly detection …

200 papers

Logs provide users with useful insights to help with a variety of development and operations tasks. The problem is that logs are often unstructured, making their analysis a complex task. This is mainly due to the lack of guidelines and best…

Software Engineering · Computer Science 2021-11-01 Issam Sedki , Abdelwahab Hamou-Lhadj , Otmane Ait-Mohamed

As LLMs grow in capability, the task of supervising LLMs becomes more challenging. Supervision failures can occur if LLMs are sensitive to factors that supervisors are unaware of. We investigate Mechanistic Anomaly Detection (MAD) as a…

Machine Learning · Computer Science 2025-04-15 David O. Johnston , Arkajyoti Chakraborty , Nora Belrose

Large Language Models (LLMs) have revolutionised natural language processing, exhibiting impressive human-like capabilities. In particular, LLMs are capable of "lying", knowingly outputting false statements. Hence, it is of interest and…

Computation and Language · Computer Science 2024-10-22 Lennart Bürger , Fred A. Hamprecht , Boaz Nadler

Existing anomaly detection (AD) methods for tabular data usually rely on some assumptions about anomaly patterns, leading to inconsistent performance in real-world scenarios. While Large Language Models (LLMs) show remarkable reasoning…

Machine Learning · Computer Science 2026-03-31 Hangting Ye , Jinmeng Li , He Zhao , Mingchen Zhuge , Dandan Guo , Yi Chang , Hongyuan Zha

Due to the complexity of modern IT services, failures can be manifold, occur at any stage, and are hard to detect. For this reason, anomaly detection applied to monitoring data such as logs allows gaining relevant insights to improve IT…

Machine Learning · Computer Science 2023-01-26 Thorsten Wittkopp , Dominik Scheinert , Philipp Wiesner , Alexander Acker , Odej Kao

Software systems log massive amounts of data, recording important runtime information. Such logs are used, for example, for log-based anomaly detection, which aims to automatically detect abnormal behaviors of the system under analysis by…

Software Engineering · Computer Science 2024-08-20 Zanis Ali Khan , Donghwan Shin , Domenico Bianculli , Lionel Briand

Retrieval-Augmented Large Language Models (LLMs), which incorporate the non-parametric knowledge from external knowledge bases into LLMs, have emerged as a promising approach to enhancing response accuracy in several tasks, such as…

Computation and Language · Computer Science 2024-03-29 Soyeong Jeong , Jinheon Baek , Sukmin Cho , Sung Ju Hwang , Jong C. Park

Large Language Models (LLMs) are important tools for reasoning and problem-solving, while they often operate passively, answering questions without actively discovering new ones. This limitation reduces their ability to simulate human-like…

Computational Engineering, Finance, and Science · Computer Science 2025-09-26 Hong Su

With the rapid evolution of Large Language Models (LLMs) and their large-scale experimentation in cloud-computing spaces, the challenge of guaranteeing their security and efficiency in a failure scenario has become a main issue. To ensure…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-18 Yihong Jin , Ze Yang , Xinhe Xu , Yihan Zhang , Shuyang Ji

Anomaly detection on text-rich graphs is widely prevalent in real life, such as detecting incorrectly assigned academic papers to authors and detecting bots in social networks. The remarkable capabilities of large language models (LLMs)…

Computation and Language · Computer Science 2025-08-08 Yunhe Pang , Bo Chen , Fanjin Zhang , Yanghui Rao , Evgeny Kharlamov , Jie Tang

Automatic log analysis is essential for the efficient Operation and Maintenance (O&M) of software systems, providing critical insights into system behaviors. However, existing approaches mostly treat log analysis as training a model to…

Software Engineering · Computer Science 2025-01-10 Yilun Liu , Yuhe Ji , Shimin Tao , Minggui He , Weibin Meng , Shenglin Zhang , Yongqian Sun , Yuming Xie , Boxing Chen , Hao Yang

Large Language Models (LLMs), with their remarkable ability to tackle challenging and unseen reasoning problems, hold immense potential for tabular learning, that is vital for many real-world applications. In this paper, we propose a novel…

Machine Learning · Computer Science 2024-05-07 Sungwon Han , Jinsung Yoon , Sercan O Arik , Tomas Pfister

Log parsing transforms log messages into structured formats, serving as a crucial step for log analysis. Despite a variety of log parsers that have been proposed, their performance on evolving log data remains unsatisfactory due to reliance…

Software Engineering · Computer Science 2025-02-04 Yifan Wu , Siyu Yu , Ying Li

Video Anomaly Detection (VAD) aims to localize abnormal events on the timeline of long-range surveillance videos. Anomaly-scoring-based methods have been prevailing for years but suffer from the high complexity of thresholding and low…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Hui Lv , Qianru Sun

Logical image understanding involves interpreting and reasoning about the relationships and consistency within an image's visual content. This capability is essential in applications such as industrial inspection, where logical anomaly…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Er Jin , Qihui Feng , Yongli Mou , Stefan Decker , Gerhard Lakemeyer , Oliver Simons , Johannes Stegmaier

Text anomaly detection is a critical task in natural language processing (NLP), with applications spanning fraud detection, misinformation identification, spam detection and content moderation, etc. Despite significant advances in large…

Computation and Language · Computer Science 2025-07-17 Feng Xiao , Jicong Fan

It has been shown that finetuned transformers and other supervised detectors effectively distinguish between human and machine-generated text in some situations arXiv:2305.13242, but we find that even simple classifiers on top of n-gram and…

Computation and Language · Computer Science 2024-05-24 Hope McGovern , Rickard Stureborg , Yoshi Suhara , Dimitris Alikaniotis

Large language models (LLMs) have been widely adopted due to their remarkable performance across various applications, driving the accelerated development of a large number of diverse models. However, these individual LLMs show limitations…

Computation and Language · Computer Science 2025-06-13 Kaushal Kumar Maurya , KV Aditya Srivatsa , Ekaterina Kochmar

Anomalies refer to data points or events that deviate from normal and homogeneous events, which can include fraudulent activities, network infiltrations, equipment malfunctions, process changes, or other significant but infrequent events.…

Machine Learning · Computer Science 2023-03-20 Ahmed Shoyeb Raihan , Imtiaz Ahmed

The rapid identification of medical emergencies through digital communication channels remains a critical challenge in modern healthcare delivery, particularly with the increasing prevalence of telemedicine. This paper presents a novel…

Machine Learning · Computer Science 2024-12-24 Ferit Akaybicen , Aaron Cummings , Lota Iwuagwu , Xinyue Zhang , Modupe Adewuyi