English
Related papers

Related papers: Log Anomaly Detection with Large Language Models v…

200 papers

This paper introduces an automated fault analysis framework for the Advanced Light Source (ALS) that processes real-time event logs from its EPICS control system. By treating log entries as natural language, we transform them into…

Machine Learning · Computer Science 2025-09-18 Antonin Sulc , Thorsten Hellert , Steven Hunt

Retrieval Augmented Generation (RAG) frameworks have shown significant promise in leveraging external knowledge to enhance the performance of large language models (LLMs). However, conventional RAG methods often retrieve documents based…

Computation and Language · Computer Science 2025-04-02 Pouya Pezeshkpour , Estevam Hruschka

Log anomaly detection is a critical component in modern software system security and maintenance, serving as a crucial support and basis for system monitoring, operation, and troubleshooting. It aids operations personnel in timely…

Software Engineering · Computer Science 2024-07-31 Yingying He , Xiaobing Pei

Anomaly detection based on system logs plays an important role in intelligent operations, which is a challenging task due to the extremely complex log patterns. Existing methods detect anomalies by capturing the sequential dependencies in…

Machine Learning · Computer Science 2023-07-10 Ling Chen , Chaodu Song , Xu Wang , Dachao Fu , Feifei Li

Ontologies are pivotal for structuring knowledge bases to enhance question answering (QA) systems powered by Large Language Models (LLMs). However, traditional ontology creation relies on manual efforts by domain experts, a process that is…

Artificial Intelligence · Computer Science 2025-06-03 Yash Tiwari , Owais Ahmad Lone , Mayukha Pal

Log-based anomaly detection (LogAD) is the main component of Artificial Intelligence for IT Operations (AIOps), which can detect anomalous that occur during the system on-the-fly. Existing methods commonly extract log sequence features…

Machine Learning · Computer Science 2024-12-19 Jiaxing Qi , Chang Zeng , Zhongzhi Luan , Shaohan Huang , Shu Yang , Yao Lu , Bin Han , Hailong Yang , Depei Qian

One of the most challenging problems in the field of intrusion detection is anomaly detection for discrete event logs. While most earlier work focused on applying unsupervised learning upon engineered features, most recent work has started…

Machine Learning · Computer Science 2021-06-04 Lun-Pin Yuan , Peng Liu , Sencun Zhu

This article introduces a novel method for detecting anomalies within log data from control system nodes at the European XFEL accelerator. Effective anomaly detection is crucial for providing operators with a clear understanding of each…

Cryptography and Security · Computer Science 2025-09-26 Antonin Sulc , Annika Eichler , Tim Wilksen

Fully supervised log anomaly detection methods suffer the heavy burden of annotating massive unlabeled log data. Recently, many semi-supervised methods have been proposed to reduce annotation costs with the help of parsed templates.…

Software Engineering · Computer Science 2023-04-12 Hongcheng Guo , Yuhui Guo , Renjie Chen , Jian Yang , Jiaheng Liu , Zhoujun Li , Tieqiao Zheng , Weichao Hou , Liangfan Zheng , Bo Zhang

Retrieval-Augmented Generation (RAG) augments Large Language Models (LLMs) with external knowledge to improve factuality. However, existing RAG systems frequently underutilize the retrieved documents, failing to extract and integrate the…

Computation and Language · Computer Science 2025-10-31 Hao Chen , Yukun Yan , Sen Mei , Wanxiang Che , Zhenghao Liu , Qi Shi , Xinze Li , Yuchun Fan , Pengcheng Huang , Qiushi Xiong , Zhiyuan Liu , Maosong Sun

Detecting anomalies in discrete event logs is critical for ensuring system reliability, security, and efficiency. Traditional window-based methods for log anomaly detection often suffer from context bias and fuzzy localization, which hinder…

Software Engineering · Computer Science 2025-01-22 Jiaxing Qi , Chang Zeng , Zhongzhi Luan , Shaohan Huang , Shu Yang , Yao Lu , Hailong Yang , Depei Qian

Detecting anomalies in general ledger data is of utmost importance to ensure trustworthiness of financial records. Financial audits increasingly rely on machine learning (ML) algorithms to identify irregular or potentially fraudulent…

Machine Learning · Computer Science 2025-09-30 Alexander Bakumenko , Kateřina Hlaváčková-Schindler , Claudia Plant , Nina C. Hubig

Time series anomaly detection is critical for supply chain management to take proactive operations, but faces challenges: classical unsupervised anomaly detection based on exploiting data patterns often yields results misaligned with…

Machine Learning · Computer Science 2026-01-28 Haoting Zhang , Shekhar Jain

With the growth of online services, IoT devices, and DevOps-oriented software development, software log anomaly detection is becoming increasingly important. Prior works mainly follow a traditional four-staged architecture (Preprocessor,…

Software Engineering · Computer Science 2024-08-06 Shayan Hashemi , Mika Mäntylä

Log analysis represents a critical sub-domain within AI applications that facilitates automatic approaches to fault and error management of large-scaled software systems, saving labors of traditional manual methods. While existing solutions…

Computation and Language · Computer Science 2025-08-27 Yuhe Ji , Yilun Liu , Feiyu Yao , Minggui He , Shimin Tao , Xiaofeng Zhao , Su Chang , Xinhua Yang , Weibin Meng , Yuming Xie , Boxing Chen , Shenglin Zhang , Yongqian Sun

With the rapid development of multi-cloud environments, it is increasingly important to ensure the security and reliability of intelligent monitoring systems. In this paper, we propose an anomaly detection and early warning mechanism for…

Machine Learning · Computer Science 2025-06-10 Yihong Jin , Ze Yang , Juntian Liu , Xinhe Xu

Anomaly detection in computational workflows is critical for ensuring system reliability and security. However, traditional rule-based methods struggle to detect novel anomalies. This paper leverages large language models (LLMs) for…

Software Engineering · Computer Science 2024-07-26 Hongwei Jin , George Papadimitriou , Krishnan Raghavan , Pawel Zuk , Prasanna Balaprakash , Cong Wang , Anirban Mandal , Ewa Deelman

Retrieval-Augmented Generation (RAG) systems enhance large language models (LLMs) by integrating external knowledge sources, enabling more accurate and contextually relevant responses tailored to user needs. However, existing RAG systems…

Information Retrieval · Computer Science 2025-04-29 Zirui Guo , Lianghao Xia , Yanhua Yu , Tu Ao , Chao Huang

Automated log analysis is crucial to ensure high availability and reliability of complex systems. The advent of LLMs in NLP has ushered in a new era of language model-driven automated log analysis, garnering significant interest. Within…

Software Engineering · Computer Science 2025-01-22 Lipeng Ma , Weidong Yang , Yixuan Li , Ben Fei , Mingjie Zhou , Shuhao Li , Sihang Jiang , Bo Xu , Yanghua Xiao

Text anomaly detection is a critical task in natural language processing (NLP), with applications spanning fraud detection, misinformation identification, spam detection and content moderation, etc. Despite significant advances in large…

Computation and Language · Computer Science 2025-07-17 Feng Xiao , Jicong Fan