English
Related papers

Related papers: LogLLM: Log-based Anomaly Detection Using Large La…

200 papers

The scarcity of high-quality public log datasets has become a critical bottleneck in advancing log-based anomaly detection techniques. Current datasets exhibit three fundamental limitations: (1) incomplete event coverage, (2) artificial…

Software Engineering · Computer Science 2025-04-17 Xinyu Li , Yingtong Huo , Chenxi Mao , Shiwen Shan , Yuxin Su , Dan Li , Zibin Zheng

System logs are a critical resource for monitoring and managing distributed systems, providing insights into failures and anomalous behavior. Traditional log analysis techniques, including template-based and sequence-driven approaches,…

Artificial Intelligence · Computer Science 2025-12-16 Anfeng Peng , Ajesh Koyatan Chathoth , Stephen Lee

Anomaly detection (AD) is an important machine learning task with many real-world uses, including fraud detection, medical diagnosis, and industrial monitoring. Within natural language processing (NLP), AD helps detect issues like spam,…

Computation and Language · Computer Science 2025-10-13 Tiankai Yang , Yi Nian , Shawn Li , Ruiyao Xu , Yuangang Li , Jiaqi Li , Zhuo Xiao , Xiyang Hu , Ryan Rossi , Kaize Ding , Xia Hu , Yue Zhao

Large language models (LLMs) have demonstrated remarkable capabilities across various domains, yet their application to relational deep learning (RDL) remains underexplored. Existing approaches adapt LLMs by traversing relational links…

Computation and Language · Computer Science 2025-06-09 Fang Wu , Vijay Prakash Dwivedi , Jure Leskovec

Large language models (LLMs) have been widely adopted due to their remarkable performance across various applications, driving the accelerated development of a large number of diverse models. However, these individual LLMs show limitations…

Computation and Language · Computer Science 2025-06-13 Kaushal Kumar Maurya , KV Aditya Srivatsa , Ekaterina Kochmar

Large Language Models (LLMs) have become a focal point of research across various domains, including software engineering, where their capabilities are increasingly leveraged. Recent studies have explored the integration of LLMs into…

Software Engineering · Computer Science 2024-10-14 Yi Wen Heng , Zeyang Ma , Zhenhao Li , Dong Jae Kim , Tse-Hsun , Chen

Logs are important in modern software development with runtime information. Log parsing is the first step in many log-based analyses, that involve extracting structured information from unstructured log data. Traditional log parsers face…

Software Engineering · Computer Science 2024-04-30 Zeyang Ma , An Ran Chen , Dong Jae Kim , Tse-Hsun Chen , Shaowei Wang

Time series anomaly detection is critical for supply chain management to take proactive operations, but faces challenges: classical unsupervised anomaly detection based on exploiting data patterns often yields results misaligned with…

Machine Learning · Computer Science 2026-01-28 Haoting Zhang , Shekhar Jain

Logging code is written by developers to capture system runtime behavior and plays a vital role in debugging, performance analysis, and system monitoring. However, defects in logging code can undermine the usefulness of logs and lead to…

Software Engineering · Computer Science 2025-08-18 Xin Wang , Zhenhao Li , Zishuo Ding

Large Language Model (LLM)-based systems present new opportunities for autonomous health monitoring in sensor-rich industrial environments. This study explores the potential of LLMs to detect and classify faults directly from sensor data,…

Artificial Intelligence · Computer Science 2025-09-30 Xian Yeow Lee , Lasitha Vidyaratne , Ahmed Farahat , Chetan Gupta

Advanced Persistent Threats (APTs) pose a major cybersecurity challenge due to their stealth and ability to mimic normal system behavior, making detection particularly difficult in highly imbalanced datasets. Traditional anomaly detection…

Cryptography and Security · Computer Science 2025-02-14 Sidahmed Benabderrahmane , Petko Valtchev , James Cheney , Talal Rahwan

Despite various approaches being employed to detect vulnerabilities, the number of reported vulnerabilities shows an upward trend over the years. This suggests the problems are not caught before the code is released, which could be caused…

Cryptography and Security · Computer Science 2025-02-14 Karl Tamberg , Hayretdin Bahsi

Modern computing systems, such as HDFS and Spark, produce vast quantities of logs that developers use for tasks like anomaly detection and error analysis. To simplify log analysis, template generation methods have been proposed to…

Databases · Computer Science 2025-08-14 Fei Teng , Haoyang Li , Lei Chen

Large language models (LLMs) are effective at capturing complex, valuable conceptual representations from textual data for a wide range of real-world applications. However, in fields like Intelligent Fault Diagnosis (IFD), incorporating…

Artificial Intelligence · Computer Science 2024-12-03 Hamzah A. A. M. Qaid , Bo Zhang , Dan Li , See-Kiong Ng , Wei Li

Large language models (LLMs) have shown their potential in long-context understanding and mathematical reasoning. In this paper, we study the problem of using LLMs to detect tabular anomalies and show that pre-trained LLMs are zero-shot…

Machine Learning · Computer Science 2024-06-25 Aodong Li , Yunhan Zhao , Chen Qiu , Marius Kloft , Padhraic Smyth , Maja Rudolph , Stephan Mandt

Self-supervised methods have gained prominence in time series anomaly detection due to the scarcity of available annotations. Nevertheless, they typically demand extensive training data to acquire a generalizable representation map, which…

Machine Learning · Computer Science 2024-01-30 Chen Liu , Shibo He , Qihang Zhou , Shizhong Li , Wenchao Meng

System logs play a critical role in maintaining the reliability of software systems. Fruitful studies have explored automatic log-based anomaly detection and achieved notable accuracy on benchmark datasets. However, when applied to…

Software Engineering · Computer Science 2023-10-03 Jinyang Liu , Junjie Huang , Yintong Huo , Zhihan Jiang , Jiazhen Gu , Zhuangbin Chen , Cong Feng , Minzhi Yan , Michael R. Lyu

Background: Log messages provide valuable information about the status of software systems. This information is provided in an unstructured fashion and automated approaches are applied to extract relevant parameters. To ease this process,…

Software Engineering · Computer Science 2024-09-05 Merve Astekin , Max Hort , Leon Moonen

Automated logging statement generation supports developers in documenting critical software runtime behavior. Given the great success in natural language generation and programming language comprehension, large language models (LLMs) might…

Software Engineering · Computer Science 2024-04-02 Yichen Li , Yintong Huo , Zhihan Jiang , Renyi Zhong , Pinjia He , Yuxin Su , Lionel Briand , Michael R. Lyu

Software vulnerability detection is generally supported by automated static analysis tools, which have recently been reinforced by deep learning (DL) models. However, despite the superior performance of DL-based approaches over rule-based…

Software Engineering · Computer Science 2024-05-03 Yanjing Yang , Xin Zhou , Runfeng Mao , Jinwei Xu , Lanxin Yang , Yu Zhangm , Haifeng Shen , He Zhang