English
Related papers

Related papers: LogPurge: Log Data Purification for Anomaly Detect…

200 papers

Industry 4.0 will make manufacturing processes smarter but this smartness requires more environmental awareness, which in case of Industrial Internet of Things, is realized by the help of sensors. This article is about industrial…

System logs play a critical role in maintaining the reliability of software systems. Fruitful studies have explored automatic log-based anomaly detection and achieved notable accuracy on benchmark datasets. However, when applied to…

Software Engineering · Computer Science 2023-10-03 Jinyang Liu , Junjie Huang , Yintong Huo , Zhihan Jiang , Jiazhen Gu , Zhuangbin Chen , Cong Feng , Minzhi Yan , Michael R. Lyu

Log-system is an important mechanism for recording the runtime status and events of Web service systems, and anomaly detection in logs is an effective method of detecting problems. However, manual anomaly detection in logs is inefficient,…

Machine Learning · Computer Science 2024-11-26 Jiawei Lu , Chengrong Wu

The rapid advancement of Large Language Models (LLMs) has opened new opportunities in recommender systems by enabling zero-shot recommendation without conventional training. Despite their potential, most existing works rely solely on users'…

Computation and Language · Computer Science 2026-05-01 Seunghwan Bang , Hwanjun Song

This article introduces a novel method for detecting anomalies within log data from control system nodes at the European XFEL accelerator. Effective anomaly detection is crucial for providing operators with a clear understanding of each…

Cryptography and Security · Computer Science 2025-09-26 Antonin Sulc , Annika Eichler , Tim Wilksen

Log analysis is an important technique that engineers use for troubleshooting faults of large-scale service-oriented systems. In this study, we propose a novel semi-supervised log-based anomaly detection approach, LogDP, which utilizes the…

Software Engineering · Computer Science 2021-10-06 Yongzheng Xie , Hongyu Zhang , Bo Zhang , Muhammad Ali Babar , Sha Lu

Logs are one of the most critical data for service management. It contains rich runtime information for both services and users. Since size of logs are often enormous in size and have free handwritten constructions, a typical log-based…

Software Engineering · Computer Science 2022-08-23 Shimin Tao , Weibin Meng , Yimeng Chen , Yichen Zhu , Ying Liu Chunning Du , Tao Han , Yongpeng Zhao , Xiangguang Wang , Hao Yang

Log analysis is crucial for monitoring system health and diagnosing failures in complex systems. Recent advances in large language models (LLMs) offer new opportunities for automated log analysis, leveraging their reasoning capabilities to…

Artificial Intelligence · Computer Science 2025-09-30 Lipeng Ma , Yixuan Li , Weidong Yang , Mingjie Zhou , Xinyi Liu , Ben Fei , Shuhao Li , Xiaoyan Sun , Sihang Jiang , Yanghua Xiao

This paper introduces a scalable Anomaly Detection Service with a generalizable API tailored for industrial time-series data, designed to assist Site Reliability Engineers (SREs) in managing cloud infrastructure. The service enables…

Machine Learning · Computer Science 2025-01-29 Nimesh Jha , Shuxin Lin , Srideepika Jayaraman , Kyle Frohling , Christodoulos Constantinides , Dhaval Patel

River water-quality monitoring is increasingly conducted using automated in situ sensors, enabling timelier identification of unexpected values. However, anomalies caused by technical issues confound these data, while the volume and…

Training in unsupervised time series anomaly detection is constantly plagued by the discrimination between harmful `anomaly contaminations' and beneficial `hard normal samples'. These two samples exhibit analogous loss behavior that…

Machine Learning · Computer Science 2026-03-17 Ruyi Zhang , Hongzuo Xu , Songlei Jian , Yusong Tan , Haifang Zhou , Rulin Xu

Anomaly detection based on system logs plays an important role in intelligent operations, which is a challenging task due to the extremely complex log patterns. Existing methods detect anomalies by capturing the sequential dependencies in…

Machine Learning · Computer Science 2023-07-10 Ling Chen , Chaodu Song , Xu Wang , Dachao Fu , Feifei Li

Due to the complexity and size of modern software systems, the amount of logs generated is tremendous. Hence, it is infeasible to manually investigate these data in a reasonable time, thereby requiring automating log analysis to derive…

Software Engineering · Computer Science 2024-02-09 Stefan Petrescu , Floris den Hengst , Alexandru Uta , Jan S. Rellermeyer

Automated log analysis is crucial to ensure high availability and reliability of complex systems. The advent of LLMs in NLP has ushered in a new era of language model-driven automated log analysis, garnering significant interest. Within…

Software Engineering · Computer Science 2025-01-22 Lipeng Ma , Weidong Yang , Yixuan Li , Ben Fei , Mingjie Zhou , Shuhao Li , Sihang Jiang , Bo Xu , Yanghua Xiao

Large language models (LLMs) are widely used, but concerns about data contamination challenge the reliability of LLM evaluations. Existing contamination detection methods are often task-specific or require extra prerequisites, limiting…

Computation and Language · Computer Science 2024-10-22 Yi Zhao , Jing Li , Linyi Yang

Continuous Integration and Deployment (CI/CD) pipelines are critical to modern software engineering, yet diagnosing and resolving their failures remains complex and labor-intensive. We present LogSage, the first end-to-end LLM-powered…

Software Engineering · Computer Science 2025-10-07 Weiyuan Xu , Juntao Luo , Tao Huang , Kaixin Sui , Jie Geng , Qijun Ma , Isami Akasaka , Xiaoxue Shi , Jing Tang , Peng Cai

Health monitoring is important for maintaining reliable information and communications technology (ICT) systems. Anomaly detection methods based on machine learning, which train a model for describing "normality" are promising for…

Networking and Internet Architecture · Computer Science 2020-03-25 Kengo Tajiri , Yasuhiro Ikeda , Yuusuke Nakano , Keishiro Watanabe

Anomaly detection is a widely explored domain in machine learning. Many models are proposed in the literature, and compared through different metrics measured on various datasets. The most popular metrics used to compare performances are…

Machine Learning · Computer Science 2021-07-01 Damien Fourure , Muhammad Usama Javaid , Nicolas Posocco , Simon Tihon

Ensuring the security of critical infrastructure has become increasingly vital with the proliferation of Internet of Things (IoT) systems. However, the heterogeneous nature of IoT data and the lack of human-comprehensible insights from…

Cryptography and Security · Computer Science 2025-10-07 Ashutosh Ghimire , Ghazal Ghajari , Karma Gurung , Love K. Sah , Fathi Amsaad

Motivated by practical needs of experimentation and policy learning in online platforms, we study the problem of safe data collection. Specifically, our goal is to develop a logging policy that efficiently explores different actions to…

Machine Learning · Computer Science 2022-08-08 Ruihao Zhu , Branislav Kveton