English
Related papers

Related papers: LogPurge: Log Data Purification for Anomaly Detect…

200 papers

Log data have facilitated various tasks of software development and maintenance, such as testing, debugging and diagnosing. Due to the unstructured nature of logs, log parsing is typically required to transform log messages into structured…

Software Engineering · Computer Science 2024-03-26 Zhihan Jiang , Jinyang Liu , Junjie Huang , Yichen Li , Yintong Huo , Jiazhen Gu , Zhuangbin Chen , Jieming Zhu , Michael R. Lyu

Logs are essential for understanding Continuous Integration (CI) behavior, particularly for diagnosing build failures and performance regressions. Yet their growing volume and verbosity make both manual inspection and automated analysis…

Software Engineering · Computer Science 2026-01-29 Marcus Emmanuel Barnes , Taher A. Ghaleb , Safwat Hassan

Smart grids rely on high-dimensional numeric telemetry and explicit operating rules to maintain reliable and secure operation. Recent large language models (LLMs) are increasingly considered as candidate decision-support components for…

Systems and Control · Electrical Eng. & Systems 2026-05-06 Yichen Liu , Hongyu Wu , Bo Liu

Web log data is usually diverse and voluminous. This data must be assembled into a consistent, integrated and comprehensive view, in order to be used for pattern discovery. Without properly cleaning, transforming and structuring the data…

Databases · Computer Science 2011-05-03 C. Ramya , G. Kavitha , Dr. K. S. Shreedhara

Log data are generated from logging statements in the source code, providing insights into the execution processes of software applications and systems. State-of-the-art log-based anomaly detection approaches typically leverage deep…

Software Engineering · Computer Science 2025-03-12 Xingfang Wu , Heng Li , Foutse Khomh

Huge datasets in cyber security, such as network traffic logs, can be analyzed using machine learning and data mining methods. However, the amount of collected data is increasing, which makes analysis more difficult. Many machine learning…

Machine Learning · Computer Science 2014-10-30 Antti Juvonen , Tuomo Sipola

Log parsing transforms raw logs into structured templates containing constants and variables. It underpins anomaly detection, failure diagnosis, and other AIOps tasks. Current parsers are mostly reactive and log-centric. They only infer…

Software Engineering · Computer Science 2025-12-05 Jiaqi Sun , Wei Li , Heng Zhang , Chutong Ding , Shiyou Qian , Jian Cao , Guangtao Xue

Modern distributed systems generate massive volumes of log data that are critical for detecting anomalies and cyber threats. However, in real world settings, these logs are often distributed across multiple organizations and cannot be…

Cryptography and Security · Computer Science 2026-04-22 Isaiah Thompson , Tanmay Sen , Ritwik Bhattacharya

End-point monitoring solutions are widely deployed in today's enterprise environments to support advanced attack detection and investigation. These monitors continuously record system-level activities as audit logs and provide deep…

Cryptography and Security · Computer Science 2026-02-16 Hao Zhang , Shuo Shao , Song Li , Zhenyu Zhong , Yan Liu , Zhan Qin

Numerous Deep Learning (DL)-based approaches have gained attention in software Log Anomaly Detection (LAD), yet class imbalance in training data remains a challenge, with anomalies often comprising less than 1% of datasets like Thunderbird.…

Software Engineering · Computer Science 2024-10-31 Xiaoxue Ma , Huiqi Zou , Pinjia He , Jacky Keung , Yishu Li , Xiao Yu , Federica Sarro

System logs are a cornerstone of cybersecurity, supporting proactive breach prevention and post-incident investigations. However, analyzing vast amounts of diverse log data remains significantly challenging, as high costs, lack of in-house…

Artificial Intelligence · Computer Science 2025-10-29 Peng Cai , Reza Ryan , Nickson M. Karie

Logs are essential for diagnosing failures and conducting retrospective studies, leading many software organizations to retain log messages for a long time. Nevertheless, the volume of generated log data grows rapidly as software systems…

Software Engineering · Computer Science 2026-03-24 Shiwen Shan , Yintong Huo , Hongzhan Zhong , Zhining Wang , Yuxin Su , Zibin Zheng

Anomalies represent deviations from the intended system operation and can lead to decreased efficiency as well as partial or complete system failure. As the causes of anomalies are often unknown due to complex system dynamics, efficient…

Machine Learning · Computer Science 2021-08-31 Benjamin Lindemann , Benjamin Maschler , Nada Sahlab , Michael Weyrich

Anomaly detection often relies on supervised or clustering approaches, with limited success in specialized domains like automotive communication systems where scalable solutions are essential. We propose a novel decoder-only Large Language…

Machine Learning · Computer Science 2025-07-03 Bogdan Bogdan , Arina Cazacu , Laura Vasilie

Data profiling is critical in machine learning for generating descriptive statistics, supporting both deeper understanding and downstream tasks like data valuation and curation. This work addresses profiling specifically in the context of…

Software Engineering · Computer Science 2025-03-21 Pankaj Thorat , Adnan Qidwai , Adrija Dhar , Aishwariya Chakraborty , Anand Eswaran , Hima Patel , Praveen Jayachandran

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access broader knowledge sources, yet factual inconsistencies persist due to noise in retrieved documents-even with advanced retrieval methods. We demonstrate that…

Computation and Language · Computer Science 2025-06-04 Yongjian Li , HaoCheng Chu , Yukun Yan , Zhenghao Liu , Shi Yu , Zheni Zeng , Ruobing Wang , Sen Song , Zhiyuan Liu , Maosong Sun

Large Language Models (LLMs) have become foundational in modern artificial intelligence, powering a wide range of applications from code generation and virtual assistants to scientific research and enterprise automation. However, concerns…

Machine Learning · Computer Science 2025-05-20 Le Vu Anh , Dinh Duc Nha Nguyen , Phi Long Nguyen

In the digital era, accidental exposure of sensitive information such as API keys, tokens, and credentials is a growing security threat. While most prior work focuses on detecting secrets in source code, leakage in software issue reports…

Software Engineering · Computer Science 2026-04-17 Sadif Ahmed , Md Nafiu Rahman , Zahin Wahab , Gias Uddin , Rifat Shahriyar

Anomaly detection is critical in industrial manufacturing for ensuring product quality and improving efficiency in automated processes. The scarcity of anomalous samples limits traditional detection methods, making anomaly generation…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Xuan Tong , Yang Chang , Qing Zhao , Jiawen Yu , Boyang Wang , Junxiong Lin , Yuxuan Lin , Xinji Mai , Haoran Wang , Zeng Tao , Yan Wang , Wenqiang Zhang

Log data store event execution patterns that correspond to underlying workflows of systems or applications. While most logs are informative, log data also include artifacts that indicate failures or incidents. Accordingly, log data are…

Machine Learning · Computer Science 2024-09-06 Max Landauer , Florian Skopik , Markus Wurzenberger