English
Related papers

Related papers: Logram: Efficient Log Parsing Using n-Gram Diction…

200 papers

Logs are one of the most valuable data sources for managing large-scale online services. After a failure is detected/diagnosed/predicted, operators still have to inspect the raw logs to gain a summarized view before take actions. However,…

Analyzing database access logs is a key part of performance tuning, intrusion detection, benchmark development, and many other database administration tasks. Unfortunately, it is common for production databases to deal with millions or even…

Databases · Computer Science 2018-10-02 Ting Xie , Oliver Kennedy , Varun Chandola

Developers use logging statements to create logs that document system behavior and aid in software maintenance. As such, high-quality logging is essential for effective maintenance; however, manual logging often leads to errors and…

Software Engineering · Computer Science 2025-09-05 Renyi Zhong , Yichen Li , Guangba Yu , Wenwei Gu , Jinxi Kuang , Yintong Huo , Michael R. Lyu

Software systems log massive amounts of data, recording important runtime information. Such logs are used, for example, for log-based anomaly detection, which aims to automatically detect abnormal behaviors of the system under analysis by…

Software Engineering · Computer Science 2024-08-20 Zanis Ali Khan , Donghwan Shin , Domenico Bianculli , Lionel Briand

Log parsing converts semi-structured logs into structured templates, forming a critical foundation for downstream analysis. Traditional syntax and semantic-based parsers often struggle with semantic variations in evolving logs and data…

Software Engineering · Computer Science 2026-01-13 Jianbo Yu , Yixuan Li , Hai Xu , Kang Xu , Junjielong Xu , Zhijing Li , Pinjia He , Wanyuan Wang

Large-scale software systems generate vast volumes of system logs that are essential for monitoring, diagnosing, and performance optimization. However, the unstructured nature and ever-growing scale of these logs present significant…

Software Engineering · Computer Science 2025-04-04 Shu-Wei Huang , Xingfang Wu , Heng Li

Logs serve as a primary source of information for engineers to diagnose failures in large-scale online service systems. Log parsing, which extracts structured events from massive unstructured log data, is a critical first step for…

Software Engineering · Computer Science 2026-03-13 Jinrui Sun , Tong Jia , Minghua He , Ying Li

Logs are a critical data source for cloud systems, enabling advanced features like monitoring, alerting, and root cause analysis. However, the massive scale and diverse formats of unstructured logs pose challenges for adaptable, efficient,…

Software Engineering · Computer Science 2025-04-15 Zeyan Li , Jie Song , Tieying Zhang , Tao Yang , Xiongjun Ou , Yingjie Ye , Pengfei Duan , Muchen Lin , Jianjun Chen

Logs are essential for diagnosing failures and conducting retrospective studies, leading many software organizations to retain log messages for a long time. Nevertheless, the volume of generated log data grows rapidly as software systems…

Software Engineering · Computer Science 2026-03-24 Shiwen Shan , Yintong Huo , Hongzhan Zhong , Zhining Wang , Yuxin Su , Zibin Zheng

In the field of log compression, the prevailing "parse-then-compress" paradigm fundamentally limits effectiveness by treating log parsing and compression as isolated objectives. While parsers prioritize semantic accuracy (i.e., event…

Software Engineering · Computer Science 2026-02-04 Yang Liu , Kaiming Zhang , Zhuangbin Chen , Zibin Zheng

Logging is indispensable for maintaining the reliability and diagnosability of modern software, yet developers still struggle to decide where and how to log effectively. Existing automated logging techniques focus on isolated sub-tasks -…

Software Engineering · Computer Science 2025-07-29 Shengcheng Duan , Yihua Xu , Sheng Zhang , Shen Wang , Yue Duan

Software systems generate massive, evolving, semi-structured logs that are central to reliability engineering and AIOps, yet difficult to analyze at scale under drift and limited labels. Recent advances in pretrained Transformer models and…

Software Engineering · Computer Science 2026-05-21 Zeyang Ma , Jinqiu Yang , Tse-Hsun Chen

Log analysis is crucial for monitoring system health and diagnosing failures in complex systems. Recent advances in large language models (LLMs) offer new opportunities for automated log analysis, leveraging their reasoning capabilities to…

Artificial Intelligence · Computer Science 2025-09-30 Lipeng Ma , Yixuan Li , Weidong Yang , Mingjie Zhou , Xinyi Liu , Ben Fei , Shuhao Li , Xiaoyan Sun , Sihang Jiang , Yanghua Xiao

Logs are widely used to record runtime information of software systems, such as the timestamp and the importance of an event, the unique ID of the source of the log, and a part of the state of a task's execution. The rich information of…

Software Engineering · Computer Science 2022-01-04 Sina Gholamian , Paul A. S. Ward

With the increasing complexity and rapid expansion of the scale of AI systems in cloud platforms, the log data generated during system operation is massive, unstructured, and semantically ambiguous, which brings great challenges to fault…

Artificial Intelligence · Computer Science 2025-06-24 Cheng Ji , Huaiying Luo

Log anomaly detection, which is critical for identifying system failures and preempting security breaches, detects irregular patterns within large volumes of log data, and impacts domains such as service reliability, performance…

Software Engineering · Computer Science 2025-11-19 Shenglin Zhang , Ziang Chen , Zijing Que , Yilun Liu , Yongqian Sun , Sicheng Wei , Dan Pei , Hailin Li

Software logs play an essential role in ensuring the reliability and maintainability of large-scale software systems, as they are often the sole source of runtime information. Log parsing, which converts raw log messages into structured…

Software Engineering · Computer Science 2023-08-22 Van-Hoang Le , Hongyu Zhang

Logs are a first-hand source of information for software maintenance and failure diagnosis. Log parsing, which converts semi-structured log messages into structured templates, is a prerequisite for automated log analysis tasks such as…

Software Engineering · Computer Science 2024-08-16 Andy Xu , Arno Gau

Modern software development and operations rely on monitoring to understand how systems behave in production. The data provided by application logs and runtime environment are essential to detect and diagnose undesired behavior and improve…

Software Engineering · Computer Science 2021-03-08 Jeanderson Barros Cândido , Maurício Finavaro Aniche , Arie van Deursen

Effective alert diagnosis is essential for ensuring the reliability of large-scale online service systems. However, on-call engineers are often burdened with manually inspecting massive volumes of logs to identify root causes. While various…

Software Engineering · Computer Science 2025-10-01 Zhihan Jiang , Jinyang Liu , Yichen Li , Haiyu Huang , Xiao He , Tieying Zhang , Jianjun Chen , Yi Li , Rui Shi , Michael R. Lyu