English
Related papers

Related papers: Adaptive and Efficient Log Parsing as a Cloud Serv…

200 papers

Logs are essential for diagnosing failures and conducting retrospective studies, leading many software organizations to retain log messages for a long time. Nevertheless, the volume of generated log data grows rapidly as software systems…

Software Engineering · Computer Science 2026-03-24 Shiwen Shan , Yintong Huo , Hongzhan Zhong , Zhining Wang , Yuxin Su , Zibin Zheng

With the increasing complexity and rapid expansion of the scale of AI systems in cloud platforms, the log data generated during system operation is massive, unstructured, and semantically ambiguous, which brings great challenges to fault…

Artificial Intelligence · Computer Science 2025-06-24 Cheng Ji , Huaiying Luo

Log parsing is a fundamental step in log analysis, partitioning raw logs into constant templates and dynamic variables. While recent semantic-based parsers leveraging Large Language Models (LLMs) exhibit superior generalizability over…

Software Engineering · Computer Science 2026-03-31 Minxing Wang , Yintong Huo

Log parsing is a fundamental step for automated log analysis, which transforms raw log messages into structured formats. Existing syntax-based parsers struggle with complex logs because they lack semantic reasoning ability. Emerging…

Software Engineering · Computer Science 2026-05-26 Shiwen Shan , Yintong Huo , Minxing Wang , Zhiying Wu , Yuxin Su , Zibin Zheng

Logs serve as a primary source of information for engineers to diagnose failures in large-scale online service systems. Log parsing, which extracts structured events from massive unstructured log data, is a critical first step for…

Software Engineering · Computer Science 2026-03-13 Jinrui Sun , Tong Jia , Minghua He , Ying Li

Logs, being run-time information automatically generated by software, record system events and activities with their timestamps. Before obtaining more insights into the run-time status of the software, a fundamental step of log analysis,…

Software Engineering · Computer Science 2023-02-07 Yintong Huo , Yuxin Su , Cheryl Lee , Michael R. Lyu

Log data is a crucial resource for recording system events and states during system execution. However, as systems grow in scale, log data generation has become increasingly explosive, leading to an expensive overhead on log storage, such…

Software Engineering · Computer Science 2023-09-19 Xiaoyun Li , Hongyu Zhang , Van-Hoang Le , Pengfei Chen

Software systems log massive amounts of data, recording important runtime information. Such logs are used, for example, for log-based anomaly detection, which aims to automatically detect abnormal behaviors of the system under analysis by…

Software Engineering · Computer Science 2024-08-20 Zanis Ali Khan , Donghwan Shin , Domenico Bianculli , Lionel Briand

Logs have been widely adopted in software system development and maintenance because of the rich runtime information they record. In recent years, the increase of software size and complexity leads to the rapid growth of the volume of logs.…

Software Engineering · Computer Science 2023-09-14 Jieming Zhu , Shilin He , Pinjia He , Jinyang Liu , Michael R. Lyu

Modern software systems generate extensive heterogeneous log data with dynamic formats, fragmented event sequences, and varying temporal patterns, making anomaly detection both crucial and challenging. To address these complexities, we…

Artificial Intelligence · Computer Science 2025-12-17 Przemek Pospieszny , Wojciech Mormul , Karolina Szyndler , Sanjeev Kumar

Due to the limited computational capabilities of edge devices, deep learning inference can be quite expensive. One remedy is to compress and transmit point cloud data over the network for server-side processing. Unfortunately, this approach…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Mateen Ulhaq , Ivan V. Bajić

Logs are an essential source of information for people to understand the running status of a software system. Due to the evolving modern software architecture and maintenance methods, more research efforts have been devoted to automated log…

Software Engineering · Computer Science 2024-04-09 Xingfang Wu , Heng Li , Foutse Khomh

Today's high-performance computing (HPC) systems are heavily instrumented, generating logs containing information about abnormal events, such as critical conditions, faults, errors and failures, system resource utilization, and about the…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-24 Byung H. Park , Saurabh Hukerikar , Ryan Adamson , Christian Engelmann

Logs are a first-hand source of information for software maintenance and failure diagnosis. Log parsing, which converts semi-structured log messages into structured templates, is a prerequisite for automated log analysis tasks such as…

Software Engineering · Computer Science 2024-08-16 Andy Xu , Arno Gau

Numerous applications such as financial transactions (e.g., stock trading) are write-heavy in nature. The shift from reads to writes in web applications has also been accelerating in recent years. Write-ahead-logging is a common approach…

Databases · Computer Science 2012-07-03 Hoang Tam Vo , Sheng Wang , Divyakant Agrawal , Gang Chen , Beng Chin Ooi

Nowadays, most systems and applications produce log records that are useful for security and monitoring purposes such as debugging programming errors, checking system status, and detecting configuration problems or even attacks. To this…

Databases · Computer Science 2017-03-09 Carlos Vega , Paula Roquero , Rafael Leira , Ivan Gonzalez , Javier Aracil

Logs record valuable system information at runtime. They are widely used by data-driven approaches for development and monitoring purposes. Parsing log messages to structure their format is a classic preliminary step for log-mining tasks.…

Computation and Language · Computer Science 2023-04-26 Arthur Vervaet , Raja Chiky , Mar Callau-Zori

This paper introduces LogLead, a tool designed for efficient log analysis benchmarking. LogLead combines three essential steps in log processing: loading, enhancing, and anomaly detection. The tool leverages Polars, a high-speed DataFrame…

Software Engineering · Computer Science 2024-01-22 Mika Mäntylä , Yuqing Wang , Jesse Nyyssölä

Logs produced by extensive software systems are integral to monitoring system behaviors. Advanced log analysis facilitates the detection, alerting, and diagnosis of system faults. Log parsing, which entails transforming raw log messages…

Software Engineering · Computer Science 2025-03-27 Wei Zhang , Xiangyuan Guan , Lu Yunhong , Jie Zhang , Shuangyong Song , Xianfu Cheng , Zhenhe Wu , Zhoujun Li

System logs record detailed runtime information of software systems and are used as the main data source for many tasks around software engineering. As modern software systems are evolving into large scale and complex structures, logs have…

Databases · Computer Science 2019-10-02 Jinyang Liu , Jieming Zhu , Shilin He , Pinjia He , Zibin Zheng , Michael R. Lyu