English
Related papers

Related papers: Tools and Benchmarks for Automated Log Parsing

200 papers

Log analysis is crucial for ensuring the orderly and stable operation of information systems, particularly in the field of Artificial Intelligence for IT Operations (AIOps). Large Language Models (LLMs) have demonstrated significant…

Computation and Language · Computer Science 2024-07-03 Tianyu Cui , Shiyu Ma , Ziang Chen , Tong Xiao , Shimin Tao , Yilun Liu , Shenglin Zhang , Duoming Lin , Changchang Liu , Yuzhe Cai , Weibin Meng , Yongqian Sun , Dan Pei

Context: Logging is an important part of modern software projects; logs are used in several tasks such as debugging and testing. Due to the complex nature of logging, it remains a difficult task with several pitfalls that could have serious…

Software Engineering · Computer Science 2026-03-11 Nyyti Saarimäki , Donghwan Shin , Domenico Bianculli

Logs are extensively used during the development and maintenance of software systems. They collect runtime events and allow tracking of code execution, which enables a variety of critical tasks such as troubleshooting and fault detection.…

Machine Learning · Computer Science 2020-03-20 Sasho Nedelkoski , Jasmin Bogatinovski , Alexander Acker , Jorge Cardoso , Odej Kao

In the last decade, an impressive increase in software adaptions has led to a surge in log data production, making manual log analysis impractical and establishing the necessity for automated methods. Conversely, most automated analysis…

Software Engineering · Computer Science 2025-11-19 Shayan Hashemi , Mika Mäntylä

Event log analysis is an important task that security professionals undertake. Event logs record key information on activities that occur on computing devices, and due to the substantial number of events generated, they consume a large…

Artificial Intelligence · Computer Science 2025-02-04 Siraaj Akhtar , Saad Khan , Simon Parkinson

Logging code plays an important role in software systems by recording key events and behaviors, which are essential for debugging and monitoring. However, insecure logging practices can inadvertently expose sensitive information or enable…

Software Engineering · Computer Science 2026-04-23 He Yang Yuan , Xin Wang , Kundi Yao , An Ran Chen , Zishuo Ding , Zhenhao Li

Logging statements are central to debugging, failure diagnosis, and production observability, yet writing them requires developers to decide where to place a logging statement, which API and severity level to use, and what runtime…

Software Engineering · Computer Science 2026-04-21 Renyi Zhong , Yichen Li , Yulun Wu , Jinxi Kuang , Yintong Huo , Michael R. Lyu

Logs are a fundamental component of modern computer systems. They enable the analysis and monitoring teams to understand any abnormal or malicious behavior that may have occurred. The continuous increase in the volume of logs generated by…

Information Retrieval · Computer Science 2023-04-25 Arthur Vervaet , Raja Chiky , Mar Callau-Zori

Logs provide first-hand information for engineers to diagnose failures in large-scale online service systems. Log parsing, which transforms semi-structured raw log messages into structured data, is a prerequisite of automated log analysis…

Software Engineering · Computer Science 2022-02-15 Yudong Liu , Xu Zhang , Shilin He , Hongyu Zhang , Liqun Li , Yu Kang , Yong Xu , Minghua Ma , Qingwei Lin , Yingnong Dang , Saravan Rajmohan , Dongmei Zhang

Software and System logs record runtime information about processes executing within a system. These logs have become the most critical and ubiquitous forms of observability data that help developers understand system behavior, monitor…

Artificial Intelligence · Computer Science 2023-02-01 Qian Cheng , Amrita Saha , Wenzhuo Yang , Chenghao Liu , Doyen Sahoo , Steven Hoi

\underline{Context:} Logging is a fundamental yet complex practice in software engineering, essential for monitoring, debugging, and auditing software systems. With the increasing integration of machine learning (ML) components into…

Software Engineering · Computer Science 2026-01-12 Patrick Loic Foalem , Leuson Da Silva , Foutse Khomh , Ettore Merlo , Heng Li

Software systems generate massive, evolving, semi-structured logs that are central to reliability engineering and AIOps, yet difficult to analyze at scale under drift and limited labels. Recent advances in pretrained Transformer models and…

Software Engineering · Computer Science 2026-05-21 Zeyang Ma , Jinqiu Yang , Tse-Hsun Chen

System logs record detailed runtime information of software systems and are used as the main data source for many tasks around software engineering. As modern software systems are evolving into large scale and complex structures, logs have…

Databases · Computer Science 2019-10-02 Jinyang Liu , Jieming Zhu , Shilin He , Pinjia He , Zibin Zheng , Michael R. Lyu

Developers write logging statements to generate logs that provide run-time information for various tasks. The readability of log messages in the logging statements (i.e., the descriptive text) is rather crucial to the value of the generated…

Software Engineering · Computer Science 2023-08-21 Zhenhao Li , An Ran Chen , Xing Hu , Xin Xia , Tse-Hsun Chen , Weiyi Shang

Logs produced by extensive software systems are integral to monitoring system behaviors. Advanced log analysis facilitates the detection, alerting, and diagnosis of system faults. Log parsing, which entails transforming raw log messages…

Software Engineering · Computer Science 2025-03-27 Wei Zhang , Xiangyuan Guan , Lu Yunhong , Jie Zhang , Shuangyong Song , Xianfu Cheng , Zhenhe Wu , Zhoujun Li

Logs are a critical data source for cloud systems, enabling advanced features like monitoring, alerting, and root cause analysis. However, the massive scale and diverse formats of unstructured logs pose challenges for adaptable, efficient,…

Software Engineering · Computer Science 2025-04-15 Zeyan Li , Jie Song , Tieying Zhang , Tao Yang , Xiongjun Ou , Yingjie Ye , Pengfei Duan , Muchen Lin , Jianjun Chen

Today's high-performance computing (HPC) systems are heavily instrumented, generating logs containing information about abnormal events, such as critical conditions, faults, errors and failures, system resource utilization, and about the…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-24 Byung H. Park , Saurabh Hukerikar , Ryan Adamson , Christian Engelmann

Logs are one of the most critical data for service management. It contains rich runtime information for both services and users. Since size of logs are often enormous in size and have free handwritten constructions, a typical log-based…

Software Engineering · Computer Science 2022-08-23 Shimin Tao , Weibin Meng , Yimeng Chen , Yichen Zhu , Ying Liu Chunning Du , Tao Han , Yongpeng Zhao , Xiangguang Wang , Hao Yang

Software logs play an essential role in ensuring the reliability and maintainability of large-scale software systems, as they are often the sole source of runtime information. Log parsing, which converts raw log messages into structured…

Software Engineering · Computer Science 2023-08-22 Van-Hoang Le , Hongyu Zhang

Log parsing, which extracts log templates from semi-structured logs and produces structured logs, is the first and the most critical step in automated log analysis. While existing log parsers have achieved decent results, they suffer from…

Software Engineering · Computer Science 2023-08-15 Junjielong Xu , Qiuai Fu , Zhouruixing Zhu , Yutong Cheng , Zhijing Li , Yuchi Ma , Pinjia He