English
Related papers

Related papers: Tools and Benchmarks for Automated Log Parsing

200 papers

Logging plays a central role in ensuring reproducibility, observability, and reliability in machine learning (ML) systems. While logging is generally considered a good engineering practice, poorly designed logging can negatively affect…

Software Engineering · Computer Science 2026-03-26 Patrick Loic Foalem , Leuson Da Silva , Foutse Khomh , Heng Li , Ettore Merlo

Logging statements are essential for software debugging and maintenance. However, existing approaches to automatic logging generation rely on static analysis and produce statements in a single pass without considering runtime behavior. They…

Software Engineering · Computer Science 2026-04-01 Xin Wang , Yang Feng , Jiaoxiao Qian , Yang Zhang , Zhenhao Li , Zishuo Ding

System logs constitute valuable information for analysis and diagnosis of system behavior. The size of parallel computing systems and the number of their components steadily increase. The volume of generated logs by the system is in…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-23 Siavash Ghiasvand , Florina M. Ciorba

Logs generated by large-scale software systems provide crucial information for engineers to understand the system status and diagnose problems of the systems. Log parsing, which converts raw log messages into structured data, is the first…

Software Engineering · Computer Science 2023-02-16 Van-Hoang Le , Hongyu Zhang

Log parsing serves as an essential prerequisite for various log analysis tasks. Recent advancements in this field have improved parsing accuracy by leveraging the semantics in logs through fine-tuning large language models (LLMs) or…

Software Engineering · Computer Science 2024-08-09 Junjie Huang , Zhihan Jiang , Zhuangbin Chen , Michael R. Lyu

Logs are a common way to record detailed run-time information in software. As modern software systems evolve in scale and complexity, logs have become indispensable to understanding the internal states of the system. At the same time…

Machine Learning · Computer Science 2021-03-15 Armin Catovic , Carolyn Cartwright , Yasmin Tesfaldet Gebreyesus , Simone Ferlin

Large-scale software systems generate vast volumes of system logs that are essential for monitoring, diagnosing, and performance optimization. However, the unstructured nature and ever-growing scale of these logs present significant…

Software Engineering · Computer Science 2025-04-04 Shu-Wei Huang , Xingfang Wu , Heng Li

Automatic log analysis is essential for the efficient Operation and Maintenance (O&M) of software systems, providing critical insights into system behaviors. However, existing approaches mostly treat log analysis as training a model to…

Software Engineering · Computer Science 2025-01-10 Yilun Liu , Yuhe Ji , Shimin Tao , Minggui He , Weibin Meng , Shenglin Zhang , Yongqian Sun , Yuming Xie , Boxing Chen , Hao Yang

Event logs are invaluable for conducting process mining projects, offering insights into process improvement and data-driven decision-making. However, data quality issues affect the correctness and trustworthiness of these insights, making…

Databases · Computer Science 2023-10-09 Ying Liu , Vinicius Stein Dani , Iris Beerepoot , Xixi Lu

Predictive monitoring of business processes is concerned with the prediction of ongoing cases on a business process. Lately, the popularity of deep learning techniques has propitiated an ever-growing set of approaches focused on predictive…

Machine Learning · Computer Science 2021-11-01 Efrén Rama-Maneiro , Juan C. Vidal , Manuel Lama

Beyond self-report data, we lack reliable and non-intrusive methods for identifying flow. However, taking a step back and acknowledging that flow occurs during periods of focus gives us the opportunity to make progress towards measuring…

Human-Computer Interaction · Computer Science 2023-04-11 Adam Brown , Sarah D'Angelo , Ben Holtz , Ciera Jaspen , Collin Green

Execution logs are a crucial medium as they record runtime information of software systems. Although extensive logs are helpful to provide valuable details to identify the root cause in postmortem analysis in case of a failure, this may…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-20 Sina Gholamian , Paul A. S. Ward

Log analysis is crucial for monitoring system health and diagnosing failures in complex systems. Recent advances in large language models (LLMs) offer new opportunities for automated log analysis, leveraging their reasoning capabilities to…

Artificial Intelligence · Computer Science 2025-09-30 Lipeng Ma , Yixuan Li , Weidong Yang , Mingjie Zhou , Xinyi Liu , Ben Fei , Shuhao Li , Xiaoyan Sun , Sihang Jiang , Yanghua Xiao

Logs are one of the most valuable data sources for managing large-scale online services. After a failure is detected/diagnosed/predicted, operators still have to inspect the raw logs to gain a summarized view before take actions. However,…

With the recent advances of deep learning techniques, there are rapidly growing interests in applying machine learning to log data. As a fundamental part of log analytics, accurate log parsing that transforms raw logs to structured events…

Software Engineering · Computer Science 2022-02-16 Lei Yu , Tian Wu , Jiaqi Li , Patrick Chan , Hong Min , Fanjing Meng

Logs provide valuable insights into system runtime and assist in software development and maintenance. Log parsing, which converts semi-structured log data into structured log data, is often the first step in automated log analysis. Given…

Software Engineering · Computer Science 2025-10-31 Nafid Enan , Gias Uddin

Logs are essential for diagnosing failures and conducting retrospective studies, leading many software organizations to retain log messages for a long time. Nevertheless, the volume of generated log data grows rapidly as software systems…

Software Engineering · Computer Science 2026-03-24 Shiwen Shan , Yintong Huo , Hongzhan Zhong , Zhining Wang , Yuxin Su , Zibin Zheng

Automated log analysis is crucial in modern software-intensive systems for facilitating program comprehension throughout software maintenance and engineering life cycles. Existing methods perform tasks such as log parsing and log anomaly…

Software Engineering · Computer Science 2024-01-29 Yilun Liu , Shimin Tao , Weibin Meng , Jingyu Wang , Wenbing Ma , Yanqing Zhao , Yuhang Chen , Hao Yang , Yanfei Jiang , Xun Chen

Machine learning (ML) has become a vital part in many aspects of our daily life. However, building well performing machine learning applications requires highly specialized data scientists and domain experts. Automated machine learning…

Machine Learning · Computer Science 2021-01-27 Marc-André Zöller , Marco F. Huber

Large Language Models (LLMs) have become a focal point of research across various domains, including software engineering, where their capabilities are increasingly leveraged. Recent studies have explored the integration of LLMs into…

Software Engineering · Computer Science 2024-10-14 Yi Wen Heng , Zeyang Ma , Zhenhao Li , Dong Jae Kim , Tse-Hsun , Chen