English
Related papers

Related papers: System Log Parsing: A Survey

200 papers

System logs are a valuable source of information for the analysis and understanding of systems behavior for the purpose of improving their performance. Such logs contain various types of information, including sensitive information.…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-23 Siavash Ghiasvand , Florina M. Ciorba

Logs are extensively used during the development and maintenance of software systems. They collect runtime events and allow tracking of code execution, which enables a variety of critical tasks such as troubleshooting and fault detection.…

Machine Learning · Computer Science 2020-03-20 Sasho Nedelkoski , Jasmin Bogatinovski , Alexander Acker , Jorge Cardoso , Odej Kao

Background: Log messages provide valuable information about the status of software systems. This information is provided in an unstructured fashion and automated approaches are applied to extract relevant parameters. To ease this process,…

Software Engineering · Computer Science 2024-09-05 Merve Astekin , Max Hort , Leon Moonen

Software logs play an essential role in ensuring the reliability and maintainability of large-scale software systems, as they are often the sole source of runtime information. Log parsing, which converts raw log messages into structured…

Software Engineering · Computer Science 2023-08-22 Van-Hoang Le , Hongyu Zhang

Modern systems produce a large volume of logs to record run-time status and events. System operators use these raw logs to track a system in order to obtain some useful information to diagnose system anomalies. One of the most important…

Networking and Internet Architecture · Computer Science 2023-03-22 Shaohan Huang , Yi Liu , Carol Fung , Jiaxing Qi , Hailong Yang , Zhongzhi Luan

Logs are a fundamental component of modern computer systems. They enable the analysis and monitoring teams to understand any abnormal or malicious behavior that may have occurred. The continuous increase in the volume of logs generated by…

Information Retrieval · Computer Science 2023-04-25 Arthur Vervaet , Raja Chiky , Mar Callau-Zori

Software and System logs record runtime information about processes executing within a system. These logs have become the most critical and ubiquitous forms of observability data that help developers understand system behavior, monitor…

Artificial Intelligence · Computer Science 2023-02-01 Qian Cheng , Amrita Saha , Wenzhuo Yang , Chenghao Liu , Doyen Sahoo , Steven Hoi

Developers write logging statements to generate logs that provide run-time information for various tasks. The readability of log messages in the logging statements (i.e., the descriptive text) is rather crucial to the value of the generated…

Software Engineering · Computer Science 2023-08-21 Zhenhao Li , An Ran Chen , Xing Hu , Xin Xia , Tse-Hsun Chen , Weiyi Shang

Logs produced by extensive software systems are integral to monitoring system behaviors. Advanced log analysis facilitates the detection, alerting, and diagnosis of system faults. Log parsing, which entails transforming raw log messages…

Software Engineering · Computer Science 2025-03-27 Wei Zhang , Xiangyuan Guan , Lu Yunhong , Jie Zhang , Shuangyong Song , Xianfu Cheng , Zhenhe Wu , Zhoujun Li

Software systems generate massive, evolving, semi-structured logs that are central to reliability engineering and AIOps, yet difficult to analyze at scale under drift and limited labels. Recent advances in pretrained Transformer models and…

Software Engineering · Computer Science 2026-05-21 Zeyang Ma , Jinqiu Yang , Tse-Hsun Chen

Due to the sheer size of software logs, developers rely on automated log analysis. Log parsing, which parses semi-structured logs into a structured format, is a prerequisite of automated log analysis. However, existing log parsers are…

Software Engineering · Computer Science 2026-03-16 Yifan Wu , Bingxu Chai , Siyu Yu , Ying Li , Pinjia He , Wei Jiang , Jianguo Li

Today's high-performance computing (HPC) systems are heavily instrumented, generating logs containing information about abnormal events, such as critical conditions, faults, errors and failures, system resource utilization, and about the…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-24 Byung H. Park , Saurabh Hukerikar , Ryan Adamson , Christian Engelmann

Any modern system writes events into files, called log files. Those contain crucial information which are subject to various analyses. Examples range from cybersecurity, intrusion detection over usage analyses to trouble shooting. Before…

Machine Learning · Computer Science 2022-02-02 Nadine Ruecker , Andreas Maier

Logs provide users with useful insights to help with a variety of development and operations tasks. The problem is that logs are often unstructured, making their analysis a complex task. This is mainly due to the lack of guidelines and best…

Software Engineering · Computer Science 2021-11-01 Issam Sedki , Abdelwahab Hamou-Lhadj , Otmane Ait-Mohamed

Log parsing, which involves log template extraction from semi-structured logs to produce structured logs, is the first and the most critical step in automated log analysis. However, current log parsers suffer from limited effectiveness for…

Software Engineering · Computer Science 2024-03-01 Junjielong Xu , Ruichun Yang , Yintong Huo , Chengyu Zhang , Pinjia He

Analyzing database access logs is a key part of performance tuning, intrusion detection, benchmark development, and many other database administration tasks. Unfortunately, it is common for production databases to deal with millions or even…

Databases · Computer Science 2018-10-02 Ting Xie , Oliver Kennedy , Varun Chandola

Logs are one of the most valuable data sources for managing large-scale online services. After a failure is detected/diagnosed/predicted, operators still have to inspect the raw logs to gain a summarized view before take actions. However,…

Nowadays, most systems and applications produce log records that are useful for security and monitoring purposes such as debugging programming errors, checking system status, and detecting configuration problems or even attacks. To this…

Databases · Computer Science 2017-03-09 Carlos Vega , Paula Roquero , Rafael Leira , Ivan Gonzalez , Javier Aracil

Log parsing transforms log messages into structured formats, serving as a crucial step for log analysis. Despite a variety of log parsers that have been proposed, their performance on evolving log data remains unsatisfactory due to reliance…

Software Engineering · Computer Science 2025-02-04 Yifan Wu , Siyu Yu , Ying Li

Logs play a critical role in providing essential information for system monitoring and troubleshooting. Recently, with the success of pre-trained language models (PLMs) and large language models (LLMs) in natural language processing (NLP),…

Software Engineering · Computer Science 2025-02-03 Lipeng Ma , Weidong Yang , Sihang Jiang , Ben Fei , Mingjie Zhou , Shuhao Li , Mingyu Zhao , Bo Xu , Yanghua Xiao