English
Related papers

Related papers: Optimized Log Parsing with Syntactic Modifications

200 papers

Log parsing is a fundamental step in log analysis, partitioning raw logs into constant templates and dynamic variables. While recent semantic-based parsers leveraging Large Language Models (LLMs) exhibit superior generalizability over…

Software Engineering · Computer Science 2026-03-31 Minxing Wang , Yintong Huo

Log parsing transforms log messages into structured formats, serving as the prerequisite step for various log analysis tasks. Although a variety of log parsing approaches have been proposed, their performance on complicated log data remains…

Software Engineering · Computer Science 2024-03-25 Zhihan Jiang , Jinyang Liu , Zhuangbin Chen , Yichen Li , Junjie Huang , Yintong Huo , Pinjia He , Jiazhen Gu , Michael R. Lyu

Log parsing transforms raw logs into structured templates containing constants and variables. It underpins anomaly detection, failure diagnosis, and other AIOps tasks. Current parsers are mostly reactive and log-centric. They only infer…

Software Engineering · Computer Science 2025-12-05 Jiaqi Sun , Wei Li , Heng Zhang , Chutong Ding , Shiyou Qian , Jian Cao , Guangtao Xue

Logs provide first-hand information for engineers to diagnose failures in large-scale online service systems. Log parsing, which transforms semi-structured raw log messages into structured data, is a prerequisite of automated log analysis…

Software Engineering · Computer Science 2022-02-15 Yudong Liu , Xu Zhang , Shilin He , Hongyu Zhang , Liqun Li , Yu Kang , Yong Xu , Minghua Ma , Qingwei Lin , Yingnong Dang , Saravan Rajmohan , Dongmei Zhang

Code analysis is fundamental in Software Engineering, supporting debugging, optimization, and security assessment. Human developers approach it through syntax parsing, static semantics inference, and dynamic reasoning. Traditional tools are…

Software Engineering · Computer Science 2026-05-22 Wei Ma , Zhihao Lin , Shangqing Liu , Qiang Hu , Ye Liu , Wenhan Wang , Cen Zhang , Liming Nie , Li Li , Yang Liu , Lingxiao Jiang

Log parsing is a critical step that transforms unstructured log data into structured formats, facilitating subsequent log-based analysis. Traditional syntax-based log parsers are efficient and effective, but they often experience decreased…

Software Engineering · Computer Science 2024-11-19 Zeyang Ma , Dong Jae Kim , Tse-Hsun Chen

Logging is indispensable for maintaining the reliability and diagnosability of modern software, yet developers still struggle to decide where and how to log effectively. Existing automated logging techniques focus on isolated sub-tasks -…

Software Engineering · Computer Science 2025-07-29 Shengcheng Duan , Yihua Xu , Sheng Zhang , Shen Wang , Yue Duan

Log data provides crucial insights for tasks like monitoring, root cause analysis, and anomaly detection. Due to the vast volume of logs, automated log parsing is essential to transform semi-structured log messages into structured…

Machine Learning · Computer Science 2025-05-16 Viktor Beck , Max Landauer , Markus Wurzenberger , Florian Skopik , Andreas Rauber

Semantic role labeling (SRL), also known as shallow semantic parsing, is an important yet challenging task in NLP. Motivated by the close correlation between syntactic and semantic structures, traditional discrete-feature-based SRL…

Computation and Language · Computer Science 2019-07-23 Qingrong Xia , Zhenghua Li , Min Zhang , Meishan Zhang , Guohong Fu , Rui Wang , Luo Si

In the last decade, an impressive increase in software adaptions has led to a surge in log data production, making manual log analysis impractical and establishing the necessity for automated methods. Conversely, most automated analysis…

Software Engineering · Computer Science 2025-11-19 Shayan Hashemi , Mika Mäntylä

Modern computing systems, such as HDFS and Spark, produce vast quantities of logs that developers use for tasks like anomaly detection and error analysis. To simplify log analysis, template generation methods have been proposed to…

Databases · Computer Science 2025-08-14 Fei Teng , Haoyang Li , Lei Chen

Log parsing, a vital task for interpreting the vast and complex data produced within software architectures faces significant challenges in the transition from academic benchmarks to the industrial domain. Existing log parsers, while highly…

Software Engineering · Computer Science 2024-05-27 Wei Zhang , Xianfu Cheng , Yi Zhang , Jian Yang , Hongcheng Guo , Zhoujun Li , Xiaolin Yin , Xiangyuan Guan , Xu Shi , Liangfan Zheng , Bo Zhang

Log statements capture critical information for software maintenance activities such as testing, debugging, and failure analysis. Because of this importance, developers must carefully design log statements, which requires significant…

Software Engineering · Computer Science 2026-05-26 Kazuki Kusama , Honglin Shu , Masanari Kondo , Yasutaka Kamei

Log parsing transforms log messages into structured formats, serving as a crucial step for log analysis. Despite a variety of log parsers that have been proposed, their performance on evolving log data remains unsatisfactory due to reliance…

Software Engineering · Computer Science 2025-02-04 Yifan Wu , Siyu Yu , Ying Li

With the recent advances of deep learning techniques, there are rapidly growing interests in applying machine learning to log data. As a fundamental part of log analytics, accurate log parsing that transforms raw logs to structured events…

Software Engineering · Computer Science 2022-02-16 Lei Yu , Tian Wu , Jiaqi Li , Patrick Chan , Hong Min , Fanjing Meng

The analysis techniques of system log messages (syslog messages) have a long history from when the syslog mechanism was invented. Typically, the analysis consists of two parts, one is a message template generation, and the other is finding…

Other Computer Science · Computer Science 2016-11-11 Keiichi Shima

Parser-based log compression, which separates static templates from dynamic variables, is a promising approach to exploit the unique structure of log data. However, its performance on complex production logs is often unsatisfactory. This…

Software Engineering · Computer Science 2026-01-23 Siyu Yu , Yifan Wu , Junjielong Xu , Ying Fu , Ning Wang , Maoyin Liu , Pancheng Jiang , Xiang Zhang , Tong Jia , Pinjia He , Ying Li

Logs are a first-hand source of information for software maintenance and failure diagnosis. Log parsing, which converts semi-structured log messages into structured templates, is a prerequisite for automated log analysis tasks such as…

Software Engineering · Computer Science 2024-08-16 Andy Xu , Arno Gau

Security logs are foundational to threat detection and post-incident investigation, yet analysts often struggle to fully leverage them due to their heterogeneity and unstructured nature. The standard practice of manually writing parsers to…

Cryptography and Security · Computer Science 2025-11-18 Julien Piet , Vivian Fang , Rishi Khare , Scott Coull , Vern Paxson , Raluca Ada Popa , David Wagner

Automated log analysis is crucial to ensure high availability and reliability of complex systems. The advent of LLMs in NLP has ushered in a new era of language model-driven automated log analysis, garnering significant interest. Within…

Software Engineering · Computer Science 2025-01-22 Lipeng Ma , Weidong Yang , Yixuan Li , Ben Fei , Mingjie Zhou , Shuhao Li , Sihang Jiang , Bo Xu , Yanghua Xiao