English
Related papers

Related papers: System Log Parsing: A Survey

200 papers

Software logs record system activities, aiding maintainers in identifying the underlying causes for failures and enabling prompt mitigation actions. However, maintainers need to inspect a large volume of daily logs to identify the anomalous…

Software Engineering · Computer Science 2023-08-16 Yintong Huo , Cheryl Lee , Yuxin Su , Shiwen Shan , Jinyang Liu , Michael R. Lyu

Data lakes are becoming increasingly prevalent for big data management and data analytics. In contrast to traditional 'schema-on-write' approaches such as data warehouses, data lakes are repositories storing raw data in its original formats…

Databases · Computer Science 2023-10-24 Rihan Hai , Christos Koutras , Christoph Quix , Matthias Jarke

Logs record valuable system information at runtime. They are widely used by data-driven approaches for development and monitoring purposes. Parsing log messages to structure their format is a classic preliminary step for log-mining tasks.…

Computation and Language · Computer Science 2023-04-26 Arthur Vervaet , Raja Chiky , Mar Callau-Zori

Logging plays a crucial role in software engineering because it is key to perform various tasks including debugging, performance analysis, and detection of anomalies. Despite the importance of log data, the practice of logging still suffers…

Software Engineering · Computer Science 2022-08-16 Keyur Patel , Joao Faccin , Abdelwahab Hamou-Lhadj , Ingrid Nunes

Logs are a first-hand source of information for software maintenance and failure diagnosis. Log parsing, which converts semi-structured log messages into structured templates, is a prerequisite for automated log analysis tasks such as…

Software Engineering · Computer Science 2024-08-16 Andy Xu , Arno Gau

Logs are a common way to record detailed run-time information in software. As modern software systems evolve in scale and complexity, logs have become indispensable to understanding the internal states of the system. At the same time…

Machine Learning · Computer Science 2021-03-15 Armin Catovic , Carolyn Cartwright , Yasmin Tesfaldet Gebreyesus , Simone Ferlin

Integrating third-party software components is a common practice in modern software development, offering significant advantages in terms of efficiency and innovation. However, this practice is fraught with risks related to software…

Software Engineering · Computer Science 2025-07-11 Boyuan Li , Chengwei Liu , Lingling Fan , Sen Chen , Zhenlin Zhang , Zheli Liu

Audit trails are evidential indications of activities performers in any logs. Modern reactive systems such as transaction processing systems, management information systems, decision support systems and even executive management systems log…

Software Engineering · Computer Science 2023-08-02 Patrick Mukala

Event log analysis is an important task that security professionals undertake. Event logs record key information on activities that occur on computing devices, and due to the substantial number of events generated, they consume a large…

Artificial Intelligence · Computer Science 2025-02-04 Siraaj Akhtar , Saad Khan , Simon Parkinson

Recent development of large language models (LLMs), such as ChatGPT has been widely applied to a wide range of software engineering tasks. Many papers have reported their analysis on the potential advantages and limitations of ChatGPT for…

Software Engineering · Computer Science 2023-09-18 Priyanka Mudgal , Rita Wouhaybi

Source data for computer network security analysis takes different forms (alerts, incidents, logs) and each source may be voluminous. Due to the challenge this presents for data management, this has often lead to security stovepipe…

Cryptography and Security · Computer Science 2007-05-23 William Yurcik , Cristina Abad , Ragib Hasan , Moazzam Saleem , Shyama Sridharan

Logs are widely used in modern software system management because they are often the only data accessible that record system events at runtime. In recent years, because of the ever-increasing log size, data mining techniques are often…

Software Engineering · Computer Science 2018-06-13 Pinjia He , Jieming Zhu , Pengcheng Xu , Zibin Zheng , Michael R. Lyu

Background. Coping with the rapid growing complexity in contemporary software architecture, tracing has become an increasingly critical practice and been adopted widely by software engineers. By adopting tracing tools, practitioners are…

Software Engineering · Computer Science 2023-06-26 Andrea Janes , Xiaozhou Li , Valentina Lenarduzzi

Modern software systems are becoming increasingly complex and opaque. The integration of explanations within software has shown the potential to address this opacity and can make the system more understandable to end-users. As a result,…

Software Engineering · Computer Science 2024-04-26 Jakob Droste , Hannah Deters , Martin Obaidi , Kurt Schneider

Log parsing, which extracts log templates from semi-structured logs and produces structured logs, is the first and the most critical step in automated log analysis. While existing log parsers have achieved decent results, they suffer from…

Software Engineering · Computer Science 2023-08-15 Junjielong Xu , Qiuai Fu , Zhouruixing Zhu , Yutong Cheng , Zhijing Li , Yuchi Ma , Pinjia He

Automated log analysis is crucial in modern software-intensive systems for facilitating program comprehension throughout software maintenance and engineering life cycles. Existing methods perform tasks such as log parsing and log anomaly…

Software Engineering · Computer Science 2024-01-29 Yilun Liu , Shimin Tao , Weibin Meng , Jingyu Wang , Wenbing Ma , Yanqing Zhao , Yuhang Chen , Hao Yang , Yanfei Jiang , Xun Chen

Document parsing (DP) transforms unstructured or semi-structured documents into structured, machine-readable representations, enabling downstream applications such as knowledge base construction and retrieval-augmented generation (RAG).…

With the recent advances of deep learning techniques, there are rapidly growing interests in applying machine learning to log data. As a fundamental part of log analytics, accurate log parsing that transforms raw logs to structured events…

Software Engineering · Computer Science 2022-02-16 Lei Yu , Tian Wu , Jiaqi Li , Patrick Chan , Hong Min , Fanjing Meng

Logs serve as a primary source of information for engineers to diagnose failures in large-scale online service systems. Log parsing, which extracts structured events from massive unstructured log data, is a critical first step for…

Software Engineering · Computer Science 2026-03-13 Jinrui Sun , Tong Jia , Minghua He , Ying Li

Logs play a crucial role in modern software systems, serving as a means for developers to record essential information for future software maintenance. As the performance of these log-based maintenance tasks heavily relies on the quality of…

Software Engineering · Computer Science 2024-04-01 Xiaoyuan Xie , Zhipeng Cai , Songqiang Chen , Jifeng Xuan