English
Related papers

Related papers: Software Logging for Machine Learning

200 papers

Most enterprise applications use logging as a mechanism to diagnose anomalies, which could help with reducing system downtime. Anomaly detection using software execution logs has been explored in several prior studies, using both classical…

Machine Learning · Computer Science 2023-11-01 Nadun Wijesinghe , Hadi Hemmati

Log parsing, the process of converting raw log messages into structured formats, is an important initial step for automated analysis of logs of large-scale software systems. Traditional log parsers often rely on heuristics or handcrafted…

Software Engineering · Computer Science 2024-06-13 Yi Xiao , Van-Hoang Le , Hongyu Zhang

Log data have facilitated various tasks of software development and maintenance, such as testing, debugging and diagnosing. Due to the unstructured nature of logs, log parsing is typically required to transform log messages into structured…

Software Engineering · Computer Science 2024-03-26 Zhihan Jiang , Jinyang Liu , Junjie Huang , Yichen Li , Yintong Huo , Jiazhen Gu , Zhuangbin Chen , Jieming Zhu , Michael R. Lyu

Software systems generate massive, evolving, semi-structured logs that are central to reliability engineering and AIOps, yet difficult to analyze at scale under drift and limited labels. Recent advances in pretrained Transformer models and…

Software Engineering · Computer Science 2026-05-21 Zeyang Ma , Jinqiu Yang , Tse-Hsun Chen

Context: Advancements in machine learning (ML) lead to a shift from the traditional view of software development, where algorithms are hard-coded by humans, to ML systems materialized through learning from data. Therefore, we need to…

Software Engineering · Computer Science 2021-06-16 Görkem Giray

Logs are extensively used during the development and maintenance of software systems. They collect runtime events and allow tracking of code execution, which enables a variety of critical tasks such as troubleshooting and fault detection.…

Machine Learning · Computer Science 2020-03-20 Sasho Nedelkoski , Jasmin Bogatinovski , Alexander Acker , Jorge Cardoso , Odej Kao

Machine learning (ML) is increasingly applied across industries to automate decision-making, but concerns about ethical and legal compliance remain due to limited transparency, fairness, and accountability. Monitoring through logging a…

Software Engineering · Computer Science 2025-08-26 Patrick Loic Foalem , Leuson Da Silva , Foutse Khomh , Heng Li , Ettore Merlo

With the advent of modern embedded systems, logging as a process is becoming more and more prevalent for diagnostic and analytic services. Traditionally, storage and managing of the logged data are generally kept as a part of one entity…

Cryptography and Security · Computer Science 2023-11-10 Fikret Basic , Christian Steger , Robert Kofler

The rapid progress of modern computing systems has led to a growing interest in informative run-time logs. Various log-based anomaly detection techniques have been proposed to ensure software reliability. However, their implementation in…

Software Engineering · Computer Science 2023-08-21 Yintong Huo , Yichen Li , Yuxin Su , Pinjia He , Zifan Xie , Michael R. Lyu

Bug reports are common artefacts in software development. They serve as the main channel for users to communicate to developers information about the issues that they encounter when using released versions of software programs. In the…

Software Engineering · Computer Science 2021-12-21 Arthur D. Sawadogo , Quentin Guimard , Tegawendé F. Bissyandé , Abdoul Kader Kaboré , Jacques Klein , Naouel Moha

Software systems log massive amounts of data, recording important runtime information. Such logs are used, for example, for log-based anomaly detection, which aims to automatically detect abnormal behaviors of the system under analysis by…

Software Engineering · Computer Science 2024-08-20 Zanis Ali Khan , Donghwan Shin , Domenico Bianculli , Lionel Briand

Developers write logging statements to generate logs that provide run-time information for various tasks. The readability of log messages in the logging statements (i.e., the descriptive text) is rather crucial to the value of the generated…

Software Engineering · Computer Science 2023-08-21 Zhenhao Li , An Ran Chen , Xing Hu , Xin Xia , Tse-Hsun Chen , Weiyi Shang

This paper deals with the problem of analyzing application event logs in relevance to dependability evaluation. We present the significance of application logs as a valuable source of information on operational profiles, anomalies and…

Other Computer Science · Computer Science 2012-04-06 Janusz Sosnowski

Log statements capture critical information for software maintenance activities such as testing, debugging, and failure analysis. Because of this importance, developers must carefully design log statements, which requires significant…

Software Engineering · Computer Science 2026-05-26 Kazuki Kusama , Honglin Shu , Masanari Kondo , Yasutaka Kamei

Large-scale software systems generate vast volumes of system logs that are essential for monitoring, diagnosing, and performance optimization. However, the unstructured nature and ever-growing scale of these logs present significant…

Software Engineering · Computer Science 2025-04-04 Shu-Wei Huang , Xingfang Wu , Heng Li

Logging is indispensable for maintaining the reliability and diagnosability of modern software, yet developers still struggle to decide where and how to log effectively. Existing automated logging techniques focus on isolated sub-tasks -…

Software Engineering · Computer Science 2025-07-29 Shengcheng Duan , Yihua Xu , Sheng Zhang , Shen Wang , Yue Duan

The analysis techniques of system log messages (syslog messages) have a long history from when the syslog mechanism was invented. Typically, the analysis consists of two parts, one is a message template generation, and the other is finding…

Other Computer Science · Computer Science 2016-11-11 Keiichi Shima

The log-based analysis and trouble-shooting has remained prevalent and commonly used approach for centralized and time-haring systems. However, for parallel and distributed systems where happen-before relations are not directly available…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-09 K. R. Chowdhary , Rajendra Purohit

Log analysis is one of the main techniques engineers use to troubleshoot faults of large-scale software systems. During the past decades, many log analysis approaches have been proposed to detect system anomalies reflected by logs. They…

Software Engineering · Computer Science 2022-09-19 Yongzheng Xie , Hongyu Zhang , Muhammad Ali Babar

Producing accurate software models is crucial in model-driven software engineering (MDE). However, modeling complex systems is an error-prone task that requires deep application domain knowledge. In the past decade, several automated…

Software Engineering · Computer Science 2024-08-27 Vittoriano Muttillo , Claudio Di Sipio , Riccardo Rubei , Luca Berardinelli , MohammadHadi Dehghani