English
Related papers

Related papers: Software Logging for Machine Learning

200 papers

Software logs are messages recorded during the execution of a software system that provide crucial run-time information about events and activities. Although software logs have a critical role in software maintenance and operation tasks,…

Software Engineering · Computer Science 2025-05-22 Roozbeh Aghili , Xingfang Wu , Foutse Khomh , Heng Li

AI systems produce large volumes of logs as they interact with tools and users. Analysing these logs can help understand model capabilities, propensities, and behaviours, or assess whether an evaluation worked as intended. Researchers have…

Execution logs are a crucial medium as they record runtime information of software systems. Although extensive logs are helpful to provide valuable details to identify the root cause in postmortem analysis in case of a failure, this may…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-20 Sina Gholamian , Paul A. S. Ward

Log data provides crucial insights for tasks like monitoring, root cause analysis, and anomaly detection. Due to the vast volume of logs, automated log parsing is essential to transform semi-structured log messages into structured…

Machine Learning · Computer Science 2025-05-16 Viktor Beck , Max Landauer , Markus Wurzenberger , Florian Skopik , Andreas Rauber

System logs constitute valuable information for analysis and diagnosis of system behavior. The size of parallel computing systems and the number of their components steadily increase. The volume of generated logs by the system is in…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-23 Siavash Ghiasvand , Florina M. Ciorba

Software and System logs record runtime information about processes executing within a system. These logs have become the most critical and ubiquitous forms of observability data that help developers understand system behavior, monitor…

Artificial Intelligence · Computer Science 2023-02-01 Qian Cheng , Amrita Saha , Wenzhuo Yang , Chenghao Liu , Doyen Sahoo , Steven Hoi

Software logs play an essential role in ensuring the reliability and maintainability of large-scale software systems, as they are often the sole source of runtime information. Log parsing, which converts raw log messages into structured…

Software Engineering · Computer Science 2023-08-22 Van-Hoang Le , Hongyu Zhang

In the last couple of years we have witnessed an enormous increase of machine learning (ML) applications. More and more program functions are no longer written in code, but learnt from a huge amount of data samples using an ML algorithm.…

Software Engineering · Computer Science 2022-09-07 Peter Kriens , Tim Verbelen

Software logs record system activities, aiding maintainers in identifying the underlying causes for failures and enabling prompt mitigation actions. However, maintainers need to inspect a large volume of daily logs to identify the anomalous…

Software Engineering · Computer Science 2023-08-16 Yintong Huo , Cheryl Lee , Yuxin Su , Shiwen Shan , Jinyang Liu , Michael R. Lyu

Nowadays, most systems and applications produce log records that are useful for security and monitoring purposes such as debugging programming errors, checking system status, and detecting configuration problems or even attacks. To this…

Databases · Computer Science 2017-03-09 Carlos Vega , Paula Roquero , Rafael Leira , Ivan Gonzalez , Javier Aracil

Anomalies or failures in large computer systems, such as the cloud, have an impact on a large number of users that communicate, compute, and store information. Therefore, timely and accurate anomaly detection is necessary for reliability,…

Artificial Intelligence · Computer Science 2021-02-24 Harold Ott , Jasmin Bogatinovski , Alexander Acker , Sasho Nedelkoski , Odej Kao

System logs record detailed runtime information of software systems and are used as the main data source for many tasks around software engineering. As modern software systems are evolving into large scale and complex structures, logs have…

Databases · Computer Science 2019-10-02 Jinyang Liu , Jieming Zhu , Shilin He , Pinjia He , Zibin Zheng , Michael R. Lyu

Logs are ubiquitous digital footprints, playing an indispensable role in system diagnostics, security analysis, and performance optimization. The extraction of actionable insights from logs is critically dependent on the log parsing…

Software Engineering · Computer Science 2024-08-27 Aoxiao Zhong , Dengyao Mo , Guiyang Liu , Jinbu Liu , Qingda Lu , Qi Zhou , Jiesheng Wu , Quanzheng Li , Qingsong Wen

The number of machine learning, artificial intelligence or data science related software engineering projects using Agile methodology is increasing. However, there are very few studies on how such projects work in practice. In this paper,…

Software Engineering · Computer Science 2019-12-17 Kushal Singla , Joy Bose , Chetan Naik

The real-world use cases of Machine Learning (ML) have exploded over the past few years. However, the current computing infrastructure is insufficient to support all real-world applications and scenarios. Apart from high efficiency…

Logs are a common way to record detailed run-time information in software. As modern software systems evolve in scale and complexity, logs have become indispensable to understanding the internal states of the system. At the same time…

Machine Learning · Computer Science 2021-03-15 Armin Catovic , Carolyn Cartwright , Yasmin Tesfaldet Gebreyesus , Simone Ferlin

Automatic log file analysis enables early detection of relevant incidents such as system failures. In particular, self-learning anomaly detection techniques capture patterns in log data and subsequently report unexpected log event…

Machine Learning · Computer Science 2023-05-16 Max Landauer , Sebastian Onder , Florian Skopik , Markus Wurzenberger

Machine learning techniques are finding many applications in computer systems, including many tasks that require decision making: network optimization, quality of service assurance, and security. We believe machine learning systems are here…

Computers and Society · Computer Science 2019-12-02 David Mohaisen , Songqing Chen

This paper presents the results of an industry expert survey about event log generation in process mining. It takes academic assumptions as a starting point and elicits practitioner's assessments of statements about process execution,…

Software Engineering · Computer Science 2022-04-15 Timotheus Kampik , Mathias Weske

Automated logging statement generation supports developers in documenting critical software runtime behavior. Given the great success in natural language generation and programming language comprehension, large language models (LLMs) might…

Software Engineering · Computer Science 2024-04-02 Yichen Li , Yintong Huo , Zhihan Jiang , Renyi Zhong , Pinjia He , Yuxin Su , Lionel Briand , Michael R. Lyu