English
Related papers

Related papers: Software Logging for Machine Learning

200 papers

Event logs are invaluable for conducting process mining projects, offering insights into process improvement and data-driven decision-making. However, data quality issues affect the correctness and trustworthiness of these insights, making…

Databases · Computer Science 2023-10-09 Ying Liu , Vinicius Stein Dani , Iris Beerepoot , Xixi Lu

Effective issue resolution is crucial for maintaining software quality. Yet developers frequently encounter challenges such as low-quality issue reports, limited understanding of real-world workflows, and a lack of automated support. This…

Software Engineering · Computer Science 2025-12-12 Antu Saha

Context: Machine learning (ML)-enabled systems are being increasingly adopted by companies aiming to enhance their products and operational processes. Objective: This paper aims to deliver a comprehensive overview of the current status quo…

Context: An increasing demand is observed in various domains to employ Machine Learning (ML) for solving complex problems. ML models are implemented as software components and deployed in Machine Learning Software Systems (MLSSs). Problem:…

Software Engineering · Computer Science 2022-08-23 Pierre-Olivier Côté , Amin Nikanjam , Rached Bouchoucha , Foutse Khomh

This paper explores the essential areas of cybersecurity management for big data systems. Big data platform stems its complexity from being a collection of interrelated non-standardized systems that interact with each other to process large…

Cryptography and Security · Computer Science 2019-12-18 Shakir A. Almasaari

Logs serve as a primary source of information for engineers to diagnose failures in large-scale online service systems. Log parsing, which extracts structured events from massive unstructured log data, is a critical first step for…

Software Engineering · Computer Science 2026-03-13 Jinrui Sun , Tong Jia , Minghua He , Ying Li

Event logs are widely used for anomaly detection and prediction in complex systems. Existing log-based anomaly detection methods usually consist of four main steps: log collection, log parsing, feature extraction, and anomaly detection,…

Machine Learning · Computer Science 2022-12-20 Zhong Li , Matthijs van Leeuwen

Log data store event execution patterns that correspond to underlying workflows of systems or applications. While most logs are informative, log data also include artifacts that indicate failures or incidents. Accordingly, log data are…

Machine Learning · Computer Science 2024-09-06 Max Landauer , Florian Skopik , Markus Wurzenberger

Intrusion detection systems (IDS) monitor system logs and network traffic to recognize malicious activities in computer networks. Evaluating and comparing IDSs with respect to their detection accuracies is thereby essential for their…

Cryptography and Security · Computer Science 2023-05-16 Max Landauer , Florian Skopik , Maximilian Frank , Wolfgang Hotwagner , Markus Wurzenberger , Andreas Rauber

In the current IT world, developers write code while system operators run the code mostly as a black box. The connection between both worlds is typically established with log messages: the developer provides hints to the (unknown) operator,…

Software Engineering · Computer Science 2022-04-07 Jasmin Bogatinovski , Sasho Nedelkoski , Alexander Acker , Jorge Cardoso , Odej Kao

There is an increasing need for more automated system-log analysis tools for large scale online system in a timely manner. However, conventional way to monitor and classify the log output based on keyword list does not scale well for…

Software Engineering · Computer Science 2018-11-06 Guofu Li , Pengjia Zhu , Zhiyi Chen

In recent years, technology has advanced considerably with the introduction of many systems including advanced robotics, big data analytics, cloud computing, machine learning and many more. The opportunities to exploit the yet to come…

Cryptography and Security · Computer Science 2023-11-21 Sam Wen Ping , Jeffrey Cheok Jun Wah , Lee Wen Jie , Jeremy Bong Yong Han , Saira Muzafar

Logging is a practice widely adopted in several phases of the software lifecycle. For example, during software development log statements allow engineers to verify and debug the system by exposing fine-grained information of the running…

Software Engineering · Computer Science 2022-01-17 Antonio Mastropaolo , Luca Pascarella , Gabriele Bavota

The quality of the data in a dataset can have a substantial impact on the performance of a machine learning model that is trained and/or evaluated using the dataset. Effective dataset management, including tasks such as data cleanup,…

Databases · Computer Science 2023-03-16 Ze Mao , Yang Xu , Erick Suarez

Artificial Intelligence (AI) or Machine Learning (ML) systems have been widely adopted as value propositions by companies in all industries in order to create or extend the services and products they offer. However, developing AI/ML systems…

Software Engineering · Computer Science 2020-11-10 Elizamary Nascimento , Anh Nguyen-Duc , Ingrid Sundbø , Tayana Conte

Context: The software development industry is rapidly adopting machine learning for transitioning modern day software systems towards highly intelligent and self-learning systems. However, the full potential of machine learning for…

Software Engineering · Computer Science 2021-10-18 Saad Shafiq , Atif Mashkoor , Christoph Mayr-Dorn , Alexander Egyed

Logs are semi-structured text files that represent software's execution paths and states during its run-time. Therefore, detecting anomalies in software logs reflect anomalies in the software's execution path or state. So, it has become a…

Software Engineering · Computer Science 2024-08-06 Shayan Hashemi , Mika Mäntylä

Log parsing transforms log messages into structured formats, serving as a crucial step for log analysis. Despite a variety of log parsers that have been proposed, their performance on evolving log data remains unsatisfactory due to reliance…

Software Engineering · Computer Science 2025-02-04 Yifan Wu , Siyu Yu , Ying Li

Analyzing database access logs is a key part of performance tuning, intrusion detection, benchmark development, and many other database administration tasks. Unfortunately, it is common for production databases to deal with millions or even…

Databases · Computer Science 2018-10-02 Ting Xie , Oliver Kennedy , Varun Chandola

We present cyber-security problems of high importance. We show that in order to solve these cyber-security problems, one must cope with certain machine learning challenges. We provide novel data sets representing the problems in order to…

Machine Learning · Computer Science 2019-04-23 Idan Amit , John Matherly , William Hewlett , Zhi Xu , Yinnon Meshi , Yigal Weinberger