English
Related papers

Related papers: Linnaeus: A highly reusable and adaptable ML based…

200 papers

Due to the complexity and size of modern software systems, the amount of logs generated is tremendous. Hence, it is infeasible to manually investigate these data in a reasonable time, thereby requiring automating log analysis to derive…

Software Engineering · Computer Science 2024-02-09 Stefan Petrescu , Floris den Hengst , Alexandru Uta , Jan S. Rellermeyer

Even though machine learning (ML) pipelines affect an increasing array of stakeholders, there is little work on how input from stakeholders is recorded and incorporated. We propose FeedbackLogs, addenda to existing documentation of ML…

Human-Computer Interaction · Computer Science 2023-07-31 Matthew Barker , Emma Kallina , Dhananjay Ashok , Katherine M. Collins , Ashley Casovan , Adrian Weller , Ameet Talwalkar , Valerie Chen , Umang Bhatt

Log data have facilitated various tasks of software development and maintenance, such as testing, debugging and diagnosing. Due to the unstructured nature of logs, log parsing is typically required to transform log messages into structured…

Software Engineering · Computer Science 2024-03-26 Zhihan Jiang , Jinyang Liu , Junjie Huang , Yichen Li , Yintong Huo , Jiazhen Gu , Zhuangbin Chen , Jieming Zhu , Michael R. Lyu

Logs are crucial for analyzing large-scale software systems, offering insights into system health, performance, security threats, potential bugs, etc. However, their chaotic nature$\unicode{x2013}$characterized by sheer volume, lack of…

Software Engineering · Computer Science 2025-02-20 Dmytro Borysenkov , Adriano Vogel , Sören Henning , Esteban Perez-Wohlfeil

Logs have been widely adopted in software system development and maintenance because of the rich runtime information they record. In recent years, the increase of software size and complexity leads to the rapid growth of the volume of logs.…

Software Engineering · Computer Science 2023-09-14 Jieming Zhu , Shilin He , Pinjia He , Jinyang Liu , Michael R. Lyu

The rapid advancement of software development practices has introduced challenges in ensuring quality and efficiency across the software engineering (SE) lifecycle. As SE systems grow in complexity, traditional approaches often fail to…

Software Engineering · Computer Science 2025-08-04 Samah Kansab

Log data provides crucial insights for tasks like monitoring, root cause analysis, and anomaly detection. Due to the vast volume of logs, automated log parsing is essential to transform semi-structured log messages into structured…

Machine Learning · Computer Science 2025-05-16 Viktor Beck , Max Landauer , Markus Wurzenberger , Florian Skopik , Andreas Rauber

AI systems produce large volumes of logs as they interact with tools and users. Analysing these logs can help understand model capabilities, propensities, and behaviours, or assess whether an evaluation worked as intended. Researchers have…

Runtime monitors that are specified in a stream-based monitoring language tend to be easier to understand, maintain, and reuse than those written in a standard programming language. Because of their formal semantics, such specification…

Formal Languages and Automata Theory · Computer Science 2020-11-30 Jan Baumeister , Bernd Finkbeiner , Matthis Kruse , Maximilian Schwenger

Deploying a Machine Learning (ML) training pipeline into production requires good software engineering practices. Unfortunately, the typical data science workflow often leads to code that lacks critical software quality attributes. This…

Log parsing serves as an essential prerequisite for various log analysis tasks. Recent advancements in this field have improved parsing accuracy by leveraging the semantics in logs through fine-tuning large language models (LLMs) or…

Software Engineering · Computer Science 2024-08-09 Junjie Huang , Zhihan Jiang , Zhuangbin Chen , Michael R. Lyu

Most enterprise applications use logging as a mechanism to diagnose anomalies, which could help with reducing system downtime. Anomaly detection using software execution logs has been explored in several prior studies, using both classical…

Machine Learning · Computer Science 2023-11-01 Nadun Wijesinghe , Hadi Hemmati

Machine learning (ML) applications become increasingly common in many domains. ML systems to execute these workloads include numerical computing frameworks and libraries, ML algorithm libraries, and specialized systems for deep neural…

Background: Machine Learning (ML) systems rely on data to make predictions, the systems have many added components compared to traditional software systems such as the data processing pipeline, serving pipeline, and model training. Existing…

Software Engineering · Computer Science 2022-09-22 Tuan Dung Lai , Anj Simmons , Scott Barnett , Jean-Guy Schneider , Rajesh Vasa

Logs produced by extensive software systems are integral to monitoring system behaviors. Advanced log analysis facilitates the detection, alerting, and diagnosis of system faults. Log parsing, which entails transforming raw log messages…

Software Engineering · Computer Science 2025-03-27 Wei Zhang , Xiangyuan Guan , Lu Yunhong , Jie Zhang , Shuangyong Song , Xianfu Cheng , Zhenhe Wu , Zhoujun Li

In the last decade, an impressive increase in software adaptions has led to a surge in log data production, making manual log analysis impractical and establishing the necessity for automated methods. Conversely, most automated analysis…

Software Engineering · Computer Science 2025-11-19 Shayan Hashemi , Mika Mäntylä

Machine learning (ML) is now commonplace, powering data-driven applications in various organizations. Unlike the traditional perception of ML in research, ML production pipelines are complex, with many interlocking analytical components…

Databases · Computer Science 2021-03-31 Doris Xin , Hui Miao , Aditya Parameswaran , Neoklis Polyzotis

ML-based systems are software systems that incorporates machine learning components such as Deep Neural Networks (DNNs) or Large Language Models (LLMs). While such systems enable advanced features such as high performance computer vision,…

Software Engineering · Computer Science 2025-03-14 Shin Yoo , Robert Feldt , Somin Kim , Naryeong Kim

Nowadays, most systems and applications produce log records that are useful for security and monitoring purposes such as debugging programming errors, checking system status, and detecting configuration problems or even attacks. To this…

Databases · Computer Science 2017-03-09 Carlos Vega , Paula Roquero , Rafael Leira , Ivan Gonzalez , Javier Aracil

Nowadays, machine learning (ML) plays a vital role in many aspects of our daily life. In essence, building well-performing ML applications requires the provision of high-quality data throughout the entire life-cycle of such applications.…

Databases · Computer Science 2023-02-10 Mohamed Abdelaal , Christian Hammacher , Harald Schoening