English
Related papers

Related papers: Monitoring Machine Learning Systems: A Multivocal …

200 papers

Modern Code Review (MCR) is a standard practice in software engineering, yet it demands substantial time and resource investments. Recent research has increasingly explored automating core review tasks using machine learning (ML) and deep…

Software Engineering · Computer Science 2025-08-26 Robert Heumüller , Frank Ortmeier

The development and deployment of machine learning (ML) systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end. The lack of diligence can lead to technical debt, scope creep and misaligned…

Machine learning models are widely recognized for their strong performance in forecasting. To keep that performance in streaming data settings, they have to be monitored and frequently re-trained. This can be done with machine learning…

Econometrics · Economics 2025-04-24 Yu Jeffrey Hu , Jeroen Rombouts , Ines Wilms

In the Machine Learning (ML) model development lifecycle, training candidate models using an offline holdout dataset and identifying the best model for the given task is only the first step. After the deployment of the selected model,…

Machine Learning · Computer Science 2023-11-20 Jaykumar Kasundra , Claudia Schulz , Melicaalsadat Mirsafian , Stavroula Skylaki

Machine learning can provide deep insights into data, allowing machines to make high-quality predictions and having been widely used in real-world applications, such as text mining, visual classification, and recommender systems. However,…

Machine Learning · Computer Science 2020-08-11 Meng Wang , Weijie Fu , Xiangnan He , Shijie Hao , Xindong Wu

[Background] Systematic literature reviews (SLRs) are essential for synthesizing evidence in Software Engineering (SE), but keeping them up-to-date requires substantial effort. Study selection, one of the most labor-intensive steps,…

Research is facing a reproducibility crisis, in which the results and findings of many studies are difficult or even impossible to reproduce. This is also the case in machine learning (ML) and artificial intelligence (AI) research. Often,…

Machine Learning · Computer Science 2023-07-21 Harald Semmelrock , Simone Kopeinik , Dieter Theiler , Tony Ross-Hellauer , Dominik Kowald

Context: Maturity of practices and infrastructure in healthcare domain directly impacts the quality and efficiency of healthcare services. Therefore, various healthcare administrations (e.g., hospital management to nation-wide health…

Computers and Society · Computer Science 2019-10-15 Ayça Kolukısa Tarhan , Vahid Garousi , Oktay Turetken , Mehmet Söylemez , Sonia Garossi

Context: Machine Learning (ML) has become widely adopted as a component in many modern software applications. Due to the large volumes of data available, organizations want to increasingly leverage their data to extract meaningful insights…

Software Engineering · Computer Science 2023-11-02 Hira Naveed , Chetan Arora , Hourieh Khalajzadeh , John Grundy , Omar Haggag

Context: Over the last years, Grey Literature (GL) is gaining increasing attention in Secondary Studies in Software Engineering (SE). Notably, Multivocal Literature Review (MLR) studies, that search for evidence in both Traditional…

Software Engineering · Computer Science 2021-08-19 Fernando Kamei , Gustavo Pinto , Igor Wiese , Márcio Ribeiro , Sérgio Soares

Machine learning (ML) is an increasingly important scientific tool supporting decision making and knowledge generation in numerous fields. With this, it also becomes more and more important that the results of ML experiments are…

Machine Learning · Computer Science 2020-06-23 Sheeba Samuel , Frank Löffler , Birgitta König-Ries

Predictive models are increasingly used to make various consequential decisions in high-stakes domains such as healthcare, finance, and policy. It becomes critical to ensure that these models make accurate predictions, are robust to shifts…

Machine Learning · Computer Science 2022-09-22 Murtuza N Shergadwala , Himabindu Lakkaraju , Krishnaram Kenthapadi

Machine Learning (ML) models are widely used across various domains, including medical diagnostics and autonomous driving. To support this growth, cloud providers offer ML services to ease the integration of ML components in software…

Software Engineering · Computer Science 2025-10-22 Hadil Ben Amor , Manel Abdellatif , Taher Ghaleb

In this survey, we discuss the challenges of executing scientific workflows as well as existing Machine Learning (ML) techniques to alleviate those challenges. We provide the context and motivation for applying ML to each step of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-28 Azita Nouri , Philip E. Davis , Pradeep Subedi , Manish Parashar

The rapid development of Machine Learning (ML) has demonstrated superior performance in many areas, such as computer vision, video and speech recognition. It has now been increasingly leveraged in software systems to automate the core…

Cryptography and Security · Computer Science 2023-12-19 Huaming Chen , M. Ali Babar

Logging plays a central role in ensuring reproducibility, observability, and reliability in machine learning (ML) systems. While logging is generally considered a good engineering practice, poorly designed logging can negatively affect…

Software Engineering · Computer Science 2026-03-26 Patrick Loic Foalem , Leuson Da Silva , Foutse Khomh , Heng Li , Ettore Merlo

Systematic Literature Reviews (SLRs) are a widely employed research method in software engineering. However, there are several problems with SLRs, including the enormous time and effort to conduct them and the lack of obvious impacts of SLR…

Software Engineering · Computer Science 2025-01-06 Vinicius dos Santos , Rick Kazman , Elisa Yumi Nakagawa

For machine learning components used as part of autonomous systems (AS) in carrying out critical tasks it is crucial that assurance of the models can be maintained in the face of post-deployment changes (such as changes in the operating…

Machine Learning · Computer Science 2024-06-25 Ozan Vardal , Richard Hawkins , Colin Paterson , Chiara Picardi , Daniel Omeiza , Lars Kunze , Ibrahim Habli

Errors or failures in a high-volume manufacturing environment can have significant impact that can result in both the loss of time and money. Identifying such failures early has been a top priority for manufacturing industries and various…

Machine Learning · Computer Science 2024-07-15 Siddarth Reddy Karuka , Abhinav Sunderrajan , Zheng Zheng , Yong Woon Tiean , Ganesh Nagappan , Allan Luk

Software organizations are increasingly incorporating machine learning (ML) into their product offerings, driving a need for new data management tools. Many of these tools facilitate the initial development of ML applications, but…

Software Engineering · Computer Science 2022-07-19 Shreya Shankar , Aditya Parameswaran