English
Related papers

Related papers: Data Quality Aware Approaches for Addressing Model…

200 papers

A trained ML model is deployed on another `test' dataset where target feature values (labels) are unknown. Drift is distribution change between the training and deployment data, which is concerning if model performance changes. For a…

Applications · Statistics 2022-09-07 Samuel Ackerman , Eitan Farchi , Orna Raz , Marcel Zalmanovici , Parijat Dube

Many methods have been proposed to detect concept drift, i.e., the change in the distribution of streaming data, due to concept drift causes a decrease in the prediction accuracy of algorithms. However, the most of current detection methods…

Artificial Intelligence · Computer Science 2021-05-05 Hang Yu , Tianyu Liu , Jie Lu , Guangquan Zhang

Concept drift detection is crucial for many AI systems to ensure the system's reliability. These systems often have to deal with large amounts of data or react in real-time. Thus, drift detectors must meet computational requirements or…

Machine Learning · Computer Science 2024-06-11 Elias Werner , Nishant Kumar , Matthias Lieber , Sunna Torge , Stefan Gumhold , Wolfgang E. Nagel

As machine learning models increasingly replace traditional business logic in the production system, their lifecycle management is becoming a significant concern. Once deployed into production, the machine learning models are constantly…

Machine Learning · Computer Science 2022-11-24 Lorena Poenaru-Olaru , Luis Cruz , Arie van Deursen , Jan S. Rellermeyer

Concept drift is a major issue that greatly affects the accuracy and reliability of many real-world applications of machine learning. We argue that to tackle concept drift it is important to develop the capacity to describe and analyze it.…

Machine Learning · Computer Science 2017-04-04 Geoffrey I. Webb , Loong Kuan Lee , François Petitjean , Bart Goethals

Predictive services nowadays play an important role across all business sectors. However, deployed machine learning models are challenged by changing data streams over time which is described as concept drift. Prediction quality of models…

Machine Learning · Computer Science 2020-12-09 Lucas Baier , Josua Reimold , Niklas Kühl

Deploying robust machine learning models has to account for concept drifts arising due to the dynamically changing and non-stationary nature of data. Addressing drifts is particularly imperative in the security domain due to the…

Cryptography and Security · Computer Science 2022-06-16 Aditya Kuppa , Nhien-An Le-Khac

Camera images are ubiquitous in machine learning research. They also play a central role in the delivery of important services spanning medicine and environmental surveying. However, the application of machine learning models in these…

Addressing sensor drift is essential in industrial measurement systems, where precise data output is necessary for maintaining accuracy and reliability in monitoring processes, as it progressively degrades the performance of machine…

Machine Learning · Computer Science 2025-02-27 Melanie Schaller , Mathis Kruse , Antonio Ortega , Marius Lindauer , Bodo Rosenhahn

Concept drift is the phenomenon in which the underlying data distributions and statistical properties of a target domain change over time, leading to a degradation in model performance. Consequently, production models require continuous…

Machine Learning · Computer Science 2025-08-07 Salvatore Greco , Bartolomeo Vacchetti , Daniele Apiletti , Tania Cerquitelli

The ability to detect and adapt to changes in data distributions is crucial to maintain the accuracy and reliability of machine learning models. Detection is generally approached by observing the drift of model performance from a global…

Machine Learning · Computer Science 2025-05-22 Flavio Giobergia , Eliana Pastor , Luca de Alfaro , Elena Baralis

Modern artificial intelligence (AI) applications require large quantities of training and test data. This need creates critical challenges not only concerning the availability of such data, but also regarding its quality. For example,…

Machine learning enables the extraction of useful information from large, diverse datasets. However, despite many successful applications, machine learning continues to suffer from performance and transparency issues. These challenges can…

Machine Learning · Computer Science 2025-07-08 V. C. Storey , J. Parsons , A. Castellanos , M. Tremblay , R. Lukyanenko , W. Maass , A. Castillo

Artificial intelligence (AI) has been increasingly applied to the condition monitoring of vehicular equipment, aiming to enhance maintenance strategies, reduce costs, and improve safety. Leveraging the edge computing paradigm, AI-based…

A significant part of contemporary research in autonomous vehicles is dedicated to the development of safety critical systems where state-of-the-art artificial intelligence (AI) algorithms, like computer vision (CV), can play a major role.…

In applying deep learning for malware classification, it is crucial to account for the prevalence of malware evolution, which can cause trained classifiers to fail on drifted malware. Existing solutions to address concept drift use active…

Cryptography and Security · Computer Science 2024-12-23 Adrian Shuai Li , Arun Iyengar , Ashish Kundu , Elisa Bertino

Additional training of a deep learning model can cause negative effects on the results, turning an initially positive sample into a negative one (degradation). Such degradation is possible in real-world use cases due to the diversity of…

Machine Learning · Computer Science 2022-05-19 Akihito Yoshii , Susumu Tokumoto , Fuyuki Ishikawa

AI modeling for source code understanding tasks has been making significant progress, and is being adopted in production development pipelines. However, reliability concerns, especially whether the models are actually learning task-related…

Software Engineering · Computer Science 2022-01-11 Sahil Suneja , Yufan Zhuang , Yunhui Zheng , Jim Laredo , Alessandro Morari

Machine learning models nowadays play a crucial role for many applications in business and industry. However, models only start adding value as soon as they are deployed into production. One challenge of deployed models is the effect of…

Machine Learning · Computer Science 2020-11-06 Lucas Baier , Vincent Kellner , Niklas Kühl , Gerhard Satzger

AI is foreseen to be a centerpiece in next generation wireless networks enabling enabling ubiquitous communication as well as new services. However, in real deployment, feature distribution changes may degrade the performance of AI models…