English
Related papers

Related papers: Detection of data drift and outliers affecting mac…

200 papers

ML models deployed in production often have to face unknown domain changes, fundamentally different from their training settings. Performance prediction models carry out the crucial task of measuring the impact of these changes on model…

Machine Learning · Computer Science 2022-06-23 Simona Maggio , Victor Bouvier , Léo Dreyfus-Schmidt

Recent work has shown that the performance of machine learning models can vary substantially when models are evaluated on data drawn from a distribution that is close to but different from the training distribution. As a result, predicting…

Machine Learning · Computer Science 2021-08-23 Devin Guillory , Vaishaal Shankar , Sayna Ebrahimi , Trevor Darrell , Ludwig Schmidt

Machine learning models nowadays play a crucial role for many applications in business and industry. However, models only start adding value as soon as they are deployed into production. One challenge of deployed models is the effect of…

Machine Learning · Computer Science 2020-11-06 Lucas Baier , Vincent Kellner , Niklas Kühl , Gerhard Satzger

Business processes are prone to unexpected changes, as process workers may suddenly or gradually start executing a process differently in order to adjust to changes in workload, season, or other external factors. Early detection of business…

Artificial Intelligence · Computer Science 2020-05-11 Abderrahmane Maaradji , Marlon Dumas , Marcello La Rosa , Alireza Ostovar

Adapting to drifting data streams is a significant challenge in online learning. Concept drift must be detected for effective model adaptation to evolving data properties. Concept drift can impact the data distribution entirely or…

Machine Learning · Computer Science 2023-12-12 Gabriel J. Aguiar , Alberto Cano

In the midst of the rapid integration of artificial intelligence (AI) into real world applications, one pressing challenge we confront is the phenomenon of model drift, wherein the performance of AI models gradually degrades over time,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Samiha Mirza , Vuong D. Nguyen , Pranav Mantini , Shishir K. Shah

Concept drift refers to a change in the data distribution affecting the data stream of future samples. Consequently, learning models operating on the data stream might become obsolete, and need costly and difficult adjustments such as…

Machine Learning · Computer Science 2023-09-20 André Artelt , Kleanthis Malialis , Christos Panayiotou , Marios Polycarpou , Barbara Hammer

Concept drift refers to a non stationary learning problem over time. The training and the application data often mismatch in real life problems. In this report we present a context of concept drift problem 1. We focus on the issues relevant…

Artificial Intelligence · Computer Science 2010-10-25 Indrė Žliobaitė

Data distributions in streaming environments are usually not stationary. In order to maintain a high predictive quality at all times, online learning models need to adapt to distributional changes, which are known as concept drift. The…

Machine Learning · Computer Science 2022-03-31 Johannes Haug , Gjergji Kasneci

The problem of detecting whether a test sample is from in-distribution (i.e., training distribution by a classifier) or out-of-distribution sufficiently different from it arises in many real-world machine learning applications. However, the…

Machine Learning · Statistics 2018-02-27 Kimin Lee , Honglak Lee , Kibok Lee , Jinwoo Shin

Standard Control Chart techniques to detect level shift in data streams assume independence between observations. As data today is collected with high frequency, this assumption is seldom valid. To overcome this, we propose to adapt the…

Methodology · Statistics 2019-11-11 Jacob Søgaard Larsen , Anders Stockmarr , Bjarne Kjær Ersbøll , Murat Kulahci

Machine learning models are commonly used for malware classification; however, they suffer from performance degradation over time due to concept drift. Adapting these models to changing data distributions requires frequent updates, which…

Machine Learning · Computer Science 2025-08-05 Md Tanvirul Alam , Aritran Piplai , Nidhi Rastogi

In the context of Just-In-Time Software Defect Prediction (JIT-SDP), Concept drift (CD) can occur due to changes in the software development process, the complexity of the software, or changes in user behavior that may affect the stability…

Software Engineering · Computer Science 2023-05-29 Zeynab Chitsazian , Saeed Sedighian Kashi , Amin Nikanjam

Outlying observations are frequently encountered across a wide spectrum of scientific domains, posing notable challenges to the generalizability of statistical models and the reproducibility of downstream analysis. They are identified…

Methodology · Statistics 2026-03-17 Dongliang Zhang , Masoud Asgharian , Martin A. Lindquist

National statistical institutes currently investigate how to improve the output quality of official statistics based on machine learning algorithms. A key obstacle is concept drift, i.e., when the joint distribution of independent variables…

Methodology · Statistics 2021-03-02 Quinten Meertens , Cees Diks , Jaap van den Herik , Frank Takes

Modern neural networks can assign high confidence to inputs drawn from outside the training distribution, posing threats to models in real-world deployments. While much research attention has been placed on designing new out-of-distribution…

Machine Learning · Computer Science 2022-03-08 Yifei Ming , Hang Yin , Yixuan Li

Despite outstanding results, machine learning-based Android malware detection models struggle with concept drift, where rapidly evolving malware characteristics degrade model effectiveness. This study examines the impact of concept drift on…

Cryptography and Security · Computer Science 2025-07-31 Ahmed Sabbah , Radi Jarrar , Samer Zein , David Mohaisen

As the adoption of deep learning models has grown beyond human capacity for verification, meta-algorithms are needed to ensure reliable model inference. Concept drift detection is a field dedicated to identifying statistical shifts that is…

Machine Learning · Computer Science 2025-05-08 Jacob Glenn Ayers , Buvaneswari A. Ramanan , Manzoor A. Khan

Several areas have been improved with Deep Learning during the past years. For non-safety related products adoption of AI and ML is not an issue, whereas in safety critical applications, robustness of such approaches is still an issue. A…

Machine learning models often deteriorate in their performance when they are used to predict the outcomes over data on which they were not trained. These scenarios can often arise in real world when the distribution of data changes…

Machine Learning · Computer Science 2024-01-19 Narayanan U. Edakunni , Utkarsh Tekriwal , Anukriti Jain