English
Related papers

Related papers: A probability theoretic approach to drifting data …

200 papers

Existing drift detection methods focus on designing sensitive test statistics. They treat the detection threshold as a fixed hyperparameter, set once to balance false alarms and late detections, and applied uniformly across all datasets and…

Machine Learning · Computer Science 2025-11-14 Pengqian Lu , Jie Lu , Anjin Liu , En Yu , Guangquan Zhang

Uncertain changes in data streams present challenges for machine learning models to dynamically adapt and uphold performance in real-time. Particularly, classification boundary change, also known as real concept drift, is the major cause of…

Machine Learning · Computer Science 2024-05-24 Feng Gu , Jie Lu , Zhen Fang , Kun Wang , Guangquan Zhang

Machine learning models are omnipresent for predictions on big data. One challenge of deployed models is the change of the data over time, a phenomenon called concept drift. If not handled correctly, a concept drift can lead to significant…

Machine Learning · Computer Science 2020-04-02 Lucas Baier , Marcel Hofmann , Niklas Kühl , Marisa Mohr , Gerhard Satzger

Data taken from observations of the natural world or laboratory measurements often depend on parameters which can vary in unexpected ways. In this paper we demonstrate how machine learning can be leveraged to detect changes in global…

Fluid Dynamics · Physics 2021-11-25 Logan M. Kageorge , Roman O. Grigoriev , Michael F. Schatz

Deployed machine learning models are confronted with the problem of changing data over time, a phenomenon also called concept drift. While existing approaches of concept drift detection already show convincing results, they require true…

Machine Learning · Computer Science 2022-09-26 Lucas Baier , Tim Schlör , Jakob Schöffer , Niklas Kühl

We consider a continuous-time random walk which is the generalization, by means of the introduction of waiting periods on sites, of the one-dimensional nonhomogeneous random walk with a position-dependent drift known in the mathematical…

Statistical Mechanics · Physics 2021-10-25 Gaia Pozzoli , Mattia Radice , Manuele Onofri , Roberto Artuso

Drift analysis is one of the state-of-the-art techniques for the runtime analysis of randomized search heuristics (RSHs) such as evolutionary algorithms (EAs), simulated annealing etc. The vast majority of existing drift theorems yield…

Neural and Evolutionary Computing · Computer Science 2018-05-30 Per Kristian Lehre , Carsten Witt

Recently, continual learning has received a lot of attention. One of the significant problems is the occurrence of \emph{concept drift}, which consists of changing probabilistic characteristics of the incoming data. In the case of the…

Machine Learning · Computer Science 2022-10-11 Sebastián Basterrech , Michal Woźniak

Deploying robust machine learning models has to account for concept drifts arising due to the dynamically changing and non-stationary nature of data. Addressing drifts is particularly imperative in the security domain due to the…

Cryptography and Security · Computer Science 2022-06-16 Aditya Kuppa , Nhien-An Le-Khac

Machine learning models nowadays play a crucial role for many applications in business and industry. However, models only start adding value as soon as they are deployed into production. One challenge of deployed models is the effect of…

Machine Learning · Computer Science 2020-11-06 Lucas Baier , Vincent Kellner , Niklas Kühl , Gerhard Satzger

The dynamicity of real-world systems poses a significant challenge to deployed predictive machine learning (ML) models. Changes in the system on which the ML model has been trained may lead to performance degradation during the system's…

Machine Learning · Computer Science 2022-03-22 Firas Bayram , Bestoun S. Ahmed , Andreas Kassler

The amount of real-time communication between agents in an information system has increased rapidly since the beginning of the decade. This is because the use of these systems, e. g. social media, has become commonplace in today's society.…

Machine Learning · Computer Science 2020-07-13 Christoph Raab , Moritz Heusinger , Frank-Michael Schleif

With today's abundant streams of data, the only constant we can rely on is change. For stream classification algorithms, it is necessary to adapt to concept drift. This can be achieved by monitoring the model error, and triggering counter…

Machine Learning · Computer Science 2020-12-09 Lukas Fleckenstein , Sebastian Kauschke , Johannes Fürnkranz

The distribution of streaming data often changes over time as conditions change, a phenomenon known as concept drift. Only a subset of previous experience, collected in similar conditions, is relevant to learning an accurate classifier for…

Machine Learning · Computer Science 2024-08-20 Ben Halstead , Yun Sing Koh , Patricia Riddle , Mykola Pechenizkiy , Albert Bifet

This paper elucidates the importance of governing an artificial intelligence model post-deployment and overseeing potential fluctuations in the distribution of present data in contrast to the training data. The concepts of data drift and…

Machine Learning · Computer Science 2023-09-06 Carlos Mario Braga Ortuño , Blanca Martinez Donoso , Belén Muñiz Villanueva

A trained ML model is deployed on another `test' dataset where target feature values (labels) are unknown. Drift is distribution change between the training and deployment data, which is concerning if model performance changes. For a…

Applications · Statistics 2022-09-07 Samuel Ackerman , Eitan Farchi , Orna Raz , Marcel Zalmanovici , Parijat Dube

Data distributions in streaming environments are usually not stationary. In order to maintain a high predictive quality at all times, online learning models need to adapt to distributional changes, which are known as concept drift. The…

Machine Learning · Computer Science 2022-03-31 Johannes Haug , Gjergji Kasneci

Concept drift is a common phenomenon in data streams where the statistical properties of the target variable change over time. Traditionally, drift is assumed to occur globally, affecting the entire dataset uniformly. However, this…

Machine Learning · Computer Science 2025-03-06 Flavio Giobergia , Eliana Pastor , Luca de Alfaro , Elena Baralis

Machine learning traditionally assumes that the training and testing data are distributed independently and identically. However, in many real-world settings, the data distribution can shift over time, leading to poor generalization of…

Machine Learning · Computer Science 2024-02-19 Sepidehsadat Hosseini , Mengyao Zhai , Hossein Hajimirsadegh , Frederick Tung

Business processes are prone to unexpected changes, as process workers may suddenly or gradually start executing a process differently in order to adjust to changes in workload, season, or other external factors. Early detection of business…

Artificial Intelligence · Computer Science 2020-05-11 Abderrahmane Maaradji , Marlon Dumas , Marcello La Rosa , Alireza Ostovar