English
Related papers

Related papers: A probability theoretic approach to drifting data …

200 papers

We consider a simple mean reverting diffusion process, with piecewise constant drift and diffusion coefficients, discontinuous at a fixed threshold. We discuss estimation of drift and diffusion parameters from discrete observations of the…

Statistics Theory · Mathematics 2024-03-12 Sara Mazzonetto , Paolo Pigato

We study nonparametric density estimation in non-stationary drift settings. Given a sequence of independent samples taken from a distribution that gradually changes in time, the goal is to compute the best estimate for the current…

Machine Learning · Computer Science 2023-10-31 Alessio Mazzetto , Eli Upfal

Traditional machine learning assumes a stationary data distribution, yet many real-world applications operate on nonstationary streams in which the underlying concept evolves over time. This problem can also be viewed as task-free continual…

Machine Learning · Computer Science 2026-03-17 Michal Wozniak , Marek Klonowski , Maciej Maczynski , Bartosz Krawczyk

Flight delays impose challenges that impact any flight transportation system. Predicting when they are going to occur is an important way to mitigate this issue. However, the behavior of the flight delay system varies through time. This…

Machine Learning · Computer Science 2022-02-01 Lucas Giusti , Leonardo Carvalho , Antonio Tadeu Gomes , Rafaelli Coutinho , Jorge Soares , Eduardo Ogasawara

Distribution shift is a common situation in machine learning tasks, where the data used for training a model is different from the data the model is applied to in the real world. This issue arises across multiple technical settings: from…

Machine Learning · Computer Science 2024-05-24 Nicolas Acevedo , Carmen Cortez , Chris Brooks , Rene Kizilcec , Renzhe Yu

Conventional statistics begins with a model, and assigns a likelihood of obtaining any particular set of data. The opposite approach, beginning with the data and assigning a likelihood to any particular model, is explored here for the case…

Data Analysis, Statistics and Probability · Physics 2009-10-30 Timothy E. Holy

Learning guarantees often rely on assumptions of i.i.d. data, which will likely be violated in practice once predictors are deployed to perform real-world tasks. Domain adaptation approaches thus appeared as a useful framework yielding…

Machine Learning · Computer Science 2021-06-29 Joao Monteiro , Xavier Gibert , Jianqiao Feng , Vincent Dumoulin , Dar-Shyang Lee

We introduce and study knowledge drift (KD), a complex form of drift that occurs in hierarchical classification. Under KD the vocabulary of concepts, their individual distributions, and the is-a relations between them can all change over…

Machine Learning · Computer Science 2021-03-30 Andrea Bontempelli , Fausto Giunchiglia , Andrea Passerini , Stefano Teso

This work focuses on classification over time series data. When a time series is generated by non-stationary phenomena, the pattern relating the series with the class to be predicted may evolve over time (concept drift). Consequently,…

Machine Learning · Computer Science 2020-04-02 Eric L. Manibardo , Ibai Laña , Jesus L. Lobo , Javier Del Ser

Deep learning algorithms have made incredible strides in the past decade, yet due to their complexity, the science of deep learning remains in its early stages. Being an experimentally driven field, it is natural to seek a theory of deep…

Machine Learning · Statistics 2025-04-18 Zohar Ringel , Noa Rubin , Edo Mor , Moritz Helias , Inbar Seroussi

The concept of random dynamical system is a comparatively recent development combining ideas and methods from the well developed areas of probability theory and dynamical systems. Due to our inaccurate knowledge of the particular physical…

Dynamical Systems · Mathematics 2007-05-23 Vitor Araujo

We introduce Class Distribution Monitoring (CDM), an effective concept-drift detection scheme that monitors the class-conditional distributions of a datastream. In particular, our solution leverages multiple instances of an online and…

Machine Learning · Computer Science 2022-10-18 Diego Stucchi , Luca Frittoli , Giacomo Boracchi

Safely deploying machine learning models to the real world is often a challenging process. Models trained with data obtained from a specific geographic location tend to fail when queried with data obtained elsewhere, agents trained in a…

Machine Learning · Computer Science 2021-11-02 Marco Federici , Ryota Tomioka , Patrick Forré

Drift analysis has become a powerful tool to prove bounds on the runtime of randomized search heuristics. It allows, for example, fairly simple proofs for the classical problem how the (1+1) Evolutionary Algorithm (EA) optimizes an…

Neural and Evolutionary Computing · Computer Science 2015-03-17 Benjamin Doerr , Daniel Johannsen , Carola Winzen

One important assumption underlying common classification models is the stationarity of the data. However, in real-world streaming applications, the data concept indicated by the joint distribution of feature and label is not stationary but…

Machine Learning · Computer Science 2018-08-10 Shujian Yu , Xiaoyang Wang , Jose C. Principe

Real-world deployment of machine learning models is challenging because data evolves over time. While no model can work when data evolves in an arbitrary fashion, if there is some pattern to these changes, we might be able to design methods…

Machine Learning · Computer Science 2024-05-03 Rasool Fakoor , Jonas Mueller , Zachary C. Lipton , Pratik Chaudhari , Alexander J. Smola

Complex systems are characterized by a huge number of degrees of freedom often interacting in a non-linear manner. In many cases macroscopic states, however, can be characterized by a small number of order parameters that obey stochastic…

Data Analysis, Statistics and Probability · Physics 2012-02-20 David Kleinhans

Machine learning models are being increasingly used to automate decisions in almost every domain, and ensuring the performance of these models is crucial for ensuring high quality machine learning enabled services. Ensuring concept drift is…

Machine Learning · Statistics 2025-09-30 Nelvin Tan , Yu-Ching Shih , Dong Yang , Amol Salunkhe

eCommerce transaction frauds keep changing rapidly. This is the major issue that prevents eCommerce merchants having a robust machine learning model for fraudulent transactions detection. The root cause of this problem is that rapid…

Applications · Statistics 2018-10-11 Huiying Mao , Yung-wen Liu , Yuting Jia , Jay Nanduri

Spreading phenomena on networks are essential for the collective dynamics of various natural and technological systems, from information spreading in gene regulatory networks to neural circuits or from epidemics to supply networks…

Physics and Society · Physics 2021-06-01 Justine Wolter , Benedict Lünsmann , Xiaozhu Zhang , Malte Schröder , Marc Timme