English
Related papers

Related papers: An Improved Algorithm for Learning Drifting Discre…

200 papers

Most predictive models assume that training and test data are generated from a stationary process. However, this assumption does not hold true in practice. In this paper, we consider the scenario of a gradual concept drift due to the…

Machine Learning · Computer Science 2020-02-12 Subhro Das , Prasanth Lade , Soundar Srinivasan

Time series prediction is often complicated by distribution shift which demands adaptive models to accommodate time-varying distributions. We frame time series prediction under distribution shift as a weighted empirical risk minimisation…

Machine Learning · Computer Science 2022-07-26 Stefanos Bennett , Jase Clarkson

Machine learning models are increasingly trained or fine-tuned on synthetic data. Recursively training on such data has been observed to significantly degrade performance in a wide range of tasks, often characterized by a progressive drift…

Machine Learning · Statistics 2026-02-19 Nail B. Khelifa , Richard E. Turner , Ramji Venkataramanan

In the classic machine learning framework, models are trained on historical data and used to predict future values. It is assumed that the data distribution does not change over time (stationarity). However, in real-world scenarios, the…

Machine Learning · Statistics 2023-06-13 Mansour Zoubeirou A Mayaki , Michel Riveill

In this paper we provide a thorough, rigorous theoretical framework to assess optimality guarantees of sampling-based algorithms for drift control systems: systems that, loosely speaking, can not stop instantaneously due to momentum. We…

Robotics · Computer Science 2015-10-28 Edward Schmerling , Lucas Janson , Marco Pavone

We study the well-motivated problem of online distribution shift in which the data arrive in batches and the distribution of each batch can change arbitrarily over time. Since the shifts can be large or small, abrupt or gradual, the length…

Machine Learning · Computer Science 2025-04-11 Dheeraj Baby , Boran Han , Shuai Zhang , Cuixiong Hu , Yuyang Wang , Yu-Xiang Wang

The notion of concept drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time. We are interested in an identification of those features, that are most relevant for the observed drift.…

Machine Learning · Computer Science 2020-12-02 Fabian Hinder , Jonathan Jakob , Barbara Hammer

Time-varying stochastic optimization problems frequently arise in machine learning practice (e.g. gradual domain shift, object tracking, strategic classification). Although most problems are solved in discrete time, the underlying process…

Machine Learning · Computer Science 2023-02-24 Subha Maity , Debarghya Mukherjee , Moulinath Banerjee , Yuekai Sun

In recent years, we have seen a handful of work on inference algorithms over non-stationary data streams. Given their flexibility, Bayesian non-parametric models are a good candidate for these scenarios. However, reliable streaming…

Machine Learning · Statistics 2022-10-14 Ioar Casado , Aritz Pérez

The notion of drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time. Albeit many attempts were made to deal with drift, formal notions of drift are application-dependent and…

Machine Learning · Computer Science 2019-12-05 Fabian Hinder , André Artelt , Barbara Hammer

We study reinforcement learning for controlled diffusion processes with unbounded continuous state spaces, bounded continuous actions, and polynomially growing rewards: settings that arise naturally in finance, economics, and operations…

Machine Learning · Computer Science 2025-12-18 Hanqing Jin , Renyuan Xu , Yanzhao Yang

This paper focuses on stochastic saddle point problems with decision-dependent distributions. These are problems whose objective is the expected value of a stochastic payoff function and whose data distribution drifts in response to…

Optimization and Control · Mathematics 2022-11-15 Killian Wood , Emiliano Dall'Anese

We propose an algorithm which predicts each subsequent time step relative to the previous timestep of intractable short rate model (when adjusted for drift and overall distribution of previous percentile result) and show that the method…

Machine Learning · Statistics 2024-04-15 Anna Knezevic , Nikolai Dokuchaev

We propose an adaptive diffusion mechanism to optimize a global cost function in a distributed manner over a network of nodes. The cost function is assumed to consist of a collection of individual components. Diffusion adaptation allows the…

Optimization and Control · Mathematics 2015-06-03 Jianshu Chen , Ali H. Sayed

This paper addresses the general problem of domain adaptation which arises in a variety of applications where the distribution of the labeled sample available somewhat differs from that of the test data. Building on previous work by…

Machine Learning · Computer Science 2023-12-04 Yishay Mansour , Mehryar Mohri , Afshin Rostamizadeh

This paper studies the problem of steering the distribution of a discrete-time dynamical system from an initial distribution to a target distribution in finite time. The formulation is fully nonlinear, allowing the use of general control…

Systems and Control · Electrical Eng. & Systems 2024-09-05 George Rapakoulias , Panagiotis Tsiotras

We consider the problem of statistical inference for the effective dynamics of multiscale diffusion processes with (at least) two widely separated characteristic time scales. More precisely, we seek to determine parameters in the effective…

Statistics Theory · Mathematics 2013-05-30 Sebastian Krumscheid , Grigorios A. Pavliotis , Serafim Kalliadasis

In many open environment applications, data are collected in the form of a stream, which exhibits an evolving distribution over time. How to design algorithms to track these evolving data distributions with provable guarantees, particularly…

Machine Learning · Computer Science 2024-11-06 Chao Xu , Xijia Tang , Guoqing Liu , Yuhua Qian , Chenping Hou

We investigate model assessment and selection in a changing environment, by synthesizing datasets from both the current time period and historical epochs. To tackle unknown and potentially arbitrary temporal distribution shift, we develop…

Machine Learning · Computer Science 2024-06-05 Elise Han , Chengpiao Huang , Kaizheng Wang

Traditional regression and prediction tasks often only provide deterministic point estimates. To estimate the distribution or uncertainty of the response variable, traditional methods either assume that the posterior distribution of samples…

Machine Learning · Computer Science 2025-01-08 Daojun Liang , Haixia Zhang , Dongfeng Yuan