English
Related papers

Related papers: Learning under Distributional Drift: Prequential R…

200 papers

We investigate first-hitting location (FHL) statistics induced by drift-diffusion processes in domains with absorbing boundaries, and examine how such boundary laws give rise to intrinsic information observables. Rather than introducing…

Statistical Mechanics · Physics 2026-04-07 Yen-Chi Lee

In this work, we investigate an intriguing and prevalent phenomenon of diffusion models which we term as "consistent model reproducibility": given the same starting noise input and a deterministic sampler, different diffusion models often…

Machine Learning · Computer Science 2024-06-11 Huijie Zhang , Jinfan Zhou , Yifu Lu , Minzhe Guo , Peng Wang , Liyue Shen , Qing Qu

Learning high-performance control policies that remain consistent with expert behavior is a fundamental challenge in robotics. Reinforcement learning can discover high-performing strategies but often departs from desirable human behavior,…

Robotics · Computer Science 2026-04-06 Siwei Ju , Jan Tauberschmidt , Oleg Arenz , Peter van Vliet , Jan Peters

Human decision making behavior is observed with choice-response time data during psychological experiments. Drift-diffusion models of this data consist of a Wiener first-passage time (WFPT) distribution and are described by cognitive…

Neurons and Cognition · Quantitative Biology 2022-08-18 Qinhua Jenny Sun , Khuong Vo , Kitty Lui , Michael Nunez , Joachim Vandekerckhove , Ramesh Srinivasan

Statistical Inference is the process of determining a probability distribution over the space of parameters of a model given a data set. As more data becomes available this probability distribution becomes updated via the application of…

Disordered Systems and Neural Networks · Physics 2022-04-28 David S. Berman , Jonathan J. Heckman , Marc Klinger

Drift analysis aims at translating the expected progress of an evolutionary algorithm (or more generally, a random process) into a probabilistic guarantee on its run time (hitting time). So far, drift arguments have been successfully…

Neural and Evolutionary Computing · Computer Science 2021-11-01 Benjamin Doerr , Timo Kötzing

Complex planning and scheduling problems have long been solved using various optimization or heuristic approaches. In recent years, imitation learning that aims to learn from expert demonstrations has been proposed as a viable alternative…

Machine Learning · Computer Science 2024-05-24 Qian Shao , Pradeep Varakantham , Shih-Fen Cheng

Generative modeling over discrete data has recently seen numerous success stories, with applications spanning language modeling, biological sequence design, and graph-structured molecular data. The predominant generative modeling paradigm…

Machine Learning · Computer Science 2024-11-01 Oscar Davis , Samuel Kessler , Mircea Petrache , İsmail İlkan Ceylan , Michael Bronstein , Avishek Joey Bose

Uncertain changes in data streams present challenges for machine learning models to dynamically adapt and uphold performance in real-time. Particularly, classification boundary change, also known as real concept drift, is the major cause of…

Machine Learning · Computer Science 2024-05-24 Feng Gu , Jie Lu , Zhen Fang , Kun Wang , Guangquan Zhang

We study online conformal prediction for non-stationary data streams subject to unknown distribution drift. While most prior work studied this problem under adversarial settings and/or assessed performance in terms of gaps of time-averaged…

Statistics Theory · Mathematics 2026-03-06 Jiadong Liang , Zhimei Ren , Yuxin Chen

Runtime analysis, as a branch of the theory of AI, studies how the number of iterations algorithms take before finding a solution (its runtime) depends on the design of the algorithm and the problem structure. Drift analysis is a…

Neural and Evolutionary Computing · Computer Science 2024-05-14 Per Kristian Lehre , Shishen Lin

Drift analysis is one of the state-of-the-art techniques for the runtime analysis of randomized search heuristics (RSHs) such as evolutionary algorithms (EAs), simulated annealing etc. The vast majority of existing drift theorems yield…

Neural and Evolutionary Computing · Computer Science 2018-05-30 Per Kristian Lehre , Carsten Witt

The continuous surge in data volume and velocity is often dealt with using data orchestration and distributed processing approaches, abstracting away the machine learning challenges that exist at the algorithmic level. With growing interest…

Machine Learning · Computer Science 2025-03-04 Behraj Khan , Behroz Mirza , Nouman Durrani , Tahir Syed

Data distributions in streaming environments are usually not stationary. In order to maintain a high predictive quality at all times, online learning models need to adapt to distributional changes, which are known as concept drift. The…

Machine Learning · Computer Science 2022-03-31 Johannes Haug , Gjergji Kasneci

Randomized Controlled Trials (RCTs) represent the gold standard for causal inference yet remain a scarce resource. While large-scale observational data is often available, it is utilized only for retrospective fusion, and remains discarded…

Machine Learning · Statistics 2026-03-05 Erdun Gao , Liang Zhang , Jake Fawkes , Aoqi Zuo , Wenqin Liu , Haoxuan Li , Mingming Gong , Dino Sejdinovic

We study the problem of learning in the presence of a drifting target concept. Specifically, we provide bounds on the error rate at a given time, given a learner with access to a history of independent samples labeled according to a target…

Machine Learning · Computer Science 2015-05-21 Steve Hanneke , Varun Kanade , Liu Yang

Recent studies in federated learning (FL) commonly train models on static datasets. However, real-world data often arrives as streams with shifting distributions, causing performance degradation known as concept drift. This paper analyzes…

Machine Learning · Computer Science 2025-06-27 Fu Peng , Meng Zhang , Ming Tang

Many reinforcement learning (RL) tasks have discrete action spaces, but most generative policy methods based on diffusion and flow matching are designed for continuous control. Meanwhile, generative policies usually rely heavily on offline…

Machine Learning · Computer Science 2026-05-13 Fairoz Nower Khan , Nabuat Zaman Nahim , Peizhong Ju

Drift diffusion models (DDMs) have found widespread use in computational neuroscience and other fields. They model evidence accumulation in simple decision tasks as a stochastic process drifting towards a decision barrier. In models where…

Methodology · Statistics 2025-12-12 Sicheng Liu , Alexander Fengler , Michael J. Frank , Matthew T. Harrison

Local prediction-error-based curiosity rewards focus on the current transition without considering the world model's cumulative prediction error across all visited transitions. We introduce Curiosity-Critic, which grounds its intrinsic…

Machine Learning · Computer Science 2026-04-30 Vin Bhaskara , Haicheng Wang