English
Related papers

Related papers: Learning under Distributional Drift: Prequential R…

200 papers

We consider a stochastic lost-sales inventory control system with a lead time $L$ over a planning horizon $T$. Supply is uncertain, and is a function of the order quantity (due to random yield/capacity, etc). We aim to minimize the…

Optimization and Control · Mathematics 2023-11-01 Boxiao Chen , Jiashuo Jiang , Jiawei Zhang , Zhengyuan Zhou

This paper derives an optimal control strategy for a simple stochastic dynamical system with constant drift and an additive control input. Motivated by the example of a physical system with an unexpected change in its dynamics, we take the…

Optimization and Control · Mathematics 2022-02-09 Daniel Gurevich , Debdipta Goswami , Charles L. Fefferman , Clarence W. Rowley

Database research can help machine learning performance in many ways. One way is to design better data structures. This paper combines the use of incremental computation and sequential and probabilistic filtering to enable "forgetful"…

Machine Learning · Computer Science 2022-12-16 Zhehu Yuan , Yinqi Sun , Dennis Shasha

This paper studies the theoretical underpinnings of machine learning of ergodic It\^o diffusions. The objective is to understand the convergence properties of the invariant statistics when the underlying system of stochastic differential…

Machine Learning · Computer Science 2021-10-04 He Zhang , John Harlim , Xiantao Li

Data plays a pivotal role in the groundbreaking advancements in artificial intelligence. The quantitative analysis of data significantly contributes to model training, enhancing both the efficiency and quality of data utilization. However,…

Machine Learning · Computer Science 2025-08-21 Haoru Tan , Sitong Wu , Xiuzhe Wu , Wang Wang , Bo Zhao , Zeke Xie , Gui-Song Xia , Xiaojuan Qi

Federated and Continual Learning have emerged as potential paradigms for the robust and privacy-aware use of Deep Learning in dynamic environments. However, Client Drift and Catastrophic Forgetting are fundamental obstacles to guaranteeing…

Machine Learning · Computer Science 2023-09-06 Niklas Babendererde , Moritz Fuchs , Camila Gonzalez , Yuri Tolkach , Anirban Mukhopadhyay

Large language models confidently produce outdated answers, and no existing method can detect them. We show this is not an engineering failure but a structural one: temporal drift, whether a stored fact has changed since training, is…

Artificial Intelligence · Computer Science 2026-05-12 Rania Elbadry , Ahmed Heakl , Fan Zhang , Dani Bouch , Yuxia Wang , Preslav Nakov , Zhuohan Xie

Distributional reinforcement learning (DRL) enhances the understanding of the effects of the randomness in the environment by letting agents learn the distribution of a random return, rather than its expected value as in standard RL. At the…

Optimization and Control · Mathematics 2023-03-27 Zifan Wang , Yulong Gao , Siyi Wang , Michael M. Zavlanos , Alessandro Abate , Karl H. Johansson

Evolutionary game dynamics in finite populations is typically subject to noise, inducing effects which are not present in deterministic systems, including fixation and extinction. In the first part of this paper we investigate the…

Populations and Evolution · Quantitative Biology 2010-06-16 Tobias Galla

When a source-trained model $Q$ is replaced by a model $\tilde{Q}$ trained on shifted data, its performance on the source domain can change unpredictably. To address this, we study the two-model risk change, $\Delta R := R_P(\tilde{Q}) -…

Machine Learning · Computer Science 2026-02-12 Hosein Anjidani , S. Yahya S. R. Tehrani , Mohammad Mahdi Mojahedian , Mohammad Hossein Yassaee

Data-driven predictive analytics are in use today across a number of industrial applications, but further integration is hindered by the requirement of similarity among model training and test data distributions. This paper addresses the…

Machine Learning · Computer Science 2017-10-20 Yunwen Xu , Rui Xu , Weizhong Yan , Paul Ardis

In this paper, we prove that Distributional Reinforcement Learning (DistRL), which learns the return distribution, can obtain second-order bounds in both online and offline RL in general settings with function approximation. Second-order…

Machine Learning · Computer Science 2024-02-13 Kaiwen Wang , Owen Oertell , Alekh Agarwal , Nathan Kallus , Wen Sun

Self-supervised learning is a powerful approach for developing traversability models for off-road navigation, but these models often struggle with inputs unseen during training. Existing methods utilize techniques like evidential deep…

Data stream classification is an important problem in the field of machine learning. Due to the non-stationary nature of the data where the underlying distribution changes over time (concept drift), the model needs to continuously adapt to…

Machine Learning · Computer Science 2022-09-13 Andrea Castellani , Sebastian Schmitt , Barbara Hammer

We introduce data-driven decision-making algorithms that achieve state-of-the-art \emph{dynamic regret} bounds for non-stationary bandit settings. These settings capture applications such as advertisement allocation, dynamic pricing, and…

Machine Learning · Computer Science 2021-03-19 Wang Chi Cheung , David Simchi-Levi , Ruihao Zhu

We propose and study a realistic Continual Learning (CL) setting where learning algorithms are granted a restricted computational budget per time step while training. We apply this setting to large-scale semi-supervised Continual Learning…

Machine Learning · Computer Science 2024-06-11 Wenxuan Zhang , Youssef Mohamed , Bernard Ghanem , Philip H. S. Torr , Adel Bibi , Mohamed Elhoseiny

We present a method for providing statistical guarantees on runtime safety and goal reachability for integrated planning and control of a class of systems with unknown nonlinear stochastic underactuated dynamics. Specifically, given a…

Robotics · Computer Science 2022-12-15 Craig Knuth , Glen Chou , Jamie Reese , Joe Moore

Given the inherent non-stationarity prevalent in real-world applications, continual Reinforcement Learning (RL) aims to equip the agent with the capability to address a series of sequentially presented decision-making tasks. Within this…

Machine Learning · Computer Science 2024-11-19 Feng Chen , Fuguang Han , Cong Guan , Lei Yuan , Zhilong Zhang , Yang Yu , Zongzhang Zhang

We propose a new reinforcement learning (RL) formulation for training continuous-time score-based diffusion models for generative AI to generate samples that maximize reward functions while keeping the generated distributions close to the…

Machine Learning · Computer Science 2025-08-12 Xuefeng Gao , Jiale Zha , Xun Yu Zhou

We develop a probabilistic framework for analysing model-based reinforcement learning in the episodic setting. We then apply it to study finite-time horizon stochastic control problems with linear dynamics but unknown coefficients and…

Machine Learning · Computer Science 2021-12-22 Lukasz Szpruch , Tanut Treetanthiploet , Yufei Zhang