English
Related papers

Related papers: Stress-Aware Learning under KL Drift via Trust-Dec…

200 papers

We consider an online learning problem on a continuum. A decision maker is given a compact feasible set $S$, and is faced with the following sequential problem: at iteration~$t$, the decision maker chooses a distribution $x^{(t)} \in…

Machine Learning · Computer Science 2015-04-30 Walid Krichene

We consider un-discounted reinforcement learning (RL) in Markov decision processes (MDPs) under drifting non-stationarity, i.e., both the reward and state transition distributions are allowed to evolve over time, as long as their respective…

Machine Learning · Computer Science 2020-06-26 Wang Chi Cheung , David Simchi-Levi , Ruihao Zhu

In this paper, we improve the kernel alignment regret bound for online kernel learning in the regime of the Hinge loss function. Previous algorithm achieves a regret of $O((\mathcal{A}_TT\ln{T})^{\frac{1}{4}})$ at a computational complexity…

Machine Learning · Computer Science 2024-03-14 Junfan Li , Shizhong Liao

We study sequential decision-making in time-varying Markov decision processes (TVMDPs) under limited update rates, where the decision-maker observes the system and updates its model only intermittently. Such settings arise in applications…

Systems and Control · Electrical Eng. & Systems 2026-04-16 Negin Musavi , Melkior Ornik

The growing prevalence of drift and shocks in modern decision environments exposes a gap between classical optimization theory and real-world practice. Standard models assume fixed objectives, yet organizations from hospitals to power grids…

Computational Finance · Quantitative Finance 2025-09-18 JINHO CHA

Safety is a critical concern in motion planning for autonomous vehicles. Modern autonomous vehicles rely on neural network-based perception, but making control decisions based on these inference results poses significant safety risks due to…

Robotics · Computer Science 2025-12-24 Hyeongchan Ham , Heejin Ahn

We consider the problem of online learning in Linear Quadratic Control systems whose state transition and state-action transition matrices $A$ and $B$ may be initially unknown. We devise an online learning algorithm and provide guarantees…

Machine Learning · Computer Science 2021-09-30 Yassir Jedra , Alexandre Proutiere

The upper confidence reinforcement learning (UCRL2) algorithm introduced in (Jaksch et al., 2010) is a popular method to perform regret minimization in unknown discrete Markov Decision Processes under the average-reward criterion. Despite…

Machine Learning · Computer Science 2021-04-14 Hippolyte Bourel , Odalric-Ambrym Maillard , Mohammad Sadegh Talebi

Reliable uncertainty quantification is crucial for reinforcement learning (RL) in high-stakes settings. We propose a unified conformal prediction framework for infinite-horizon policy evaluation that constructs distribution-free prediction…

Machine Learning · Statistics 2025-10-31 Feichen Gan , Youcun Lu , Yingying Zhang , Yukun Liu

Consider an online convex optimization problem where the loss functions are self-concordant barriers, smooth relative to a convex function $h$, and possibly non-Lipschitz. We analyze the regret of online mirror descent with $h$. Then, based…

Machine Learning · Statistics 2023-09-22 Chung-En Tsai , Hao-Chung Cheng , Yen-Huan Li

Learning systems are typically optimized by minimizing loss or maximizing reward, assuming that improvements in these signals reflect progress toward the true objective. However, when feedback reliability is unobservable, this assumption…

Machine Learning · Computer Science 2026-03-24 Zhipeng Zhang , Zhenjie Yao , Kai Li , Lei Yang

We devise an online learning algorithm -- titled Switching via Monotone Adapted Regret Traces (SMART) -- that adapts to the data and achieves regret that is instance optimal, i.e., simultaneously competitive on every input sequence compared…

Machine Learning · Computer Science 2024-02-28 Siddhartha Banerjee , Alankrita Bhatt , Christina Lee Yu

Research on Knowledge Tracing (KT) models traditionally focuses on improving predictive accuracy. However, responsible real-world deployment requires models to know when to defer uncertain predictions to a human teacher. We introduce an…

Machine Learning · Computer Science 2026-05-04 Joshua Mitton , Prarthana Bhattacharyya , Ralph Abboud , Simon Woodhead

We study, to our knowledge, the first tractable multistage ex-ante distributionally robust regret optimization (DRRO) formulation for stochastic control. We consider finite-horizon LQR under common stage-law ambiguity: disturbances are…

Optimization and Control · Mathematics 2026-04-08 Lukas-Benedikt Fiechtner , Jose Blanchet

This work focuses on the setting of dynamic regret in the context of online learning with full information. In particular, we analyze regret bounds with respect to the temporal variability of the loss functions. By assuming that the…

Machine Learning · Computer Science 2021-02-16 Nicolò Campolongo , Francesco Orabona

Statistical learning under distributional drift remains poorly characterized, especially in closed-loop settings where learning alters the data-generating law. We introduce an intrinsic drift budget $C_T$ that quantifies cumulative…

Machine Learning · Computer Science 2026-05-19 Sofiya Zaichyk

Recent work by Woodworth et al. (2020) shows that the optimization dynamics of gradient descent for overparameterized problems can be viewed as low-dimensional dual dynamics induced by a mirror map, explaining the implicit regularization…

Machine Learning · Computer Science 2024-10-21 Shuyang Wang , Diego Klabjan

This paper studies model-based reinforcement learning (RL) for regret minimization. We focus on finite-horizon episodic RL where the transition model $P$ belongs to a known family of models $\mathcal{P}$, a special case of which is when…

Machine Learning · Computer Science 2020-06-02 Alex Ayoub , Zeyu Jia , Csaba Szepesvari , Mengdi Wang , Lin F. Yang

We consider prediction with expert advice when data are generated from distributions varying arbitrarily within an unknown constraint set. This semi-adversarial setting includes (at the extremes) the classical i.i.d. setting, when the…

Machine Learning · Statistics 2022-07-25 Blair Bilodeau , Jeffrey Negrea , Daniel M. Roy

Statistical inference with bandit data presents fundamental challenges due to adaptive sampling, which violates the independence assumptions underlying classical asymptotic theory. Recent work has identified stability as a sufficient…

Machine Learning · Statistics 2026-03-12 Budhaditya Halder , Ishan Sengupta , Koustav Chowdhury , Koulik Khamaru