English
Related papers

Related papers: Regret Analysis with Almost Sure Convergence for O…

200 papers

The Kalman filter (KF) is one of the most widely used tools for data assimilation and sequential estimation. In this work, we show that the state estimates from the KF in a standard linear dynamical system setting are equivalent to those…

Methodology · Statistics 2021-08-04 Maria Jahja , David C. Farrow , Roni Rosenfeld , Ryan J. Tibshirani

Past research on interactive decision making problems (bandits, reinforcement learning, etc.) mostly focuses on the minimax regret that measures the algorithm's performance on the hardest instance. However, an ideal algorithm should adapt…

Machine Learning · Computer Science 2023-06-13 Kefan Dong , Tengyu Ma

Bayesian optimization (BO) with preference-based feedback has recently garnered significant attention due to its emerging applications. We refer to this problem as Bayesian Optimization from Human Feedback (BOHF), which differs from…

Machine Learning · Computer Science 2025-05-30 Aya Kayal , Sattar Vakili , Laura Toni , Da-shan Shiu , Alberto Bernacchia

For the battery management system of electric vehicle, accurate estimation of the State of Charge of Lithium-ion battery can effectively avoid structural damage caused by overcharge or over discharge inside the battery. Considering that the…

Systems and Control · Electrical Eng. & Systems 2023-04-18 Jierui Wang , Wentao Yu , Guoyang Cheng , Lin Chen

Stochastically Extended Adversarial (SEA) model is introduced by Sachs et al. [2022] as an interpolation between stochastic and adversarial online convex optimization. Under the smoothness condition, they demonstrate that the expected…

Machine Learning · Computer Science 2024-03-19 Sijia Chen , Yu-Jie Zhang , Wei-Wei Tu , Peng Zhao , Lijun Zhang

We study Online Convex Optimization (OCO) with adversarial constraints, where an online algorithm must make sequential decisions to minimize both convex loss functions and cumulative constraint violations. We focus on a setting where the…

Machine Learning · Statistics 2025-03-14 Jordan Lekeufack , Michael I. Jordan

We study an online linear programming (OLP) problem under a random input model in which the columns of the constraint matrix along with the corresponding coefficients in the objective function are generated i.i.d. from an unknown…

Data Structures and Algorithms · Computer Science 2021-04-20 Xiaocheng Li , Yinyu Ye

We introduce Recurrent All-Pairs Field Transforms (RAFT), a new deep network architecture for optical flow. RAFT extracts per-pixel features, builds multi-scale 4D correlation volumes for all pairs of pixels, and iteratively updates a flow…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Zachary Teed , Jia Deng

We propose an Online Learning with Local Permutations (OLLP) setting, in which the learner is allowed to slightly permute the \emph{order} of the loss functions generated by an adversary. On one hand, this models natural situations where…

Machine Learning · Computer Science 2017-03-14 Ohad Shamir , Liran Szlak

In this paper, we propose and analyze a new method for online linear quadratic regulator (LQR) control with a priori unknown time-varying cost matrices. The cost matrices are revealed sequentially with the potential for future values to be…

Optimization and Control · Mathematics 2023-02-22 Yitian Chen , Timothy L. Molloy , Tyler Summers , Iman Shames

We study finite-time horizon continuous-time linear-quadratic reinforcement learning problems in an episodic setting, where both the state and control coefficients are unknown to the controller. We first propose a least-squares algorithm…

Optimization and Control · Mathematics 2022-06-22 Matteo Basei , Xin Guo , Anran Hu , Yufei Zhang

Online reinforcement learning in infinite-horizon Markov decision processes (MDPs) remains less theoretically and algorithmically developed than its episodic counterpart, with many algorithms suffering from high ``burn-in'' costs and…

Machine Learning · Computer Science 2026-03-26 Guy Zamir , Matthew Zurek , Yudong Chen

The goal of a learner in standard online learning is to maintain an average loss close to the loss of the best-performing single function in some class. In many real-world problems, such as rating or ranking items, there is no single best…

Machine Learning · Computer Science 2013-03-18 Edward Moroshko , Koby Crammer

Function approximation is a powerful approach for structuring large decision problems that has facilitated great achievements in the areas of reinforcement learning and game playing. Regression counterfactual regret minimization (RCFR) is a…

Artificial Intelligence · Computer Science 2020-05-04 Ryan D'Orazio , Dustin Morrill , James R. Wright , Michael Bowling

We present safe control of partially-observed linear time-varying systems in the presence of unknown and unpredictable process and measurement noise. We introduce a control algorithm that minimizes dynamic regret, i.e., that minimizes the…

Systems and Control · Electrical Eng. & Systems 2023-04-03 Hongyu Zhou , Vasileios Tzoumas

We study online reinforcement learning in linear Markov decision processes with adversarial losses and bandit feedback, without prior knowledge on transitions or access to simulators. We introduce two algorithms that achieve improved regret…

Machine Learning · Computer Science 2023-10-19 Haolin Liu , Chen-Yu Wei , Julian Zimmert

We consider the problem of controlling an unknown linear dynamical system under adversarially changing convex costs and full feedback of both the state and cost function. We present the first computationally-efficient algorithm that attains…

Machine Learning · Computer Science 2022-06-06 Asaf Cassel , Alon Cohen , Tomer Koren

Autoregressive exogenous (ARX) systems are the general class of input-output dynamical systems used for modeling stochastic linear dynamical systems (LDS) including partially observable LDS such as LQG systems. In this work, we study the…

Machine Learning · Computer Science 2021-08-30 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

In online convex optimization (OCO), Lipschitz continuity of the functions is commonly assumed in order to obtain sublinear regret. Moreover, many algorithms have only logarithmic regret when these functions are also strongly convex.…

Machine Learning · Computer Science 2021-01-01 Yihan Zhou , Victor S. Portella , Mark Schmidt , Nicholas J. A. Harvey

We study the adversarial kernel bandit problem, in which the loss at each round is induced by an arbitrary bounded element of a reproducing kernel Hilbert space (RKHS). We propose an exponential-weights algorithm built on a regularized…

Machine Learning · Computer Science 2026-05-27 Yu-Jie Zhang , Hao Qiu , Jonathan Scarlett , Kevin Jamieson