English
Related papers

Related papers: Efficient Algorithms for k-Regret Minimizing Sets

200 papers

We present the OMG-CMDP! algorithm for regret minimization in adversarial Contextual MDPs. The algorithm operates under the minimal assumptions of realizable function class and access to online least squares and log loss regression oracles.…

Machine Learning · Computer Science 2023-08-15 Orin Levy , Alon Cohen , Asaf Cassel , Yishay Mansour

We study the problem of regret minimization in partially observable linear quadratic control systems when the model dynamics are unknown a priori. We propose ExpCommit, an explore-then-commit algorithm that learns the model Markov…

Machine Learning · Computer Science 2020-03-10 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

This paper studies batched bandit learning problems for nondegenerate functions. We introduce an algorithm that solves the batched bandit problem for nondegenerate functions near-optimally. More specifically, we introduce an algorithm,…

Machine Learning · Statistics 2025-04-09 Yu Liu , Yunlu Shu , Tianyu Wang

We study the Stochastic Shortest Path (SSP) problem with a linear mixture transition kernel, where an agent repeatedly interacts with a stochastic environment and seeks to reach certain goal state while minimizing the cumulative cost.…

Machine Learning · Computer Science 2024-02-15 Qiwei Di , Jiafan He , Dongruo Zhou , Quanquan Gu

A recent goal in the Reinforcement Learning (RL) framework is to choose a sequence of actions or a policy to maximize the reward collected or minimize the regret incurred in a finite time horizon. For several RL problems in operation…

Machine Learning · Computer Science 2016-08-18 K J Prabuchandran , Tejas Bodas , Theja Tulabandhula

We improve the theoretical and empirical performance of neural-network(NN)-based active learning algorithms for the non-parametric streaming setting. In particular, we introduce two regret metrics by minimizing the population loss that are…

Machine Learning · Computer Science 2023-01-18 Yikun Ban , Yuheng Zhang , Hanghang Tong , Arindam Banerjee , Jingrui He

We consider the setting of iterative learning control, or model-based policy learning in the presence of uncertain, time-varying dynamics. In this setting, we propose a new performance metric, planning regret, which replaces the standard…

Machine Learning · Computer Science 2021-03-01 Naman Agarwal , Elad Hazan , Anirudha Majumdar , Karan Singh

We consider the problem of sequentially maximizing an unknown function $f$ over a set of actions of the form $(s,\mathbf{x})$, where the selected actions must satisfy a safety constraint with respect to an unknown safety function $g$. We…

Machine Learning · Statistics 2024-06-06 Arpan Losalka , Jonathan Scarlett

This paper addresses the Bayesian optimization problem (also referred to as the Bayesian setting of the Gaussian process bandit), where the learner seeks to minimize the regret under a function drawn from a known Gaussian process (GP).…

Machine Learning · Computer Science 2025-12-12 Shogo Iwazaki

We examine the problem of regret minimization when the learner is involved in a continuous game with other optimizing agents: in this case, if all players follow a no-regret algorithm, it is possible to achieve significantly lower regret…

Computer Science and Game Theory · Computer Science 2023-03-20 Yu-Guan Hsieh , Kimon Antonakopoulos , Volkan Cevher , Panayotis Mertikopoulos

Kalman and H-infinity filters, the most popular paradigms for linear state estimation, are designed for very specific specific noise and disturbance patterns, which may not appear in practice. State observers based on the minimization of…

Systems and Control · Electrical Eng. & Systems 2022-12-09 Jean-Sébastien Brouillon , Florian Dörfler , Giancarlo Ferrari-Trecate

We study high-probability regret bounds for adversarial $K$-armed bandits with time-varying feedback graphs over $T$ rounds. For general strongly observable graphs, we develop an algorithm that achieves the optimal regret…

Machine Learning · Computer Science 2023-01-31 Haipeng Luo , Hanghang Tong , Mengxiao Zhang , Yuheng Zhang

The specification of aMarkov decision process (MDP) can be difficult. Reward function specification is especially problematic; in practice, it is often cognitively complex and time-consuming for users to precisely specify rewards. This work…

Artificial Intelligence · Computer Science 2012-05-14 Kevin Regan , Craig Boutilier

In this short note we consider a dynamic assortment planning problem under the capacitated multinomial logit (MNL) bandit model. We prove a tight lower bound on the accumulated regret that matches existing regret upper bounds for all…

Machine Learning · Statistics 2018-10-01 Xi Chen , Yining Wang

In this work, we propose a computationally efficient algorithm for the problem of global optimization in univariate loss functions. For the performance evaluation, we study the cumulative regret of the algorithm instead of the simple regret…

Machine Learning · Computer Science 2022-01-19 Kaan Gokcesu , Hakan Gokcesu

The need for fast and robust optimization algorithms are of critical importance in all areas of machine learning. This paper treats the task of designing optimization algorithms as an optimal control problem. Using regret as a metric for an…

Machine Learning · Computer Science 2021-01-21 Philippe Casgrain , Anastasis Kratsios

We consider the problem of selecting a subset of points from a dataset of $n$ unlabeled examples for labeling, with the goal of training a multiclass classifier. To address this, we build upon the regret minimization framework introduced by…

Machine Learning · Computer Science 2026-02-27 Youguang Chen , George Biros

We introduce the problem of $k$-chasing of convex functions, a simultaneous generalization of both the famous k-server problem in $R^d$, and of the problem of chasing convex bodies and functions. Aside from fundamental interest in this…

Data Structures and Algorithms · Computer Science 2020-04-17 Sébastien Bubeck , Yuval Rabani , Mark Sellke

This work considered an online distributed optimization problem, with a group of agents whose local objective functions vary with time. Moreover, the value of the objective function is revealed to the corresponding agent after the decision…

Optimization and Control · Mathematics 2021-08-16 Yipeng Pang , Guoqiang Hu

In reinforcement learning, experience replay stores past samples for further reuse. Prioritized sampling is a promising technique to better utilize these samples. Previous criteria of prioritization include TD error, recentness and…

Machine Learning · Computer Science 2021-11-10 Xu-Hui Liu , Zhenghai Xue , Jing-Cheng Pang , Shengyi Jiang , Feng Xu , Yang Yu