English
Related papers

Related papers: Bayesian Regret Minimization in Offline Bandits

200 papers

We revisit the study of optimal regret rates in bandit combinatorial optimization---a fundamental framework for sequential decision making under uncertainty that abstracts numerous combinatorial prediction problems. We prove that the…

Machine Learning · Computer Science 2017-02-27 Alon Cohen , Tamir Hazan , Tomer Koren

We address a generalization of the bandit with knapsacks problem, where a learner aims to maximize rewards while satisfying an arbitrary set of long-term constraints. Our goal is to design best-of-both-worlds algorithms that perform…

Machine Learning · Computer Science 2024-05-28 Martino Bernasconi , Matteo Castiglioni , Andrea Celli , Federico Fusco

We study the impact of sharing exploration in multi-armed bandits in a grouped setting where a set of groups have overlapping feasible action sets [Baek and Farias '24]. In this grouped bandit setting, groups share reward observations, and…

Machine Learning · Computer Science 2025-06-13 Moïse Blanchard , Vineet Goyal

We consider the problem of online learning in misspecified linear stochastic multi-armed bandit problems. Regret guarantees for state-of-the-art linear bandit algorithms such as Optimism in the Face of Uncertainty Linear bandit (OFUL) hold…

Machine Learning · Computer Science 2017-04-25 Avishek Ghosh , Sayak Ray Chowdhury , Aditya Gopalan

Building on the framework introduced by Xu and Raginksy [1] for supervised learning problems, we study the best achievable performance for model-based Bayesian reinforcement learning problems. With this purpose, we define minimum Bayesian…

Machine Learning · Computer Science 2022-07-19 Amaury Gouverneur , Borja Rodríguez-Gálvez , Tobias J. Oechtering , Mikael Skoglund

Much of the literature on optimal design of bandit algorithms is based on minimization of expected regret. It is well known that designs that are optimal over certain exponential families can achieve expected regret that grows…

Machine Learning · Computer Science 2024-11-14 Lin Fan , Peter W. Glynn

We introduce a novel online learning framework that unifies and generalizes pre-established models, such as delayed and corrupted feedback, to encompass adversarial environments where action feedback evolves over time. In this setting, the…

Machine Learning · Computer Science 2024-05-28 Yogev Bar-On , Yishay Mansour

There are two variants of the classical multi-armed bandit (MAB) problem that have received considerable attention from machine learning researchers in recent years: contextual bandits and simple regret minimization. Contextual bandits are…

Machine Learning · Statistics 2020-02-27 Aniket Anand Deshmukh , Srinagesh Sharma , James W. Cutler , Mark Moldwin , Clayton Scott

We study the $K$-armed contextual dueling bandit problem, a sequential decision making setting in which the learner uses contextual information to make two decisions, but only observes \emph{preference-based feedback} suggesting that one…

Machine Learning · Computer Science 2021-11-25 Aadirupa Saha , Akshay Krishnamurthy

While classical formulations of multi-armed bandit problems assume that each arm's reward is independent and stationary, real-world applications often involve non-stationary environments and interdependencies between arms. In particular,…

Machine Learning · Computer Science 2025-06-19 Ryoma Sato , Shinji Ito

We consider Bayesian optimization using Gaussian Process models, also referred to as kernel-based bandit optimization. We study the methodology of exploring the domain using random samples drawn from a distribution. We show that this random…

Machine Learning · Computer Science 2024-02-05 Sudeep Salgia , Sattar Vakili , Qing Zhao

Multi-armed bandit models have proven to be useful in modeling many real world problems in the areas of control and sequential decision making with partial information. However, in many scenarios, such as those prevalent in healthcare and…

Optimization and Control · Mathematics 2024-08-27 Qinyang He , Yonatan Mintz

Several optimism-based stochastic bandit algorithms -- including UCB, UCB-V, linear UCB, and finite-arm GP-UCB -- achieve logarithmic regret using proofs that, despite superficial differences, follow essentially the same structure. This…

Machine Learning · Computer Science 2025-12-23 Vikram Krishnamurthy

We study online reinforcement learning in linear Markov decision processes with adversarial losses and bandit feedback, without prior knowledge on transitions or access to simulators. We introduce two algorithms that achieve improved regret…

Machine Learning · Computer Science 2023-10-19 Haolin Liu , Chen-Yu Wei , Julian Zimmert

We study finite-armed semiparametric bandits, where each arm's reward combines a linear component with an unknown, potentially adversarial shift. This model strictly generalizes classical linear bandits and reflects complexities common in…

Machine Learning · Statistics 2025-06-18 Seok-Jin Kim , Gi-Soo Kim , Min-hwan Oh

We study the contextual continuum bandits problem, where the learner sequentially receives a side information vector and has to choose an action in a convex set, minimizing a function associated with the context. The goal is to minimize all…

Machine Learning · Statistics 2025-10-28 Arya Akhavan , Karim Lounici , Massimiliano Pontil , Alexandre B. Tsybakov

We study contextual linear bandit problems under feature uncertainty, where the features are noisy and have missing entries. To address the challenges posed by this noise, we analyze Bayesian oracles given the observed noisy features. Our…

Artificial Intelligence · Computer Science 2024-10-11 Jung-hun Kim , Se-Young Yun , Minchan Jeong , Jun Hyun Nam , Jinwoo Shin , Richard Combes

By leveraging the representation power of deep neural networks, neural upper confidence bound (UCB) algorithms have shown success in contextual bandits. To further balance the exploration and exploitation, we propose…

Machine Learning · Computer Science 2025-03-12 Ha Manh Bui , Enrique Mallada , Anqi Liu

We develop a meta-learning framework for simple regret minimization in bandits. In this framework, a learning agent interacts with a sequence of bandit tasks, which are sampled i.i.d.\ from an unknown prior distribution, and learns its…

Machine Learning · Computer Science 2023-07-06 Mohammadjavad Azizi , Branislav Kveton , Mohammad Ghavamzadeh , Sumeet Katariya

We analyze and evaluate an online gradient descent algorithm with adaptive per-coordinate adjustment of learning rates. Our algorithm can be thought of as an online version of batch gradient descent with a diagonal preconditioner. This…

Machine Learning · Computer Science 2010-02-26 Matthew Streeter , H. Brendan McMahan