English
Related papers

Related papers: Logarithmic Regret for Online KL-Regularized Reinf…

200 papers

In online inverse linear optimization, a learner observes time-varying sets of feasible actions and an agent's optimal actions, selected by solving linear optimization over the feasible actions. The learner sequentially makes predictions of…

Machine Learning · Computer Science 2025-05-23 Shinsaku Sakaue , Taira Tsuchiya , Han Bao , Taihei Oki

We consider a contextual bandit problem with $S$ contexts and $K$ actions. In each round $t=1,2,\dots$, the learner observes a random context and chooses an action based on its past experience. The learner then observes a random reward…

Machine Learning · Computer Science 2023-11-29 Chung-Wei Lee , Qinghua Liu , Yasin Abbasi-Yadkori , Chi Jin , Tor Lattimore , Csaba Szepesvári

We develop the first general semi-bandit algorithm that simultaneously achieves $\mathcal{O}(\log T)$ regret for stochastic environments and $\mathcal{O}(\sqrt{T})$ regret for adversarial environments without knowledge of the regime or the…

Machine Learning · Computer Science 2019-09-27 Julian Zimmert , Haipeng Luo , Chen-Yu Wei

We tackle the problem of online reward maximisation over a large finite set of actions described by their contexts. We focus on the case when the number of actions is too big to sample all of them even once. However we assume that we have…

Machine Learning · Computer Science 2013-09-27 Michal Valko , Nathaniel Korda , Remi Munos , Ilias Flaounas , Nelo Cristianini

In this paper, we consider the problem of black-box optimization with noisy feedback revealed in batches, where the unknown function to optimize has a bounded norm in some Reproducing Kernel Hilbert Space (RKHS). We refer to this as the…

Machine Learning · Statistics 2026-03-16 Chenkai Ma , Keqin Chen , Jonathan Scarlett

We consider the contextual bandit problem where at each time, the agent only has access to a noisy version of the context and the error variance (or an estimator of this variance). This setting is motivated by a wide range of applications…

Machine Learning · Statistics 2024-03-19 Yongyi Guo , Ziping Xu , Susan Murphy

Optimal regret bounds for Multi-Armed Bandit problems are now well documented. They can be classified into two categories based on the growth rate with respect to the time horizon $T$: (i) small, distribution-dependent, bounds of order of…

Data Structures and Algorithms · Computer Science 2017-04-12 Arthur Flajolet , Patrick Jaillet

This paper addresses the poor finite-horizon performance of existing online \emph{restless bandit} (RB) algorithms, which stems from the prohibitive sample complexity of learning a full \emph{Markov decision process} (MDP) for each agent.…

Machine Learning · Computer Science 2026-04-07 Jiamin Xu , Ivan Nazarov , Aditya Rastogi , África Periáñez , Kyra Gan

We study a nonparametric contextual bandit problem where the expected reward functions belong to a H\"older class with smoothness parameter $\beta$. We show how this interpolates between two extremes that were previously studied in…

Machine Learning · Statistics 2020-09-14 Yichun Hu , Nathan Kallus , Xiaojie Mao

Dueling bandits is a prominent framework for decision-making involving preferential feedback, a valuable feature that fits various applications involving human interaction, such as ranking, information retrieval, and recommendation systems.…

Machine Learning · Computer Science 2024-10-16 Qiwei Di , Tao Jin , Yue Wu , Heyang Zhao , Farzad Farnoud , Quanquan Gu

In this paper we consider the problem of online stochastic optimization of a locally smooth function under bandit feedback. We introduce the high-confidence tree (HCT) algorithm, a novel any-time $\mathcal{X}$-armed bandit algorithm, and…

Machine Learning · Statistics 2014-05-20 Mohammad Gheshlaghi Azar , Alessandro Lazaric , Emma Brunskill

Due to the drastic gap in complexity between sequential and batch statistical learning, recent work has studied a smoothed sequential learning setting, where Nature is constrained to select contexts with density bounded by 1/{\sigma} with…

Machine Learning · Statistics 2022-05-27 Adam Block , Max Simchowitz

We study the problem of $K$-armed dueling bandit for both stochastic and adversarial environments, where the goal of the learner is to aggregate information through relative preferences of pair of decisions points queried in an online…

Machine Learning · Computer Science 2022-02-15 Aadirupa Saha , Pierre Gaillard

We consider the classic online learning and stochastic multi-armed bandit (MAB) problems, when at each step, the online policy can probe and find out which of a small number ($k$) of choices has better reward (or loss) before making its…

Data Structures and Algorithms · Computer Science 2022-11-08 Aditya Bhaskara , Sreenivas Gollapudi , Sungjin Im , Kostas Kollias , Kamesh Munagala

Combinatorial multi-armed bandits provide a fundamental online decision-making environment where a decision-maker interacts with an environment across $T$ time steps, each time selecting an action and learning the cost of that action. The…

Machine Learning · Computer Science 2026-04-13 Gerdus Benadè , Rathish Das , Thomas Lavastida

Contextual bandits have emerged as a cornerstone in reinforcement learning, enabling systems to make decisions with partial feedback. However, as contexts grow in complexity, traditional bandit algorithms can face challenges in adequately…

Machine Learning · Computer Science 2023-11-07 Ali Baheri , Cecilia O. Alm

We study the linear contextual bandit problem with finite action sets. When the problem dimension is $d$, the time horizon is $T$, and there are $n \leq 2^{d/2}$ candidate actions per time period, we (1) show that the minimax expected…

Machine Learning · Statistics 2020-08-20 Yingkai Li , Yining Wang , Yuan Zhou

We consider the problem of contextual bandits and imitation learning, where the learner lacks direct knowledge of the executed action's reward. Instead, the learner can actively query an expert at each round to compare two actions and…

Machine Learning · Computer Science 2023-07-25 Ayush Sekhari , Karthik Sridharan , Wen Sun , Runzhe Wu

Recently a multi-agent variant of the classical multi-armed bandit was proposed to tackle fairness issues in online learning. Inspired by a long line of work in social choice and economics, the goal is to optimize the Nash social welfare…

Machine Learning · Computer Science 2022-09-27 Matthew Jones , Huy Lê Nguyen , Thy Nguyen

In several applications of the stochastic multi-armed bandit problem, the traditional objective of maximizing the expected total reward can be inappropriate. In this paper, motivated by certain operational concerns in online platforms, we…

Machine Learning · Computer Science 2024-10-16 Eren Ozbay , Vijay Kamble