English
Related papers

Related papers: Improved High-Probability Regret for Adversarial B…

200 papers

The cross-learning contextual bandit problem with graphical feedback has recently attracted significant attention. In this setting, there is a contextual bandit with a feedback graph over the arms, and pulling an arm reveals the loss for…

Machine Learning · Computer Science 2025-02-10 Ruiyuan Huang , Zengfeng Huang

We study dynamic regret minimization in unconstrained adversarial linear bandit problems. In this setting, a learner must minimize the cumulative loss relative to an arbitrary sequence of comparators…

Machine Learning · Computer Science 2026-03-30 Alberto Rumi , Andrew Jacobsen , Nicolò Cesa-Bianchi , Fabio Vitale

We present an algorithm that achieves almost optimal pseudo-regret bounds against adversarial and stochastic bandits. Against adversarial bandits the pseudo-regret is $O(K\sqrt{n \log n})$ and against stochastic bandits the pseudo-regret is…

Machine Learning · Computer Science 2016-05-30 Peter Auer , Chao-Kai Chiang

We study multi-armed bandit problems with graph feedback, in which the decision maker is allowed to observe the neighboring actions of the chosen action, in a setting where the graph may vary over time and is never fully revealed to the…

Machine Learning · Statistics 2018-05-24 Fang Liu , Zizhan Zheng , Ness Shroff

In this paper, we improve the regret bound for online kernel selection under bandit feedback. Previous algorithm enjoys a $O((\Vert f\Vert^2_{\mathcal{H}_i}+1)K^{\frac{1}{3}}T^{\frac{2}{3}})$ expected bound for Lipschitz loss functions. We…

Machine Learning · Computer Science 2023-03-24 Junfan Li , Shizhong Liao

We study how to adapt to smoothly-varying ('easy') environments in well-known online learning problems where acquiring information is expensive. For the problem of label efficient prediction, which is a budgeted version of prediction with…

Machine Learning · Computer Science 2019-12-09 Siddharth Mitra , Aditya Gopalan

Contextual bandits are widely used in Internet services from news recommendation to advertising, and to Web search. Generalized linear models (logistical regression in particular) have demonstrated stronger performance than linear models in…

Machine Learning · Computer Science 2017-06-20 Lihong Li , Yu Lu , Dengyong Zhou

We provide new lower bounds on the regret that must be suffered by adversarial bandit algorithms. The new results show that recent upper bounds that either (a) hold with high-probability or (b) depend on the total lossof the best arm or (c)…

Statistics Theory · Mathematics 2017-02-28 Sébastien Gerchinovitz , Tor Lattimore

Fast changing states or volatile environments pose a significant challenge to online optimization, which needs to perform rapid adaptation under limited observation. In this paper, we give query and regret optimal bandit algorithms under…

Machine Learning · Computer Science 2024-01-18 Zhou Lu , Qiuyi Zhang , Xinyi Chen , Fred Zhang , David Woodruff , Elad Hazan

We study the $\textit{single-index bandit}$ problem, where rewards depend on an unknown one-dimensional projection of high-dimensional contexts through an unknown reward function. This model extends linear and generalized linear bandits to…

Machine Learning · Statistics 2026-05-12 Devdan Dey , Sujoy Bhore , Avishek Ghosh

We consider a replicable stochastic multi-armed bandit algorithm that ensures, with high probability, that the algorithm's sequence of actions is not affected by the randomness inherent in the dataset. Replicability allows third parties to…

Machine Learning · Statistics 2025-01-14 Junpei Komiyama , Shinji Ito , Yuichi Yoshida , Souta Koshino

We introduce the problem of regret minimization in Adversarial Dueling Bandits. As in classic Dueling Bandits, the learner has to repeatedly choose a pair of items and observe only a relative binary `win-loss' feedback for this pair, but…

Machine Learning · Computer Science 2020-10-29 Aadirupa Saha , Tomer Koren , Yishay Mansour

We study the $K$-armed dueling bandit problem, a variation of the traditional multi-armed bandit problem in which feedback is obtained in the form of pairwise comparisons. Previous learning algorithms have focused on the $\textit{fully…

Machine Learning · Computer Science 2022-09-27 Arpit Agarwal , Rohan Ghuge , Viswanath Nagarajan

We consider the problem of Online Convex Optimization (OCO) with two-point bandit feedback. In this setting, a player attempts to minimize a sequence of adversarially generated convex loss functions, while only observing the value of each…

Machine Learning · Computer Science 2026-04-07 Haishan Ye

We consider the problem of combining and learning over a set of adversarial bandit algorithms with the goal of adaptively tracking the best one on the fly. The CORRAL algorithm of Agarwal et al. (2017) and its variants (Foster et al.,…

Machine Learning · Computer Science 2022-02-15 Haipeng Luo , Mengxiao Zhang , Peng Zhao , Zhi-Hua Zhou

Sequential learning with feedback graphs is a natural extension of the multi-armed bandit problem where the problem is equipped with an underlying graph structure that provides additional information - playing an action reveals the losses…

Machine Learning · Computer Science 2023-06-06 Tomáš Kocák , Alexandra Carpentier

We study high-dimensional multi-armed contextual bandits with batched feedback where the $T$ steps of online interactions are divided into $L$ batches. In specific, each batch collects data according to a policy that depends on previous…

Machine Learning · Statistics 2023-11-27 Jianqing Fan , Zhaoran Wang , Zhuoran Yang , Chenlu Ye

Policy regret is a well established notion of measuring the performance of an online learning algorithm against an adaptive adversary. We study restrictions on the adversary that enable efficient minimization of the \emph{complete policy…

Machine Learning · Statistics 2022-04-26 Dhruv Malik , Yuanzhi Li , Aarti Singh

This paper proposes a new method for the K-armed dueling bandit problem, a variation on the regular K-armed bandit problem that offers only relative feedback about pairs of arms. Our approach extends the Upper Confidence Bound algorithm to…

Machine Learning · Computer Science 2013-12-18 Masrour Zoghi , Shimon Whiteson , Remi Munos , Maarten de Rijke

We study online finite-horizon Markov Decision Processes with adversarially changing loss and aggregate bandit feedback (a.k.a full-bandit). Under this type of feedback, the agent observes only the total loss incurred over the entire…

Machine Learning · Computer Science 2025-02-07 Tal Lancewicki , Yishay Mansour