English
Related papers

Related papers: Almost Optimal Algorithms for Linear Stochastic Ba…

200 papers

We present improved algorithms with worst-case regret guarantees for the stochastic linear bandit problem. The widely used "optimism in the face of uncertainty" principle reduces a stochastic bandit problem to the construction of a…

Machine Learning · Statistics 2024-09-06 Hamish Flynn , David Reeb , Melih Kandemir , Jan Peters

We study the stochastic multi-armed bandit problem and design new policies that enjoy both worst-case optimality for expected regret and light-tailed risk for regret distribution. Specifically, our policy design (i) enjoys the worst-case…

Machine Learning · Statistics 2024-07-23 David Simchi-Levi , Zeyu Zheng , Feng Zhu

This paper considers stochastic linear bandits with general nonlinear constraints. The objective is to maximize the expected cumulative reward over horizon $T$ subject to a set of constraints in each round $\tau\leq T$. We propose a…

Machine Learning · Computer Science 2021-11-11 Xin Liu , Bin Li , Pengyi Shi , Lei Ying

We study the linear contextual bandit problem with finite action sets. When the problem dimension is $d$, the time horizon is $T$, and there are $n \leq 2^{d/2}$ candidate actions per time period, we (1) show that the minimax expected…

Machine Learning · Statistics 2020-08-20 Yingkai Li , Yining Wang , Yuan Zhou

We study linear contextual bandits under adversarial corruption and heavy-tailed noise with finite $(1+\epsilon)$-th moments for some $\epsilon \in (0,1]$. Existing work that addresses both adversarial corruption and heavy-tailed noise…

Machine Learning · Computer Science 2026-03-17 Naoto Tani , Futoshi Futami

The stochastic multi-armed bandit setting has been recently studied in the non-stationary regime, where the mean payoff of each action is a non-decreasing function of the number of rounds passed since it was last played. This model captures…

Machine Learning · Computer Science 2022-10-13 Orestis Papadigenopoulos , Constantine Caramanis , Sanjay Shakkottai

We investigate the \emph{linear contextual bandit problem} with independent and identically distributed (i.i.d.) contexts. In this problem, we aim to develop a \emph{Best-of-Both-Worlds} (BoBW) algorithm with regret upper bounds in both…

Machine Learning · Computer Science 2025-05-29 Masahiro Kato , Shinji Ito

In this paper we propose a novel experimental design-based algorithm to minimize regret in online stochastic linear and combinatorial bandits. While existing literature tends to focus on optimism-based algorithms--which have been shown to…

Machine Learning · Computer Science 2021-03-02 Andrew Wagenmaker , Julian Katz-Samuels , Kevin Jamieson

In this paper, we consider stochastic multi-armed bandits (MABs) with heavy-tailed rewards, whose $p$-th moment is bounded by a constant $\nu_{p}$ for $1<p\leq2$. First, we propose a novel robust estimator which does not require $\nu_{p}$…

Machine Learning · Computer Science 2021-10-28 Kyungjae Lee , Hongjun Yang , Sungbin Lim , Songhwai Oh

We consider combinatorial semi-bandits over a set of arms ${\cal X} \subset \{0,1\}^d$ where rewards are uncorrelated across items. For this problem, the algorithm ESCB yields the smallest known regret bound $R(T) = {\cal O}\Big( {d (\ln…

Machine Learning · Statistics 2021-01-14 Thibaut Cuvelier , Richard Combes , Eric Gourdin

We present an efficient algorithm for linear contextual bandits with adversarial losses and stochastic action sets. Our approach reduces this setting to misspecification-robust adversarial linear bandits with fixed action sets. Without…

Machine Learning · Computer Science 2025-12-16 Tim van Erven , Jack Mayo , Julia Olkhovskaya , Chen-Yu Wei

In this paper, we investigate the streaming bandits problem, wherein the learner aims to minimize regret by dealing with online arriving arms and sublinear arm memory. We establish the tight worst-case regret lower bound of $\Omega \left(…

Machine Learning · Computer Science 2023-06-14 Shaoang Li , Lan Zhang , Junhao Wang , Xiang-Yang Li

This paper proposes a linear bandit algorithm that is adaptive to environments at two different levels of hierarchy. At the higher level, the proposed algorithm adapts to a variety of types of environments. More precisely, it achieves…

Machine Learning · Computer Science 2023-02-27 Shinji Ito , Kei Takemura

We study the optimal batch-regret tradeoff for batch linear contextual bandits. For any batch number $M$, number of actions $K$, time horizon $T$, and dimension $d$, we provide an algorithm and prove its regret guarantee, which, due to…

Machine Learning · Computer Science 2022-10-18 Zihan Zhang , Xiangyang Ji , Yuan Zhou

In this paper, we study multi-armed bandits (MAB) and stochastic linear bandits (SLB) with heavy-tailed rewards and quantum reward oracle. Unlike the previous work on quantum bandits that assumes bounded/sub-Gaussian distributions for…

Machine Learning · Computer Science 2023-01-25 Yulian Wu , Chaowen Guan , Vaneet Aggarwal , Di Wang

We study a constrained contextual linear bandit setting, where the goal of the agent is to produce a sequence of policies, whose expected cumulative reward over the course of $T$ rounds is maximum, and each has an expected cost below a…

Machine Learning · Computer Science 2020-06-20 Aldo Pacchiano , Mohammad Ghavamzadeh , Peter Bartlett , Heinrich Jiang

We study the problem of online generalized linear regression in the stochastic setting, where the label is generated from a generalized linear model with possibly unbounded additive noise. We provide a sharp analysis of the classical…

Machine Learning · Computer Science 2023-03-28 Heyang Zhao , Dongruo Zhou , Jiafan He , Quanquan Gu

This work studies linear bandits under a new notion of gap-adjusted misspecification and is an extension of Liu et al. (2023). When the underlying reward function is not linear, existing linear bandits work usually relies on a uniform…

Machine Learning · Computer Science 2025-01-10 Chong Liu , Dan Qiao , Ming Yin , Ilija Bogunovic , Yu-Xiang Wang

We study a class of adversarial bandit optimization problems in which the loss functions may be non-convex and non-smooth. In each round, the learner observes a loss that consists of an underlying linear component together with an…

Machine Learning · Computer Science 2026-03-30 Zhuoyu Cheng , Kohei Hatano , Eiji Takimoto

Recently, several studies (Zhou et al., 2021a; Zhang et al., 2021b; Kim et al., 2021; Zhou and Gu, 2022) have provided variance-dependent regret bounds for linear contextual bandits, which interpolates the regret for the worst-case regime…

Machine Learning · Computer Science 2023-02-22 Heyang Zhao , Jiafan He , Dongruo Zhou , Tong Zhang , Quanquan Gu