English
Related papers

Related papers: Sharper Guarantees for Misspecified Kernelized Ban…

200 papers

On-line linear optimization on combinatorial action sets (d-dimensional actions) with bandit feedback, is known to have complexity in the order of the dimension of the problem. The exponential weighted strategy achieves the best known…

Machine Learning · Computer Science 2015-10-01 Shaona Ghosh , Adam Prugel-Bennett

The recent work by Dong & Yang (2023) showed for misspecified sparse linear bandits, one can obtain an $O\left(\epsilon\right)$-optimal policy using a polynomial number of samples when the sparsity is a constant, where $\epsilon$ is the…

Machine Learning · Computer Science 2024-07-19 Ally Yalei Du , Lin F. Yang , Ruosong Wang

In this paper, we propose an improved online confidence bound for multinomial logistic (MNL) models and apply this result to MNL bandits, achieving variance-dependent optimal regret. Recently, Lee & Oh (2024) established an online…

Machine Learning · Statistics 2025-06-17 Joongkyu Lee , Min-hwan Oh

We study how to make decisions that minimize Bayesian regret in offline linear bandits. Prior work suggests that one must take actions with maximum lower confidence bound (LCB) on their reward. We argue that the reliance on LCB is…

Machine Learning · Computer Science 2024-07-04 Marek Petrik , Guy Tennenholtz , Mohammad Ghavamzadeh

We address the online linear optimization problem with bandit feedback. Our contribution is twofold. First, we provide an algorithm (based on exponential weights) with a regret of order $\sqrt{d n \log N}$ for any finite action set with $N$…

Machine Learning · Computer Science 2012-02-15 Sébastien Bubeck , Nicolò Cesa-Bianchi , Sham M. Kakade

In this work we investigate the relationship between kernel regularity and algorithmic performance in the bandit optimization of RKHS functions. While reproducing kernel Hilbert space (RKHS) methods traditionally rely on global kernel…

Machine Learning · Statistics 2025-12-08 Madison Lee , Tara Javidi

We investigate the online nonsubmodular optimization with delayed feedback in the bandit setting, where the loss function is $\alpha$-weakly DR-submodular and $\beta$-weakly DR-supermodular. Previous work has established an…

Machine Learning · Computer Science 2025-08-04 Sifan Yang , Yuanyu Wan , Lijun Zhang

We present regret minimization algorithms for the contextual multi-armed bandit (CMAB) problem over $K$ actions in the presence of delayed feedback, a scenario where loss observations arrive with delays chosen by an adversary. As a…

Machine Learning · Computer Science 2025-10-13 Orin Levy , Liad Erez , Alon Cohen , Yishay Mansour

Regret bounds in online learning compare the player's performance to $L^*$, the optimal performance in hindsight with a fixed strategy. Typically such bounds scale with the square root of the time horizon $T$. The more refined concept of…

Machine Learning · Computer Science 2018-02-12 Zeyuan Allen-Zhu , Sébastien Bubeck , Yuanzhi Li

We present a generalization of the adversarial linear bandits framework, where the underlying losses are kernel functions (with an associated reproducing kernel Hilbert space) rather than linear functions. We study a version of the…

Machine Learning · Statistics 2018-02-28 Aldo Pacchiano , Niladri S. Chatterji , Peter L. Bartlett

We study the sequential general online regression, known also as the sequential probability assignments, under logarithmic loss when compared against a broad class of experts. We focus on obtaining tight, often matching, lower and upper…

Machine Learning · Computer Science 2023-02-02 Changlong Wu , Mohsen Heidari , Ananth Grama , Wojciech Szpankowski

Contextual bandit with linear reward functions is among one of the most extensively studied models in bandit and online learning research. Recently, there has been increasing interest in designing \emph{locally private} linear contextual…

Machine Learning · Statistics 2024-04-16 Jiachun Li , David Simchi-Levi , Yining Wang

The analysis of online least squares estimation is at the heart of many stochastic sequential decision making problems. We employ tools from the self-normalized processes to provide a simple and self-contained proof of a tail bound of a…

Artificial Intelligence · Computer Science 2011-02-15 Yasin Abbasi-Yadkori , David Pal , Csaba Szepesvari

We study an algorithm-independent, worst-case lower bound for the Gaussian process (GP) bandit problem in the frequentist setting, where the reward function is fixed and has a bounded norm in the known reproducing kernel Hilbert space…

Machine Learning · Computer Science 2026-02-23 Shogo Iwazaki

Consider the sequential optimization of an expensive to evaluate and possibly non-convex objective function $f$ from noisy feedback, that can be considered as a continuum-armed bandit problem. Upper bounds on the regret performance of…

Machine Learning · Statistics 2021-03-11 Sattar Vakili , Kia Khezeli , Victor Picheny

This paper considers the problem of distributed bandit online convex optimization with time-varying coupled inequality constraints. This problem can be defined as a repeated game between a group of learners and an adversary. The learners…

Optimization and Control · Mathematics 2019-12-10 Xinlei Yi , Xiuxian Li , Tao Yang , Lihua Xie , Karl H. Johansson , Tianyou Chai

This paper considers the distributed bandit convex optimization problem with time-varying constraints. In this problem, the global loss function is the average of all the local convex loss functions, which are unknown beforehand. Each agent…

Systems and Control · Electrical Eng. & Systems 2025-04-25 Kunpeng Zhang , Lei Xu , Xinlei Yi , Guanghui Wen , Lihua Xie , Tianyou Chai , Tao Yang

We study the linear contextual bandit problem with finite action sets. When the problem dimension is $d$, the time horizon is $T$, and there are $n \leq 2^{d/2}$ candidate actions per time period, we (1) show that the minimax expected…

Machine Learning · Statistics 2020-08-20 Yingkai Li , Yining Wang , Yuan Zhou

We study how to adapt to smoothly-varying ('easy') environments in well-known online learning problems where acquiring information is expensive. For the problem of label efficient prediction, which is a budgeted version of prediction with…

Machine Learning · Computer Science 2019-12-09 Siddharth Mitra , Aditya Gopalan

Online model selection in Bayesian bandits raises a fundamental exploration challenge: When an environment instance is sampled from a prior distribution, how can we design an adaptive strategy that explores multiple bandit learners and…

Machine Learning · Computer Science 2026-02-23 Aida Afshar , Yuke Zhang , Aldo Pacchiano