English
Related papers

Related papers: Linear Thompson Sampling Revisited

200 papers

We study online reinforcement learning in linear Markov decision processes with adversarial losses and bandit feedback, without prior knowledge on transitions or access to simulators. We introduce two algorithms that achieve improved regret…

Machine Learning · Computer Science 2023-10-19 Haolin Liu , Chen-Yu Wei , Julian Zimmert

We address a generalization of the bandit with knapsacks problem, where a learner aims to maximize rewards while satisfying an arbitrary set of long-term constraints. Our goal is to design best-of-both-worlds algorithms that perform…

Machine Learning · Computer Science 2024-05-28 Martino Bernasconi , Matteo Castiglioni , Andrea Celli , Federico Fusco

We revisit the Thompson sampling algorithm to control an unknown linear quadratic (LQ) system recently proposed by Ouyang et al (arXiv:1709.04047). The regret bound of the algorithm was derived under a technical assumption on the induced…

Systems and Control · Electrical Eng. & Systems 2022-09-21 Mukul Gagrani , Sagar Sudhakara , Aditya Mahajan , Ashutosh Nayyar , Yi Ouyang

We consider the classical stochastic multi-armed bandit but where, from time to time and roughly with frequency $\epsilon$, an extra observation is gathered by the agent for free. We prove that, no matter how small $\epsilon$ is the agent…

Machine Learning · Computer Science 2018-07-11 Rémy Degenne , Evrard Garcelon , Vianney Perchet

We consider a budget-constrained bandit problem where each arm pull incurs a random cost, and yields a random reward in return. The objective is to maximize the total expected reward under a budget constraint on the total cost. The model is…

Machine Learning · Computer Science 2020-03-03 Semih Cayci , Atilla Eryilmaz , R. Srikant

Policy regret is a well established notion of measuring the performance of an online learning algorithm against an adaptive adversary. We study restrictions on the adversary that enable efficient minimization of the \emph{complete policy…

Machine Learning · Statistics 2022-04-26 Dhruv Malik , Yuanzhi Li , Aarti Singh

This work tackles the complexities of multi-player scenarios in \emph{unknown games}, where the primary challenge lies in navigating the uncertainty of the environment through bandit feedback alongside strategic decision-making. We…

Machine Learning · Computer Science 2024-02-27 Yingru Li , Liangqi Liu , Wenqiang Pu , Hao Liang , Zhi-Quan Luo

In this paper, we prove the first Bayesian regret bounds for Thompson Sampling in reinforcement learning in a multitude of settings. We simplify the learning problem using a discrete set of surrogate environments, and present a refined…

Machine Learning · Statistics 2024-02-08 Ahmadreza Moradipari , Mohammad Pedramfar , Modjtaba Shokrian Zini , Vaneet Aggarwal

Optimal regret bounds for Multi-Armed Bandit problems are now well documented. They can be classified into two categories based on the growth rate with respect to the time horizon $T$: (i) small, distribution-dependent, bounds of order of…

Data Structures and Algorithms · Computer Science 2017-04-12 Arthur Flajolet , Patrick Jaillet

We study the setting of optimizing with bandit feedback with additional prior knowledge provided to the learner in the form of an initial hint of the optimal action. We present a novel algorithm for stochastic linear bandits that uses this…

Machine Learning · Computer Science 2022-03-09 Ashok Cutkosky , Chris Dann , Abhimanyu Das , Qiuyi , Zhang

Thompson sampling has been shown to be an effective policy across a variety of online learning tasks. Many works have analyzed the finite time performance of Thompson sampling, and proved that it achieves a sub-linear regret under a broad…

Machine Learning · Computer Science 2020-11-10 Cem Kalkanli , Ayfer Ozgur

We consider the stochastic linear contextual bandit problem with high-dimensional features. We analyze the Thompson sampling algorithm using special classes of sparsity-inducing priors (e.g., spike-and-slab) to model the unknown parameter…

Machine Learning · Statistics 2023-01-31 Sunrit Chakraborty , Saptarshi Roy , Ambuj Tewari

We consider the problem of statistical inference when the data is collected via a Thompson Sampling-type algorithm. While Thompson Sampling (TS) is known to be both asymptotically optimal and empirically effective, its adaptive sampling…

Machine Learning · Statistics 2026-03-17 Budhaditya Halder , Shubhayan Pan , Koulik Khamaru

We consider the problem of combining and learning over a set of adversarial bandit algorithms with the goal of adaptively tracking the best one on the fly. The CORRAL algorithm of Agarwal et al. (2017) and its variants (Foster et al.,…

Machine Learning · Computer Science 2022-02-15 Haipeng Luo , Mengxiao Zhang , Peng Zhao , Zhi-Hua Zhou

We study a bandit version of phase retrieval where the learner chooses actions $(A_t)_{t=1}^n$ in the $d$-dimensional unit ball and the expected reward is $\langle A_t, \theta_\star\rangle^2$ where $\theta_\star \in \mathbb R^d$ is an…

Machine Learning · Statistics 2021-06-07 Tor Lattimore , Botao Hao

This paper studies the one-shot behavior of no-regret algorithms for stochastic bandits. Although many algorithms are known to be asymptotically optimal with respect to the expected regret, over a single run, their pseudo-regret seems to…

Machine Learning · Computer Science 2023-12-01 Victor Boone

In this paper, we consider the problem of sleeping bandits with stochastic action sets and adversarial rewards. In this setting, in contrast to most work in bandits, the actions may not be available at all times. For instance, some products…

Machine Learning · Computer Science 2020-08-11 Aadirupa Saha , Pierre Gaillard , Michal Valko

We present improved algorithms with worst-case regret guarantees for the stochastic linear bandit problem. The widely used "optimism in the face of uncertainty" principle reduces a stochastic bandit problem to the construction of a…

Machine Learning · Statistics 2024-09-06 Hamish Flynn , David Reeb , Melih Kandemir , Jan Peters

We prove an instance independent (poly) logarithmic regret for stochastic contextual bandits with linear payoff. Previously, in \cite{chu2011contextual}, a lower bound of $\mathcal{O}(\sqrt{T})$ is shown for the contextual linear bandit…

Machine Learning · Statistics 2022-05-23 Avishek Ghosh , Abishek Sankararaman

We consider the thresholding bandit problem, whose goal is to find arms of mean rewards above a given threshold $\theta$, with a fixed budget of $T$ trials. We introduce LSA, a new, simple and anytime algorithm that aims to minimize the…

Machine Learning · Computer Science 2019-05-28 Chao Tao , Saùl Blanco , Jian Peng , Yuan Zhou