English
Related papers

Related papers: Learning with Good Feature Representations in Band…

200 papers

Contextual bandits are widely used in Internet services from news recommendation to advertising, and to Web search. Generalized linear models (logistical regression in particular) have demonstrated stronger performance than linear models in…

Machine Learning · Computer Science 2017-06-20 Lihong Li , Yu Lu , Dengyong Zhou

Model selection in contextual bandits is an important complementary problem to regret minimization with respect to a fixed model class. We consider the simplest non-trivial instance of model-selection: distinguishing a simple multi-armed…

Machine Learning · Computer Science 2022-07-01 Vidya Muthukumar , Akshay Krishnamurthy

We study the problem of transfer-learning in the setting of stochastic linear bandit tasks. We consider that a low dimensional linear representation is shared across the tasks, and study the benefit of learning this representation in the…

Machine Learning · Statistics 2023-08-16 Leonardo Cella , Karim Lounici , Grégoire Pacreau , Massimiliano Pontil

Value function approximation has demonstrated phenomenal empirical success in reinforcement learning (RL). Nevertheless, despite a handful of recent progress on developing theory for RL with linear function approximation, the understanding…

Machine Learning · Computer Science 2020-06-22 Ruosong Wang , Ruslan Salakhutdinov , Lin F. Yang

The linear contextual bandit literature is mostly focused on the design of efficient learning algorithms for a given representation. However, a contextual bandit problem may admit multiple linear representations, each one with different…

Machine Learning · Computer Science 2021-04-09 Matteo Papini , Andrea Tirinzoni , Marcello Restelli , Alessandro Lazaric , Matteo Pirotta

We show that learning algorithms satisfying a $\textit{low approximate regret}$ property experience fast convergence to approximate optimality in a large class of repeated games. Our property, which simply requires that each learner has…

Computer Science and Game Theory · Computer Science 2016-12-19 Dylan J. Foster , Zhiyuan Li , Thodoris Lykouris , Karthik Sridharan , Eva Tardos

Policy regret is a well established notion of measuring the performance of an online learning algorithm against an adaptive adversary. We study restrictions on the adversary that enable efficient minimization of the \emph{complete policy…

Machine Learning · Statistics 2022-04-26 Dhruv Malik , Yuanzhi Li , Aarti Singh

Specifying reward functions for complex tasks like object manipulation or driving is challenging to do by hand. Reward learning seeks to address this by learning a reward model using human feedback on selected query policies. This shifts…

Machine Learning · Computer Science 2023-02-27 Kush Bhatia , Wenshuo Guo , Jacob Steinhardt

We consider the problem of fitting a reinforcement learning (RL) model to some given behavioral data under a multi-armed bandit environment. These models have received much attention in recent years for characterizing human and animal…

Computational Engineering, Finance, and Science · Computer Science 2026-03-27 Hao Zhu , Jasper Hoffmann , Baohe Zhang , Joschka Boedecker

Nonstationary phenomena, such as satiation effects in recommendations, have mostly been modeled using bandits with finitely many arms. However, the richer action space provided by linear bandits is often preferred in practice. In this work,…

Machine Learning · Computer Science 2023-05-26 Giulia Clerici , Pierre Laforgue , Nicolò Cesa-Bianchi

The curse of dimensionality is a widely known issue in reinforcement learning (RL). In the tabular setting where the state space $\mathcal{S}$ and the action space $\mathcal{A}$ are both finite, to obtain a nearly optimal policy with…

Machine Learning · Computer Science 2022-10-28 Bingyan Wang , Yuling Yan , Jianqing Fan

High-dimensional linear bandits with low-dimensional structure have received considerable attention in recent studies due to their practical significance. The most common structure in the literature is sparsity. However, it may not be…

Machine Learning · Statistics 2026-01-01 Nam Phuong Tran , The Anh Ta , Debmalya Mandal , Long Tran-Thanh

We study a continuous-time diffusion approximation of policy gradient for $k$-armed stochastic bandits. We prove that with a learning rate $\eta = O(\Delta^2/\log(n))$ the regret is $O(k \log(k) \log(n) / \eta)$ where $n$ is the horizon and…

Machine Learning · Statistics 2026-03-12 Tor Lattimore

We propose stochastic rank-$1$ bandits, a class of online learning problems where at each step a learning agent chooses a pair of row and column arms, and receives the product of their values as a reward. The main challenge of the problem…

Machine Learning · Computer Science 2017-03-09 Sumeet Katariya , Branislav Kveton , Csaba Szepesvari , Claire Vernade , Zheng Wen

A stochastic combinatorial semi-bandit is an online learning problem where at each step a learning agent chooses a subset of ground items subject to constraints, and then observes stochastic weights of these items and receives their sum as…

Machine Learning · Computer Science 2017-06-08 Branislav Kveton , Zheng Wen , Azin Ashkan , Csaba Szepesvari

Bandit and reinforcement learning (RL) problems can often be framed as optimization problems where the goal is to maximize average performance while having access only to stochastic estimates of the true gradient. Traditionally, stochastic…

Machine Learning · Computer Science 2021-02-22 Wesley Chung , Valentin Thomas , Marlos C. Machado , Nicolas Le Roux

We study the problem of learning to generate an answer (or completion) to a question (or prompt), where there could be multiple correct answers, any one of which is acceptable at test time. Learning is based on demonstrations of some…

Machine Learning · Computer Science 2026-02-27 Nirmit Joshi , Gene Li , Siddharth Bhandari , Shiva Prasad Kasiviswanathan , Cong Ma , Nathan Srebro

Linear bandits have long been a central topic in online learning, with applications ranging from recommendation systems to adaptive clinical trials. Their general learnability has been established when the objective is to minimise the inner…

Machine Learning · Statistics 2026-02-18 Lorenzo Croissant

In sparse linear bandits, a learning agent sequentially selects an action and receive reward feedback, and the reward function depends linearly on a few coordinates of the covariates of the actions. This has applications in many real-world…

Machine Learning · Statistics 2023-11-21 Kyoungseok Jang , Chicheng Zhang , Kwang-Sung Jun

We study stochastic linear bandits where, in each round, the learner receives a set of actions (i.e., feature vectors), from which it chooses an element and obtains a stochastic reward. The expected reward is a fixed but unknown linear…

Machine Learning · Computer Science 2024-06-04 Tianyuan Jin , Kyoungseok Jang , Nicolò Cesa-Bianchi