English
Related papers

Related papers: Information Directed Sampling for Sparse Linear Ba…

200 papers

Bandit algorithms sequentially accumulate data using adaptive sampling policies, offering flexibility for real-world applications. However, excessive sampling can be costly, motivating the devolopment of early stopping methods and reliable…

Statistics Theory · Mathematics 2025-02-06 Zihan Cui

We study the problem of regret minimization in a multi-armed bandit setup where the agent is allowed to play multiple arms at each round by spreading the resources usually allocated to only one arm. At each iteration the agent selects a…

Machine Learning · Computer Science 2021-06-01 Matias I. Müller , Cristian R. Rojas

Online sparse linear regression is an online problem where an algorithm repeatedly chooses a subset of coordinates to observe in an adversarially chosen feature vector, makes a real-valued prediction, receives the true label, and incurs the…

Machine Learning · Computer Science 2020-07-27 Satyen Kale , Zohar Karnin , Tengyuan Liang , Dávid Pál

We consider model selection for sequential decision making in stochastic environments with bandit feedback, where a meta-learner has at its disposal a pool of base learners, and decides on the fly which action to take based on the policies…

Machine Learning · Computer Science 2024-01-24 Aldo Pacchiano , Christoph Dann , Claudio Gentile

Bayesian optimization is a framework for global search via maximum a posteriori updates rather than simulated annealing, and has gained prominence for decision-making under uncertainty. In this work, we cast Bayesian optimization as a…

Machine Learning · Computer Science 2022-03-24 Amrit Singh Bedi , Dheeraj Peddireddy , Vaneet Aggarwal , Brian M. Sadler , Alec Koppel

We present a novel approach to address the multi-agent sparse contextual linear bandit problem, in which the feature vectors have a high dimension $d$ whereas the reward function depends on only a limited set of features - precisely $s_0…

Machine Learning · Computer Science 2023-05-31 Haniyeh Barghi , Xiaotong Cheng , Setareh Maghsudi

We consider the problem of \textit{online sparse linear approximation}, where one predicts the best sparse approximation of a sequence of measurements in terms of linear combination of columns of a given measurement matrix. Such online…

Machine Learning · Computer Science 2025-01-08 Samrat Mukhopadhyay , Debasmita Mukherjee

We propose a simple model selection approach for algorithms in stochastic bandit and reinforcement learning problems. As opposed to prior work that (implicitly) assumes knowledge of the optimal regret, we only require that each base…

Machine Learning · Computer Science 2020-12-25 Aldo Pacchiano , Christoph Dann , Claudio Gentile , Peter Bartlett

Stochastic linear bandits are a fundamental model for sequential decision making, where an agent selects a vector-valued action and receives a noisy reward with expected value given by an unknown linear function. Although well studied in…

Machine Learning · Computer Science 2025-06-23 Bruce Huang , Ruida Zhou , Lin F. Yang , Suhas Diggavi

This paper studies the stochastic linear bandit problem, where a decision-maker chooses actions from possibly time-dependent sets of vectors in $\mathbb{R}^d$ and receives noisy rewards. The objective is to minimize regret, the difference…

Machine Learning · Computer Science 2023-04-24 Nima Hamidi , Mohsen Bayati

In this paper we propose a novel experimental design-based algorithm to minimize regret in online stochastic linear and combinatorial bandits. While existing literature tends to focus on optimism-based algorithms--which have been shown to…

Machine Learning · Computer Science 2021-03-02 Andrew Wagenmaker , Julian Katz-Samuels , Kevin Jamieson

We introduce a novel online learning framework that unifies and generalizes pre-established models, such as delayed and corrupted feedback, to encompass adversarial environments where action feedback evolves over time. In this setting, the…

Machine Learning · Computer Science 2024-05-28 Yogev Bar-On , Yishay Mansour

We study adaptive importance sampling (AIS) as an online learning problem and argue for the importance of the trade-off between exploration and exploitation in this adaptation. Borrowing ideas from the bandits literature, we propose Daisee,…

Machine Learning · Statistics 2018-11-01 Xiaoyu Lu , Tom Rainforth , Yuan Zhou , Jan-Willem van de Meent , Yee Whye Teh

Multi-armed bandit problems are the predominant theoretical model of exploration-exploitation tradeoffs in learning, and they have countless applications ranging from medical trials, to communication networks, to Web search and advertising.…

Data Structures and Algorithms · Computer Science 2017-09-06 Ashwinkumar Badanidiyuru , Robert Kleinberg , Aleksandrs Slivkins

We consider the stochastic linear contextual bandit problem with high-dimensional features. We analyze the Thompson sampling algorithm using special classes of sparsity-inducing priors (e.g., spike-and-slab) to model the unknown parameter…

Machine Learning · Statistics 2023-01-31 Sunrit Chakraborty , Saptarshi Roy , Ambuj Tewari

The contextual duelling bandit problem models adaptive recommender systems, where the algorithm presents a set of items to the user, and the user's choice reveals their preference. This setup is well suited for implicit choices users make…

Machine Learning · Computer Science 2025-08-27 Suryanarayana Sankagiri , Jalal Etesami , Pouria Fatemi , Matthias Grossglauser

We consider a special case of bandit problems, named batched bandits, in which an agent observes batches of responses over a certain time period. Unlike previous work, we consider a more practically relevant batch-centric scenario of batch…

Machine Learning · Computer Science 2023-04-04 Danil Provodin , Pratik Gajane , Mykola Pechenizkiy , Maurits Kaptein

This work addresses the mediator feedback problem, a bandit game where the decision set consists of a number of policies, each associated with a probability distribution over a common space of outcomes. Upon choosing a policy, the learner…

Machine Learning · Computer Science 2024-02-19 Khaled Eldowa , Nicolò Cesa-Bianchi , Alberto Maria Metelli , Marcello Restelli

We study linear contextual bandits with access to a large, confounded, offline dataset that was sampled from some fixed policy. We show that this problem is closely related to a variant of the bandit problem with side information. We…

Machine Learning · Computer Science 2021-08-11 Guy Tennenholtz , Uri Shalit , Shie Mannor , Yonathan Efroni

We investigate the high-dimensional sparse linear bandits problem in a data-poor regime where the time horizon is much smaller than the ambient dimension and number of arms. We study the setting under the additional blocking constraint…

Machine Learning · Computer Science 2025-05-30 Adit Jain , Soumyabrata Pal , Sunav Choudhary , Ramasuri Narayanam , Harshita Chopra , Vikram Krishnamurthy