A Survey on Contextual Multi-armed Bandits
Machine Learning
2016-02-02 v2
Authors:
Li Zhou
Abstract
In this survey we cover a few stochastic and adversarial contextual bandit algorithms. We analyze each algorithm's assumption and regret bound.
Keywords
Cite
@article{arxiv.1508.03326,
title = {A Survey on Contextual Multi-armed Bandits},
author = {Li Zhou},
journal= {arXiv preprint arXiv:1508.03326},
year = {2016}
}
Related papers
View all related →
Information Retrieval · Computer Science
Productization Challenges of Contextual Multi-Armed Bandits
David Abensur, Ivan Balashov, Shaked Bar, Ronny Lempel +4
2019-07-12
Machine Learning · Statistics
Multi-Task Learning for Contextual Bandits
Aniket Anand Deshmukh, Urun Dogan, Clayton Scott
2017-05-25
Machine Learning · Computer Science
A Hierarchical Nearest Neighbour Approach to Contextual Bandits
Stephen Pasteris, Chris Hicks, Vasilios Mavroudis
2023-12-18
Machine Learning · Computer Science
Balanced Linear Contextual Bandits
Maria Dimakopoulou, Zhengyuan Zhou, Susan Athey, Guido Imbens
2018-12-18
Machine Learning · Statistics
OSOM: A simultaneously optimal algorithm for multi-armed and linear contextual bandits
Niladri S. Chatterji, Vidya Muthukumar, Peter L. Bartlett
2020-10-07
Machine Learning · Statistics
A Contextual Bandit Bake-off
Alberto Bietti, Alekh Agarwal, John Langford
2021-06-08
Machine Learning · Statistics
Estimation Considerations in Contextual Bandits
Maria Dimakopoulou, Zhengyuan Zhou, Susan Athey, Guido Imbens
2018-12-18
Machine Learning · Computer Science
Learning Contextual Bandits in a Non-stationary Environment
Qingyun Wu, Naveen Iyer, Hongning Wang
2018-05-25
Machine Learning · Computer Science
Risk-Aware Algorithms for Adversarial Contextual Bandits
Wen Sun, Debadeepta Dey, Ashish Kapoor
2016-10-18
Machine Learning · Computer Science
Stochastic Bandits Robust to Adversarial Attacks
Xuchuang Wang, Jinhang Zuo, Xutong Liu, John C. S. Lui +1
2024-08-19
Machine Learning · Computer Science
Resourceful Contextual Bandits
Ashwinkumar Badanidiyuru, John Langford, Aleksandrs Slivkins
2015-08-03
Machine Learning · Statistics
A Survey of Online Experiment Design with the Stochastic Multi-Armed Bandit
Giuseppe Burtini, Jason Loeppky, Ramon Lawrence
2015-11-04
Machine Learning · Computer Science
Combinatorial Bandits Revisited
Richard Combes, M. Sadegh Talebi, Alexandre Proutiere, Marc Lelarge
2015-11-09
Machine Learning · Computer Science
Better Algorithms for Stochastic Bandits with Adversarial Corruptions
Anupam Gupta, Tomer Koren, Kunal Talwar
2019-03-29
Machine Learning · Computer Science
contextual: Evaluating Contextual Multi-Armed Bandit Problems in R
Robin van Emden, Maurits Kaptein
2020-01-03
Machine Learning · Computer Science
Adaptive Bandit Algorithms for Contextual Matching Markets
Shiyun Lin, Simon Mauras, Vianney Perchet, Nadav Merlis
2026-05-28
Machine Learning · Computer Science
Contextual Blocking Bandits
Soumya Basu, Orestis Papadigenopoulos, Constantine Caramanis, Sanjay Shakkottai
2020-06-18
Machine Learning · Computer Science
Survey Bandits with Regret Guarantees
Sanath Kumar Krishnamurthy, Susan Athey
2020-02-25
Machine Learning · Computer Science
Contextual Bandits with Stage-wise Constraints
Aldo Pacchiano, Mohammad Ghavamzadeh, Peter Bartlett
2025-08-22
Machine Learning · Statistics
Regularized Contextual Bandits
Xavier Fontaine, Quentin Berthet, Vianney Perchet
2019-06-06
Machine Learning · Computer Science
Proportional Response: Contextual Bandits for Simple and Cumulative Regret Minimization
Sanath Kumar Krishnamurthy, Ruohan Zhan, Susan Athey, Emma Brunskill
2023-11-06
Machine Learning · Computer Science
Stochastic Linear Contextual Bandits with Diverse Contexts
Weiqiang Wu, Jing Yang, Cong Shen
2020-03-06
Machine Learning · Computer Science
Contextual Bandits Evolving Over Finite Time
Harsh Deshpande, Vishal Jain, Sharayu Moharir
2019-11-15
Machine Learning · Computer Science
Selectively Contextual Bandits
Claudia Roberts, Maria Dimakopoulou, Qifeng Qiao, Ashok Chandrashekhar +1
2022-05-11
Machine Learning · Computer Science
Constrained Contextual Bandits with Adversarial Contexts
Dhruv Sarkar, Abhishek Sinha
2026-05-08