English
Related papers

Related papers: Multi-objective Contextual Multi-armed Bandit with…

200 papers

Safety and performance are often two competing objectives in sequential decision-making problems. Existing performant controllers, such as controllers derived from reinforcement learning algorithms, often fall short of safety guarantees. On…

Systems and Control · Electrical Eng. & Systems 2020-08-03 Parham Gohari , Franck Djeumou , Abraham P. Vinod , Ufuk Topcu

Stochastic multi-armed bandits solve the Exploration-Exploitation dilemma and ultimately maximize the expected reward. Nonetheless, in many practical problems, maximizing the expected reward is not the most desirable objective. In this…

Machine Learning · Computer Science 2013-01-10 Amir Sani , Alessandro Lazaric , Rémi Munos

We study incentivized exploration for the multi-armed bandit (MAB) problem where the players receive compensation for exploring arms other than the greedy choice and may provide biased feedback on reward. We seek to understand the impact of…

Machine Learning · Computer Science 2019-12-17 Zhiyuan Liu , Huazheng Wang , Fan Shen , Kai Liu , Lijun Chen

We consider the problem of contextual bandits and imitation learning, where the learner lacks direct knowledge of the executed action's reward. Instead, the learner can actively query an expert at each round to compare two actions and…

Machine Learning · Computer Science 2023-07-25 Ayush Sekhari , Karthik Sridharan , Wen Sun , Runzhe Wu

Learning preferences implicit in the choices humans make is a well studied problem in both economics and computer science. However, most work makes the assumption that humans are acting (noisily) optimally with respect to their preferences.…

Machine Learning · Computer Science 2019-01-28 Lawrence Chan , Dylan Hadfield-Menell , Siddhartha Srinivasa , Anca Dragan

Multi-armed bandit problems are considered as a paradigm of the trade-off between exploring the environment to find profitable actions and exploiting what is already known. In the stationary case, the distributions of the rewards do not…

Statistics Theory · Mathematics 2008-12-18 Aurélien Garivier , Eric Moulines

We consider the Multi-Armed Bandit (MAB) problem, where an agent sequentially chooses actions and observes rewards for the actions it took. While the majority of algorithms try to minimize the regret, i.e., the cumulative difference between…

Machine Learning · Computer Science 2021-09-14 Nadav Merlis , Shie Mannor

Early-phase clinical trials face the challenge of selecting optimal drug doses that balance safety and efficacy due to uncertain dose-response relationships and varied participant characteristics. Traditional randomized dose allocation…

Methodology · Statistics 2026-02-13 Rohit Kanrar , Chunlin Li , Zara Ghodsi , Margaret Gamalo

In the combinatorial semi-bandit (CSB) problem, a player selects an action from a combinatorial action set and observes feedback from the base arms included in the action. While CSB is widely applicable to combinatorial optimization…

Machine Learning · Computer Science 2025-09-15 Shintaro Nakamura , Yuko Kuroki , Wei Chen

In the classical multi-armed bandit problem, instance-dependent algorithms attain improved performance on "easy" problems with a gap between the best and second-best arm. Are similar guarantees possible for contextual bandits? While…

Machine Learning · Computer Science 2020-10-08 Dylan J. Foster , Alexander Rakhlin , David Simchi-Levi , Yunzong Xu

We study a strategic version of the multi-armed bandit problem, where each arm is an individual strategic agent and we, the principal, pull one arm each round. When pulled, the arm receives some private reward $v_a$ and can choose an amount…

Computer Science and Game Theory · Computer Science 2017-07-03 Mark Braverman , Jieming Mao , Jon Schneider , S. Matthew Weinberg

Conventional Multi-Armed Bandit (MAB) algorithms are designed for stationary environments, where the reward distributions associated with the arms do not change with time. In many applications, however, the environment is more accurately…

Artificial Intelligence · Computer Science 2025-11-05 Yu-Han Huang , Argyrios Gerogiannis , Subhonmesh Bose , Venugopal V. Veeravalli

In human-computer interaction applications like hand gesture recognition, supervised learning models are often trained on a large population of users to achieve high task accuracy. However, due to individual variability in sensor signals…

Human-Computer Interaction · Computer Science 2025-09-12 Duke Lin , Michael Paskett , Ying Yang

The multi-armed bandit (MAB) is a classical online optimization model for the trade-off between exploration and exploitation. The traditional MAB is concerned with finding the arm that minimizes the mean cost. However, minimizing the mean…

Optimization and Control · Mathematics 2018-09-17 Jianyu Xu , William B. Haskell , Zhisheng Ye

The multi-armed bandit (MAB) problem is a foundational framework in sequential decision-making under uncertainty, extensively studied for its applications in areas such as clinical trials, online advertising, and resource allocation.…

Machine Learning · Computer Science 2024-10-28 Ali Baheri

A recent line of research focuses on the study of the stochastic multi-armed bandits problem (MAB), in the case where temporal correlations of specific structure are imposed between the player's actions and the reward distributions of the…

Machine Learning · Computer Science 2021-03-02 Orestis Papadigenopoulos , Constantine Caramanis

E-commerce sites strive to provide users the most timely relevant information in order to reduce shopping frictions and increase customer satisfaction. Multi armed bandit models (MAB) as a type of adaptive optimization algorithms provide…

Information Retrieval · Computer Science 2021-08-23 Ding Xiang , Becky West , Jiaqi Wang , Xiquan Cui , Jinzhou Huang

Remote education has proliferated in the twenty-first century, yielding rise to intelligent tutoring systems. In particular, research has found multi-armed bandit (MAB) intelligent tutors to have notable abilities in traversing the…

Computers and Society · Computer Science 2024-08-15 Blake Castleman , Uzay Macar , Ansaf Salleb-Aouissi

We consider the correlated multiarmed bandit (MAB) problem in which the rewards associated with each arm are modeled by a multivariate Gaussian random variable, and we investigate the influence of the assumptions in the Bayesian prior on…

Optimization and Control · Mathematics 2015-07-09 Vaibhav Srivastava , Paul Reverdy , Naomi Ehrich Leonard

The multi-armed bandit (MAB) problem is a classical learning task that exemplifies the exploration-exploitation tradeoff. However, standard formulations do not take into account {\em risk}. In online decision making systems, risk is a…

Machine Learning · Computer Science 2020-08-04 Qiuyu Zhu , Vincent Y. F. Tan