English
Related papers

Related papers: The Assistive Multi-Armed Bandit

200 papers

Automated algorithm selection and hyperparameter tuning facilitates the application of machine learning. Traditional multi-armed bandit strategies look to the history of observed rewards to identify the most promising arms for optimizing…

Machine Learning · Computer Science 2020-05-29 Mischa Schmidt , Julia Gastinger , Sébastien Nicolas , Anett Schülke

Multi-arm bandits are gaining popularity as they enable real-world sequential decision-making across application areas, including clinical trials, recommender systems, and online decision-making. Consequently, there is an increased desire…

Methodology · Statistics 2023-03-01 Dae Woong Ham , Iavor Bojinov , Michael Lindon , Martin Tingley

The multi-armed bandit is a mathematical interpretation of the problem a gambler faces when confronted with a number of different machines (bandits). The gambler wants to explore different machines to discover which machine offers the best…

Cryptography and Security · Computer Science 2020-08-06 Hazel Murray , David Malone

This paper introduces a general multi-agent bandit model in which each agent is facing a finite set of arms and may communicate with other agents through a central controller in order to identify, in pure exploration, or play, in regret…

Machine Learning · Computer Science 2022-10-31 Clémence Réda , Sattar Vakili , Emilie Kaufmann

We study the problem of information sharing and cooperation in Multi-Player Multi-Armed bandits. We propose the first algorithm that achieves logarithmic regret for this problem when the collision reward is unknown. Our results are based on…

Machine Learning · Computer Science 2022-10-04 Aldo Pacchiano , Peter Bartlett , Michael I. Jordan

Recent works on shared autonomy and assistive-AI technologies, such as assistive robot teleoperation, seek to model and help human users with limited ability in a fixed task. However, these approaches often fail to account for humans'…

Artificial Intelligence · Computer Science 2022-11-28 Megha Srivastava , Erdem Biyik , Suvir Mirchandani , Noah Goodman , Dorsa Sadigh

Workers participating in a crowdsourcing platform can have a wide range of abilities and interests. An important problem in crowdsourcing is the task recommendation problem, in which tasks that best match a particular worker's preferences…

Human-Computer Interaction · Computer Science 2018-07-30 Qiyu Kang , Wee Peng Tay

We present an approach to Intelligent Tutoring Systems which adaptively personalizes sequences of learning activities to maximize skills acquired by students, taking into account the limited time and motivational resources. At a given point…

Artificial Intelligence · Computer Science 2019-07-17 Benjamin Clement , Didier Roy , Pierre-Yves Oudeyer , Manuel Lopes

The multi-armed bandit problem is a classical decision-making problem where an agent has to learn an optimal action balancing exploration and exploitation. Properly managing this trade-off requires a correct assessment of uncertainty; in…

Machine Learning · Computer Science 2020-08-18 Fabio Massimo Zennaro , Audun Jøsang

When humans collaborate with each other, they often make decisions by observing others and considering the consequences that their actions may have on the entire team, instead of greedily doing what is best for just themselves. We would…

Machine Learning · Computer Science 2021-12-17 Erdem Bıyık , Anusha Lalitha , Rajarshi Saha , Andrea Goldsmith , Dorsa Sadigh

Multi-armed bandit algorithms have been argued for decades as useful for adaptively randomized experiments. In such experiments, an algorithm varies which arms (e.g. alternative interventions to help students learn) are assigned to…

Machine Learning · Computer Science 2021-03-29 Joseph Jay Williams , Jacob Nogas , Nina Deliu , Hammad Shaikh , Sofia S. Villar , Audrey Durand , Anna Rafferty

Multi-armed bandit problems are receiving a great deal of attention because they adequately formalize the exploration-exploitation trade-offs arising in several industrially relevant applications, such as online advertisement and, more…

Machine Learning · Computer Science 2013-11-05 Nicolò Cesa-Bianchi , Claudio Gentile , Giovanni Zappella

We consider a decentralized stochastic multi-armed bandit problem with multiple players. Each player aims to maximize his/her own reward by pulling an arm. The arms give rewards based on i.i.d. stochastic Bernoulli distributions. Players…

Machine Learning · Computer Science 2017-12-05 Noyan Evirgen , Alper Kose , Hakan Gokcesu

Mode estimation is a classical problem in statistics with a wide range of applications in machine learning. Despite this, there is little understanding in its robustness properties under possibly adversarial data contamination. In this…

Machine Learning · Computer Science 2020-03-09 Aldo Pacchiano , Heinrich Jiang , Michael I. Jordan

Maximizing long-term rewards is the primary goal in sequential decision-making problems. The majority of existing methods assume that side information is freely available, enabling the learning agent to observe all features' states before…

Machine Learning · Computer Science 2023-07-19 Saeed Ghoorchian , Evgenii Kortukov , Setareh Maghsudi

Contextual bandits are widely used in industrial personalization systems. These online learning frameworks learn a treatment assignment policy in the presence of treatment effects that vary with the observed contextual features of the…

Machine Learning · Computer Science 2022-05-11 Claudia Roberts , Maria Dimakopoulou , Qifeng Qiao , Ashok Chandrashekhar , Tony Jebara

The multi-armed bandit (MAB) problem models a decision-maker that optimizes its actions based on current and acquired new knowledge to maximize its reward. This type of online decision is prominent in many procedures of Brain-Computer…

Artificial Intelligence · Computer Science 2022-11-10 Frida Heskebeck , Carolina Bergeling , Bo Bernhardsson

Robot arms should be able to learn new tasks. One framework here is reinforcement learning, where the robot is given a reward function that encodes the task, and the robot autonomously learns actions to maximize its reward. Existing…

Robotics · Computer Science 2024-03-21 Shaunak A. Mehta , Soheil Habibian , Dylan P. Losey

We consider a non stationary multi-armed bandit in which the population preferences are positively and negatively reinforced by the observed rewards. The objective of the algorithm is to shape the population preferences to maximize the…

Machine Learning · Computer Science 2024-03-04 Viraj Nadkarni , D. Manjunath , Sharayu Moharir

We study incentivized exploration for the multi-armed bandit (MAB) problem where the players receive compensation for exploring arms other than the greedy choice and may provide biased feedback on reward. We seek to understand the impact of…

Machine Learning · Computer Science 2019-12-17 Zhiyuan Liu , Huazheng Wang , Fan Shen , Kai Liu , Lijun Chen