English
Related papers

Related papers: Parallel Best Arm Identification in Heterogeneous …

200 papers

We focus on the problem of best-arm identification in a stochastic multi-arm bandit with temporally decreasing variances for the arms' rewards. We model arm rewards as Gaussian random variables with fixed means and variances that decrease…

Machine Learning · Computer Science 2025-02-12 Tamojeet Roychowdhury , Kota Srinivas Reddy , Krishna P Jagannathan , Sharayu Moharir

We consider the problem faced by a service platform that needs to match limited supply with demand but also to learn the attributes of new users in order to match them better in the future. We introduce a benchmark model with heterogeneous…

Machine Learning · Computer Science 2020-08-07 Ramesh Johari , Vijay Kamble , Yash Kanoria

We consider the problem of identifying the best arm in a multi-armed bandit model. Despite a wealth of literature in the traditional fixed budget and fixed confidence regimes of the best arm identification problem, it still remains a…

Machine Learning · Statistics 2025-12-08 Michael O. Harding , Kirthevasan Kandasamy

We consider the best arm identification problem, where the goal is to identify the arm with the highest mean reward from a set of $K$ arms under a limited sampling budget. This problem models many practical scenarios such as A/B testing. We…

Machine Learning · Statistics 2026-05-05 Junpei Komiyama , Kyoungseok Jang , Junya Honda

We consider a multi-armed bandit problem with $M$ latent contexts, where an agent interacts with the environment for an episode of $H$ time steps. Depending on the length of the episode, the learner may not be able to estimate accurately…

Machine Learning · Computer Science 2022-10-10 Jeongyeol Kwon , Yonathan Efroni , Constantine Caramanis , Shie Mannor

Growing concerns about safety and alignment of AI systems highlight the importance of embedding moral capabilities in artificial agents: a promising solution is the use of learning from experience, i.e., Reinforcement Learning. In…

Multiagent Systems · Computer Science 2026-02-11 Elizaveta Tennant , Stephen Hailes , Mirco Musolesi

We consider a variant of the best arm identification (BAI) problem in multi-armed bandits (MAB) in which there are two sets of arms (source and target), and the objective is to determine the best target arm while only pulling source arms.…

Machine Learning · Computer Science 2021-12-09 Ojash Neopane , Aaditya Ramdas , Aarti Singh

Heterogeneity is a fundamental property in multi-agent reinforcement learning (MARL), which is closely related not only to the functional differences of agents, but also to policy diversity and environmental interactions. However, the MARL…

Multiagent Systems · Computer Science 2025-12-30 Tianyi Hu , Zhiqiang Pu , Yuan Wang , Tenghai Qiu , Min Chen , Xin Yu

Training robots for operation in the real world is a complex, time consuming and potentially expensive task. Despite significant success of reinforcement learning in games and simulations, research in real robot applications has not been…

Artificial Intelligence · Computer Science 2017-09-28 Markus Wulfmeier , Ingmar Posner , Pieter Abbeel

The success of teams in robotics, nature, and society often depends on the division of labor among diverse specialists; however, a principled explanation for when such diversity surpasses a homogeneous team is still missing. Focusing on…

Multiagent Systems · Computer Science 2026-03-03 Michael Amir , Matteo Bettini , Amanda Prorok

The problem of identifying the best arm among a collection of items having Gaussian rewards distribution is well understood when the variances are known. Despite its practical relevance for many applications, few works studied it for…

Machine Learning · Statistics 2023-01-24 Marc Jourdan , Rémy Degenne , Emilie Kaufmann

While sequential task assignment for a single agent has been widely studied, such problems in a multi-agent setting, where the agents have heterogeneous task preferences or capabilities, remain less well-characterized. We study a…

Multiagent Systems · Computer Science 2025-10-21 Qinshuang Wei , Vaibhav Srivastava , Vijay Gupta

In this work, we analyse the relationship between heterogeneity and cooperation. Previous investigations suggest that this relation is nontrivial, as some authors found that heterogeneity sustains cooperation, while others obtained…

Physics and Society · Physics 2020-06-25 Marco A. Amaral , Marco A. Javarone

State of the art online learning procedures focus either on selecting the best alternative ("best arm identification") or on minimizing the cost (the "regret"). We merge these two objectives by providing the theoretical analysis of cost…

Machine Learning · Computer Science 2019-02-27 Rémy Degenne , Thomas Nedelec , Clément Calauzènes , Vianney Perchet

We initiate the study of the heterogeneous facility location problem with limited resources. We mainly focus on the fundamental case where a set of agents are positioned in the line segment [0,1] and have approval preferences over two…

Computer Science and Game Theory · Computer Science 2021-05-07 Argyrios Deligkas , Aris Filos-Ratsikas , Alexandros A. Voudouris

We study best-arm identification in stochastic multi-armed bandits under the fixed-confidence setting, focusing on instances with multiple optimal arms. Unlike prior work that addresses the unknown-number-of-optimal-arms case, we consider…

Machine Learning · Computer Science 2026-03-05 Lan V. Truong

In cooperative multi-agent reinforcement learning, a team of agents works together to achieve a common goal. Different environments or tasks may require varying degrees of coordination among agents in order to achieve the goal in an optimal…

Artificial Intelligence · Computer Science 2023-10-10 Dianbo Liu , Vedant Shah , Oussama Boussif , Cristian Meo , Anirudh Goyal , Tianmin Shu , Michael Mozer , Nicolas Heess , Yoshua Bengio

We examine a multi-armed bandit problem with contextual information, where the objective is to ensure that each arm receives a minimum aggregated reward across contexts while simultaneously maximizing the total cumulative reward. This…

Machine Learning · Computer Science 2025-10-15 Ahmed Ben Yahmed , Hafedh El Ferchichi , Marc Abeille , Vianney Perchet

Multi-armed bandit algorithms have become a reference solution for handling the explore/exploit dilemma in recommender systems, and many other important real-world problems, such as display advertisement. However, such algorithms usually…

Machine Learning · Computer Science 2018-05-25 Qingyun Wu , Naveen Iyer , Hongning Wang

In the latent bandit problem, the learner has access to reward distributions and -- for the non-stationary variant -- transition models of the environment. The reward distributions are conditioned on the arm and unknown latent states. The…

Machine Learning · Computer Science 2022-07-11 Alexander Galozy , Slawomir Nowaczyk
‹ Prev 1 4 5 6 7 8 10 Next ›