中文
相关论文

相关论文: (Almost) Free Incentivized Exploration from Decent…

200 篇论文

Traditional multi-armed bandit (MAB) formulations usually make certain assumptions about the underlying arms' distributions, such as bounds on the support or their tail behaviour. Moreover, such parametric information is usually 'baked'…

机器学习 · 计算机科学 2022-03-29 Anmol Kagrecha , Jayakrishnan Nair , Krishna Jagannathan

We consider a multi-armed bandit problem where the decision maker can explore and exploit different arms at every round. The exploited arm adds to the decision maker's cumulative reward (without necessarily observing the reward) while the…

机器学习 · 计算机科学 2012-07-03 Orly Avner , Shie Mannor , Ohad Shamir

Efficient exploration in deep cooperative multi-agent reinforcement learning (MARL) still remains challenging in complex coordination problems. In this paper, we introduce a novel Episodic Multi-agent reinforcement learning with…

机器学习 · 计算机科学 2021-11-23 Lulu Zheng , Jiarui Chen , Jianhao Wang , Jiamin He , Yujing Hu , Yingfeng Chen , Changjie Fan , Yang Gao , Chongjie Zhang

We study the stochastic Budgeted Multi-Armed Bandit (MAB) problem, where a player chooses from $K$ arms with unknown expected rewards and costs. The goal is to maximize the total reward under a budget constraint. A player thus seeks to…

机器学习 · 计算机科学 2023-08-16 Marco Heyden , Vadim Arzamasov , Edouard Fouché , Klemens Böhm

Multi-player Multi-Armed Bandits (MAB) have been extensively studied in the literature, motivated by applications to Cognitive Radio systems. Driven by such applications as well, we motivate the introduction of several levels of feedback…

机器学习 · 统计学 2019-04-30 Lilian Besson , Emilie Kaufmann

A standard assumption adopted in the multi-armed bandit (MAB) framework is that the mean rewards are constant over time. This assumption can be restrictive in the business world as decision-makers often face an evolving environment where…

机器学习 · 计算机科学 2021-08-24 Ningyuan Chen , Chun Wang , Longlin Wang

We introduce the concept of a multi-principal assistance game (MPAG), and circumvent an obstacle in social choice theory, Gibbard's theorem, by using a sufficiently collegial preference inference mechanism. In an MPAG, a single agent…

计算机科学与博弈论 · 计算机科学 2021-01-01 Arnaud Fickinger , Simon Zhuang , Andrew Critch , Dylan Hadfield-Menell , Stuart Russell

Social learning is learning through the observation of or interaction with other individuals; it is critical in the understanding of the collective behaviors of humans in social physics. We study the learning process of agents in a restless…

物理与社会 · 物理学 2020-12-01 Kazuaki Nakayama , Ryuzo Nakamura , Masato Hisakado , Shintaro Mori

The contextual multi-armed bandit (MAB) problem is crucial in sequential decision-making. A line of research, known as online clustering of bandits, extends contextual MAB by grouping similar users into clusters, utilizing shared features…

机器学习 · 计算机科学 2025-01-03 Zhuohua Li , Maoli Liu , Xiangxiang Dai , John C. S. Lui

In this paper, we introduce a distributed version of the classical stochastic Multi-Arm Bandit (MAB) problem. Our setting consists of a large number of agents $n$ that collaboratively and simultaneously solve the same instance of $K$ armed…

机器学习 · 计算机科学 2019-11-06 Abishek Sankararaman , Ayalvadi Ganesh , Sanjay Shakkottai

Autonomous 3D environment exploration is a fundamental task for various applications such as navigation. The goal of exploration is to investigate a new environment and build its occupancy map efficiently. In this paper, we propose a new…

人工智能 · 计算机科学 2021-11-03 Liu Juncheng , McCane Brendan , Mills Steven

In this paper, we consider a risk-averse multi-armed bandit (MAB) problem where the goal is to learn a policy that minimizes the risk of low expected return, as opposed to maximizing the expected return itself, which is the objective in the…

机器学习 · 计算机科学 2022-09-12 Yi Shen , Jessilyn Dunn , Michael M. Zavlanos

We study a decentralized multi-agent multi-armed bandit problem in which multiple clients are connected by time dependent random graphs provided by an environment. The reward distributions of each arm vary across clients and rewards are…

机器学习 · 计算机科学 2023-10-19 Mengfan Xu , Diego Klabjan

We study multi-objective multi-agent multi-armed bandits (MO-MA-MAB) under stochastic rewards, where agents observe heterogeneous reward vectors and communicate over time-varying graphs. We formulate this emerging problem setting to address…

机器学习 · 计算机科学 2026-05-11 John Wang , Mengfan Xu

We obtain the conditions for the emergence of the swarm intelligence effect in an interactive game of restless multi-armed bandit (rMAB). A player competes with multiple agents. Each bandit has a payoff that changes with a probability…

人工智能 · 计算机科学 2016-08-22 Shunsuke Yoshida , Masato Hisakado , Shintaro Mori

While learning in an unknown Markov Decision Process (MDP), an agent should trade off exploration to discover new information about the MDP, and exploitation of the current knowledge to maximize the reward. Although the agent will…

机器学习 · 计算机科学 2020-07-16 Evrard Garcelon , Mohammad Ghavamzadeh , Alessandro Lazaric , Matteo Pirotta

In recent years, multi-armed bandit (MAB) framework has attracted a lot of attention in various applications, from recommender systems and information retrieval to healthcare and finance, due to its stellar performance combined with certain…

机器学习 · 计算机科学 2019-04-24 Djallel Bouneffouf , Irina Rish

In this paper, we propose a new multi-objective contextual multi-armed bandit (MAB) problem with two objectives, where one of the objectives dominates the other objective. Unlike single-objective MAB problems in which the learner obtains a…

机器学习 · 计算机科学 2018-06-04 Cem Tekin , Eralp Turgay

Competitions for shareable and limited resources have long been studied with strategic agents. In reality, agents often have to learn and maximize the rewards of the resources at the same time. To design an individualized competing policy,…

机器学习 · 计算机科学 2023-08-07 Renzhe Xu , Haotian Wang , Xingxuan Zhang , Bo Li , Peng Cui

We study a finite-horizon restless multi-armed bandit problem with multiple actions, dubbed R(MA)^2B. The state of each arm evolves according to a controlled Markov decision process (MDP), and the reward of pulling an arm depends on both…

机器学习 · 计算机科学 2022-03-25 Guojun Xiong , Jian Li , Rahul Singh