中文
相关论文

相关论文: Multi-Player Multi-Armed Bandits with Finite Share…

200 篇论文

Multi-armed bandits (MAB) is a sequential decision-making model in which the learner controls the trade-off between exploration and exploitation to maximize its cumulative reward. Federated multi-armed bandits (FMAB) is an emerging…

机器学习 · 计算机科学 2025-02-18 Artun Saday , İlker Demirel , Yiğit Yıldırım , Cem Tekin

We introduce a new class of reinforcement learning methods referred to as {\em episodic multi-armed bandits} (eMAB). In eMAB the learner proceeds in {\em episodes}, each composed of several {\em steps}, in which it chooses an action and…

机器学习 · 计算机科学 2018-03-13 Cem Tekin , Mihaela van der Schaar

In this paper, we study the stochastic multi-armed bandit problem with graph feedback. Motivated by the clinical trials and recommendation problem, we assume that two arms are connected if and only if they are similar (i.e., their means are…

机器学习 · 计算机科学 2024-05-21 Han Qi , Guo Fei , Li Zhu

A matching platform is a system that matches different types of participants, such as companies and job-seekers. In such a platform, merely maximizing the number of matches can result in matches being concentrated on highly popular…

机器学习 · 计算机科学 2026-03-10 Yuki Shibukawa , Koichi Tanaka , Yuta Saito , Shinji Ito

We study meta-learning for adversarial multi-armed bandits. We consider the online-within-online setup, in which a player (learner) encounters a sequence of multi-armed bandit episodes. The player's performance is measured as regret against…

机器学习 · 计算机科学 2022-07-13 Ilya Osadchiy , Kfir Y. Levy , Ron Meir

We introduce a novel framework of combinatorial multi-armed bandits (CMAB) with multivariant and probabilistically triggering arms (CMAB-MT), where the outcome of each arm is a $d$-dimensional multivariant random variable and the feedback…

We investigate the use of a multi-agent multi-armed bandit (MA-MAB) setting for modeling repeated Cournot oligopoly games, where the firms acting as agents choose from the set of arms representing production quantity (a discrete value).…

计算机科学与博弈论 · 计算机科学 2022-01-05 Kshitija Taywade , Brent Harrison , Adib Bagh

Many modern AI and ML problems require evaluating partners' contributions through shared yet asymmetric, computationally intensive processes and the simultaneous selection of the most beneficial candidates. Sequential approaches to these…

机器学习 · 计算机科学 2026-01-01 András Antos , András Millinghoffer , Péter Antal

Learning preferences implicit in the choices humans make is a well studied problem in both economics and computer science. However, most work makes the assumption that humans are acting (noisily) optimally with respect to their preferences.…

机器学习 · 计算机科学 2019-01-28 Lawrence Chan , Dylan Hadfield-Menell , Siddhartha Srinivasa , Anca Dragan

Best arm identification (or, pure exploration) in multi-armed bandits is a fundamental problem in machine learning. In this paper we study the distributed version of this problem where we have multiple agents, and they want to learn the…

机器学习 · 计算机科学 2019-09-02 Chao Tao , Qin Zhang , Yuan Zhou

In a multi-armed bandit (MAB) problem, an online algorithm makes a sequence of choices. In each round it chooses from a time-invariant set of alternatives and receives the payoff associated with this alternative. While the case of small…

数据结构与算法 · 计算机科学 2014-05-21 Aleksandrs Slivkins

In the classic multi-armed bandits problem, the goal is to have a policy for dynamically operating arms that each yield stochastic rewards with unknown means. The key metric of interest is regret, defined as the gap between the expected…

最优化与控制 · 数学 2010-11-23 Yi Gai , Bhaskar Krishnamachari , Rahul Jain

We propose a generalization of the best arm identification problem in stochastic multi-armed bandits (MAB) to the setting where every pull of an arm is associated with delayed feedback. The delay in feedback increases the effective sample…

We study a problem of information gathering in a social network with dynamically available sources and time varying quality of information. We formulate this problem as a restless multi-armed bandit (RMAB). In this problem, information…

系统与控制 · 计算机科学 2018-01-22 Varun Mehta , Rahul Meshram , Kesav Kaza , S. N. Merchant

Restless multi-armed bandits (RMAB) extend multi-armed bandits so pulling an arm impacts future states. Despite the success of RMABs, a key limiting assumption is the separability of rewards into a sum across arms. We address this…

机器学习 · 计算机科学 2024-06-11 Naveen Raman , Zheyuan Ryan Shi , Fei Fang

Multi-armed bandit (MAB) is a class of online learning problems where a learning agent aims to maximize its expected cumulative reward while repeatedly selecting to pull arms with unknown reward distributions. We consider a scenario where…

机器学习 · 统计学 2019-01-25 Yang Cao , Zheng Wen , Branislav Kveton , Yao Xie

In this paper, we propose a new multi-objective contextual multi-armed bandit (MAB) problem with two objectives, where one of the objectives dominates the other objective. Unlike single-objective MAB problems in which the learner obtains a…

机器学习 · 计算机科学 2018-06-04 Cem Tekin , Eralp Turgay

Multi-user multi-armed bandits have emerged as a good model for uncoordinated spectrum access problems. In this paper we consider the scenario where users cannot communicate with each other. In addition, the environment may appear…

信息论 · 计算机科学 2019-12-05 Akshayaa Magesh , Venugopal V. Veeravalli

In this paper, we study the stochastic combinatorial multi-armed bandit (CMAB) framework that allows a general nonlinear reward function, whose expected value may not depend only on the means of the input random variables but possibly on…

机器学习 · 计算机科学 2018-07-23 Wei Chen , Wei Hu , Fu Li , Jian Li , Yu Liu , Pinyan Lu

We study reward poisoning attacks on Combinatorial Multi-armed Bandits (CMAB). We first provide a sufficient and necessary condition for the attackability of CMAB, a notion to capture the vulnerability and robustness of CMAB. The…

机器学习 · 计算机科学 2024-06-05 Rishab Balasubramanian , Jiawei Li , Prasad Tadepalli , Huazheng Wang , Qingyun Wu , Haoyu Zhao