中文
相关论文

相关论文: Networked Restless Multi-Armed Bandits for Mobile …

200 篇论文

This paper is in the field of stochastic Multi-Armed Bandits (MABs), i.e., those sequential selection techniques able to learn online using only the feedback given by the chosen option (a.k.a. arm). We study a particular case of the rested…

机器学习 · 计算机科学 2022-12-08 Alberto Maria Metelli , Francesco Trovò , Matteo Pirola , Marcello Restelli

In the classic Bayesian restless multi-armed bandit (RMAB) problem, there are $N$ arms, with rewards on all arms evolving at each time as Markov chains with known parameters. A player seeks to activate $K \geq 1$ arms at each time in order…

最优化与控制 · 数学 2010-11-23 Wenhan Dai , Yi Gai , Bhaskar Krishnamachari , Qing Zhao

In the classic Bayesian restless multi-armed bandit (RMAB) problem, there are $N$ arms, with rewards on all arms evolving at each time as Markov chains with known parameters. A player seeks to activate $K \geq 1$ arms at each time in order…

最优化与控制 · 数学 2011-12-25 Wenhan Dai , Yi Gai , Bhaskar Krishnamachari , Qing Zhao

Restless multi-arm bandits (RMABs) is a popular decision-theoretic framework that has been used to model real-world sequential decision making problems in public health, wildlife conservation, communication systems, and beyond. Deployed…

人工智能 · 计算机科学 2023-01-20 Paritosh Verma , Shresth Verma , Aditya Mate , Aparna Taneja , Milind Tambe

We consider a restless multi-armed bandit (RMAB) in which there are two types of arms, say A and B. Each arm can be in one of two states, say $0$ or $1.$ Playing a type A arm brings it to state $0$ with probability one and not playing it…

系统与控制 · 计算机科学 2017-04-11 Rahul Meshram , Aditya Gopalan , D. Manjunath

This paper studies a class of constrained restless multi-armed bandits (CRMAB). The constraints are in the form of time varying set of actions (set of available arms). This variation can be either stochastic or semi-deterministic. Given a…

系统与控制 · 计算机科学 2021-09-07 Kesav Kaza , Rahul Meshram , Varun Mehta , S. N. Merchant

We obtain the conditions for the emergence of the swarm intelligence effect in an interactive game of restless multi-armed bandit (rMAB). A player competes with multiple agents. Each bandit has a payoff that changes with a probability…

人工智能 · 计算机科学 2016-08-22 Shunsuke Yoshida , Masato Hisakado , Shintaro Mori

In this paper, we investigate a largely extended version of classical MAB problem, called networked combinatorial bandit problems. In particular, we consider the setting of a decision maker over a networked bandits as follows: each time a…

机器学习 · 计算机科学 2015-03-23 Shaojie Tang , Yaqin Zhou

Online experimentation with interference is a common challenge in modern applications such as e-commerce and adaptive clinical trials in medicine. For example, in online marketplaces, the revenue of a good depends on discounts applied to…

机器学习 · 计算机科学 2024-05-30 Abhineet Agarwal , Anish Agarwal , Lorenzo Masoero , Justin Whitehouse

We define a general framework for a large class of combinatorial multi-armed bandit (CMAB) problems, where subsets of base arms with unknown distributions form super arms. In each round, a super arm is played and the base arms contained in…

机器学习 · 计算机科学 2016-03-30 Wei Chen , Yajun Wang , Yang Yuan , Qinshi Wang

We consider a Multi-Armed Bandit problem in which the rewards are non-stationary and are dependent on past actions and potentially on past contexts. At the heart of our method, we employ a recurrent neural network, which models these…

机器学习 · 计算机科学 2023-03-29 Michael Rotman , Lior Wolf

While classical formulations of multi-armed bandit problems assume that each arm's reward is independent and stationary, real-world applications often involve non-stationary environments and interdependencies between arms. In particular,…

机器学习 · 计算机科学 2025-06-19 Ryoma Sato , Shinji Ito

Multi-armed bandits (MAB) model sequential decision making problems, in which a learner sequentially chooses arms with unknown reward distributions in order to maximize its cumulative reward. Most of the prior work on MAB assumes that the…

机器学习 · 计算机科学 2018-03-22 Onur Atan , Cem Tekin , Mihaela van der Schaar

Multi-armed bandit problems are receiving a great deal of attention because they adequately formalize the exploration-exploitation trade-offs arising in several industrially relevant applications, such as online advertisement and, more…

机器学习 · 计算机科学 2013-11-05 Nicolò Cesa-Bianchi , Claudio Gentile , Giovanni Zappella

The multi-armed bandit (MAB) problem is an active learning framework that aims to select the best among a set of actions by sequentially observing rewards. Recently, it has become popular for a number of applications over wireless networks,…

机器学习 · 计算机科学 2021-11-12 Osama A. Hanna , Lin F. Yang , Christina Fragouli

We introduce a novel framework of combinatorial multi-armed bandits (CMAB) with multivariant and probabilistically triggering arms (CMAB-MT), where the outcome of each arm is a $d$-dimensional multivariant random variable and the feedback…

We consider the restless multi-armed bandit (RMAB) problem with unknown dynamics in which a player chooses M out of N arms to play at each time. The reward state of each arm transits according to an unknown Markovian rule when it is played…

最优化与控制 · 数学 2011-12-30 Haoyang Liu , Keqin Liu , Qing Zhao

In this paper, we investigate a new multi-armed bandit (MAB) online learning model that considers real-world phenomena in many recommender systems: (i) the learning agent cannot pull the arms by itself and thus has to offer rewards to users…

机器学习 · 计算机科学 2021-06-01 Tianchen Zhou , Jia Liu , Chaosheng Dong , Jingyuan Deng

Public health practitioners often have the goal of monitoring patients and maximizing patients' time spent in "favorable" or healthy states while being constrained to using limited resources. Restless multi-armed bandits (RMAB) are an…

机器学习 · 计算机科学 2024-12-12 Gauri Jain , Pradeep Varakantham , Haifeng Xu , Aparna Taneja , Prashant Doshi , Milind Tambe

In recent years, the integration of communication and control systems has gained significant traction in various domains, ranging from autonomous vehicles to industrial automation and beyond. Multi-armed bandit (MAB) algorithms have proven…

系统与控制 · 电气工程与系统科学 2024-05-16 Hiba Dakdouk , Mohamed Sana , Mattia Merluzzi