中文
相关论文

相关论文: CCN Interest Forwarding Strategy as Multi-Armed Ba…

200 篇论文

The multi-armed bandit (MAB) problem models a decision-maker that optimizes its actions based on current and acquired new knowledge to maximize its reward. This type of online decision is prominent in many procedures of Brain-Computer…

人工智能 · 计算机科学 2022-11-10 Frida Heskebeck , Carolina Bergeling , Bo Bernhardsson

When humans collaborate with each other, they often make decisions by observing others and considering the consequences that their actions may have on the entire team, instead of greedily doing what is best for just themselves. We would…

机器学习 · 计算机科学 2021-12-17 Erdem Bıyık , Anusha Lalitha , Rajarshi Saha , Andrea Goldsmith , Dorsa Sadigh

Caching high-frequency reuse contents at the edge servers in the mobile edge computing (MEC) network omits the part of backhaul transmission and further releases the pressure of data traffic. However, how to efficiently decide the caching…

网络与互联网体系结构 · 计算机科学 2021-03-02 Yuqi Han , Rui Wang , Jun Wu , Dian Liu , Haoqi Ren

In this paper, we consider a risk-averse multi-armed bandit (MAB) problem where the goal is to learn a policy that minimizes the risk of low expected return, as opposed to maximizing the expected return itself, which is the objective in the…

机器学习 · 计算机科学 2022-09-12 Yi Shen , Jessilyn Dunn , Michael M. Zavlanos

We consider a novel multi-armed bandit framework where the rewards obtained by pulling the arms are functions of a common latent random variable. The correlation between arms due to the common random source can be used to design a…

机器学习 · 统计学 2019-01-31 Samarth Gupta , Gauri Joshi , Osman Yağan

Edge Computing (EC) offers a superior user experience by positioning cloud resources in close proximity to end users. The challenge of allocating edge resources efficiently while maximizing profit for the EC platform remains a sophisticated…

机器学习 · 计算机科学 2023-02-15 Jiaming Cheng , Duong Thuy Anh Nguyen , Lele Wang , Duong Tung Nguyen , Vijay K. Bhargava

We consider contextual linear bandits over networks, a class of sequential decision-making problems where learning occurs simultaneously across multiple locations and the reward distributions share structural similarities while also…

机器学习 · 计算机科学 2025-08-26 Chuyun Deng , Huiwen Jia

In many real-world applications such as recommendation systems, multiple learning agents must balance exploration and exploitation while maintaining safety guarantees to avoid catastrophic failures. We study the stochastic linear bandit…

机器学习 · 计算机科学 2026-02-16 Amirhossein Afsharrad , Ahmadreza Moradipari , Sanjay Lall

In this paper, we study the stochastic multi-armed bandit problem, where the reward is driven by an unknown random variable. We propose a new variant of the Upper Confidence Bound (UCB) algorithm called Hellinger-UCB, which leverages the…

机器学习 · 统计学 2024-04-17 Ruibo Yang , Jiazhou Wang , Andrew Mullhaupt

We propose a multi-agent multi-armed bandit (MA-MAB) framework aimed at ensuring fair outcomes across agents while maximizing overall system performance. A key challenge in this setting is decision-making under limited information about arm…

机器学习 · 计算机科学 2026-01-28 Tianyi Xu , Jiaxin Liu , Nicholas Mattei , Zizhan Zheng

This work formulates model selection as an infinite-armed bandit problem, namely, a problem in which a decision maker iteratively selects one of an infinite number of fixed choices (i.e., arms) when the properties of each choice are only…

神经与进化计算 · 计算机科学 2024-06-21 Margaux Brégère , Julie Keisler

The contextual multi-armed bandit (MAB) problem is crucial in sequential decision-making. A line of research, known as online clustering of bandits, extends contextual MAB by grouping similar users into clusters, utilizing shared features…

机器学习 · 计算机科学 2025-01-03 Zhuohua Li , Maoli Liu , Xiangxiang Dai , John C. S. Lui

The contextual multi-armed bandit (MAB) is a widely used framework for problems requiring sequential decision-making under uncertainty, such as recommendation systems. In applications involving a large number of users, the performance of…

机器学习 · 计算机科学 2025-02-05 Zhiyong Wang , Jiahang Sun , Mingze Kong , Jize Xie , Qinghua Hu , John C. S. Lui , Zhongxiang Dai

We formulate and study a decentralized multi-armed bandit (MAB) problem. There are M distributed players competing for N independent arms. Each arm, when played, offers i.i.d. reward according to a distribution with an unknown parameter. At…

最优化与控制 · 数学 2015-05-14 Keqin Liu , Qing Zhao

In this paper, we study \emph{Federated Bandit}, a decentralized Multi-Armed Bandit problem with a set of $N$ agents, who can only communicate their local data with neighbors described by a connected graph $G$. Each agent makes a sequence…

机器学习 · 计算机科学 2021-04-08 Zhaowei Zhu , Jingxuan Zhu , Ji Liu , Yang Liu

We study a distributed decision-making problem in which multiple agents face the same multi-armed bandit (MAB), and each agent makes sequential choices among arms to maximize its own individual reward. The agents cooperate by sharing their…

最优化与控制 · 数学 2020-08-13 Peter Landgren , Vaibhav Srivastava , Naomi Ehrich Leonard

The multi-armed bandits' framework is the most common platform to study strategies for sequential decision-making problems. Recently, the notion of fairness has attracted a lot of attention in the machine learning community. One can impose…

机器学习 · 计算机科学 2020-12-25 Shaarad A. R , Ambedkar Dukkipati

We consider the Adversarial Multi-Armed Bandits (MAB) problem with unbounded losses, where the algorithms have no prior knowledge on the sizes of the losses. We present UMAB-NN and UMAB-G, two algorithms for non-negative and general…

机器学习 · 统计学 2023-10-04 Mingyu Chen , Xuezhou Zhang

We define a general framework for a large class of combinatorial multi-armed bandit (CMAB) problems, where subsets of base arms with unknown distributions form super arms. In each round, a super arm is played and the base arms contained in…

机器学习 · 计算机科学 2016-03-30 Wei Chen , Yajun Wang , Yang Yuan , Qinshi Wang

We obtain the upper bound of the loss function for a strategy in the multi-armed bandit problem with Gaussian distributions of incomes. Considered strategy is an asymptotic generalization of the strategy proposed by J. Bather for the…

统计理论 · 数学 2019-02-04 Alexander Kolnogorov , Sergey Garbar