中文
相关论文

相关论文: Multi-Objective Multi-Agent Bandits: From Learning…

200 篇论文

This paper studies a new variant of the stochastic multi-armed bandits problem where auxiliary information about the arm rewards is available in the form of control variates. In many applications like queuing and wireless networks, the arm…

机器学习 · 计算机科学 2022-01-19 Arun Verma , Manjesh K. Hanawal

We study the distribution of regret in stochastic multi-armed bandits and episodic reinforcement learning through a unified framework. We formalize a distributional regret bound as a probabilistic guarantee that holds uniformly over all…

机器学习 · 计算机科学 2026-05-08 Harin Lee , Min-hwan Oh

In decentralized cooperative multi-armed bandits (MAB), each agent observes a distinct stream of rewards, and seeks to exchange information with others to select a sequence of arms so as to minimize its regret. Agents in the cooperative…

机器学习 · 计算机科学 2025-06-12 Jingxuan Zhu , Alec Koppel , Alvaro Velasquez , Ji Liu

Contextual multi-armed bandit (MAB) algorithms have been shown promising for maximizing cumulative rewards in sequential decision tasks such as news article recommendation systems, web page ad placement algorithms, and mobile health.…

机器学习 · 统计学 2019-02-01 Gi-Soo Kim , Myunghee Cho Paik

This paper investigates stochastic multi-armed bandit algorithms that are robust to adversarial attacks, where an attacker can first observe the learner's action and {then} alter their reward observation. We study two cases of this model,…

机器学习 · 计算机科学 2024-08-19 Xuchuang Wang , Jinhang Zuo , Xutong Liu , John C. S. Lui , Mohammad Hajiesmaili

In the classical multi-armed bandit problem, instance-dependent algorithms attain improved performance on "easy" problems with a gap between the best and second-best arm. Are similar guarantees possible for contextual bandits? While…

机器学习 · 计算机科学 2020-10-08 Dylan J. Foster , Alexander Rakhlin , David Simchi-Levi , Yunzong Xu

Multi-arm bandit (MAB) and stochastic linear bandit (SLB) are important models in reinforcement learning, and it is well-known that classical algorithms for bandits with time horizon $T$ suffer $\Omega(\sqrt{T})$ regret. In this paper, we…

机器学习 · 计算机科学 2022-05-31 Zongqi Wan , Zhijie Zhang , Tongyang Li , Jialin Zhang , Xiaoming Sun

In this paper, we study the collaborative learning model, which concerns the tradeoff between parallelism and communication overhead in multi-agent multi-armed bandits. For regret minimization in multi-armed bandits, we present the first…

机器学习 · 计算机科学 2023-12-22 Nikolai Karpov , Qin Zhang

The restless bandit problem is one of the most well-studied generalizations of the celebrated stochastic multi-armed bandit problem in decision theory. In its ultimate generality, the restless bandit problem is known to be PSPACE-Hard to…

数据结构与算法 · 计算机科学 2009-02-03 Sudipto Guha , Kamesh Munagala , Peng Shi

Boltzmann exploration is widely used in reinforcement learning to provide a trade-off between exploration and exploitation. Recently, in (Cesa-Bianchi et al., 2017) it has been shown that pure Boltzmann exploration does not perform well…

机器学习 · 计算机科学 2019-04-23 Harsh Gupta , Seo Taek Kong , R. Srikant , Weina Wang

Stochastic linear bandits are a fundamental model for sequential decision making, where an agent selects a vector-valued action and receives a noisy reward with expected value given by an unknown linear function. Although well studied in…

机器学习 · 计算机科学 2025-06-23 Bruce Huang , Ruida Zhou , Lin F. Yang , Suhas Diggavi

We study cooperative stochastic multi-armed bandits with vector-valued rewards under adversarial corruption and limited verification. In each of $T$ rounds, each of $N$ agents selects an arm, the environment generates a clean reward vector,…

机器学习 · 计算机科学 2026-02-23 Ming Shi

Cooperative multi-agent decision making involves a group of agents cooperatively solving learning problems while communicating over a network with delays. In this paper, we consider the kernelised contextual bandit problem, where the reward…

机器学习 · 计算机科学 2020-08-17 Abhimanyu Dubey , Alex Pentland

In multi-armed bandits with network interference (MABNI), the action taken by one node can influence the rewards of others, creating complex interdependence. While existing research on MABNI largely concentrates on minimizing regret, it…

机器学习 · 计算机科学 2025-10-14 Zichen Wang , Haoyang Hong , Chuanhao Li , Haoxuan Li , Zhiheng Zhang , Huazheng Wang

Restless multi-armed bandits (RMAB) have been widely used to model sequential decision making problems with constraints. The decision maker (DM) aims to maximize the expected total reward over an infinite horizon under an "instantaneous…

机器学习 · 计算机科学 2023-12-25 Shufan Wang , Guojun Xiong , Jian Li

The stochastic multi-armed bandit (MAB) problem is a common model for sequential decision problems. In the standard setup, a decision maker has to choose at every instant between several competing arms, each of them provides a scalar random…

机器学习 · 统计学 2021-10-27 Asaf Cassel , Shie Mannor , Assaf Zeevi

Recent advances in wireless radio frequency (RF) energy harvesting allows sensor nodes to increase their lifespan by remotely charging their batteries. The amount of energy harvested by the nodes varies depending on their ambient…

机器学习 · 计算机科学 2020-06-17 Debamita Ghosh , Arun Verma , Manjesh K. Hanawal

In this paper, we provide the first investigation into adaptive combinatorial experimental design, focusing on the trade-off between regret minimization and statistical power in combinatorial multi-armed bandits (CMAB). While minimizing…

机器学习 · 计算机科学 2026-03-02 Hongrui Xie , Junyu Cao , Kan Xu

Multi-armed bandit problems are considered as a paradigm of the trade-off between exploring the environment to find profitable actions and exploiting what is already known. In the stationary case, the distributions of the rewards do not…

统计理论 · 数学 2008-12-18 Aurélien Garivier , Eric Moulines

Efficient selection among multiple generative models is increasingly important in modern generative AI, where sampling from suboptimal models is costly. This problem can be formulated as a multi-armed bandit task. Under diversity-aware…

机器学习 · 计算机科学 2026-03-24 Bahar Dibaei Nia , Farzan Farnia