中文
相关论文

相关论文: No-Regret Learning for Fair Multi-Agent Social Wel…

200 篇论文

We propose the first regret-based approach to the Graphical Bilinear Bandits problem, where $n$ agents in a graph play a stochastic bilinear bandit game with each of their neighbors. This setting reveals a combinatorial NP-hard problem that…

机器学习 · 计算机科学 2022-10-13 Geovani Rizk , Igor Colin , Albert Thomas , Rida Laraki , Yann Chevaleyre

We study a regret minimization problem with the existence of multiple best/near-optimal arms in the multi-armed bandit setting. We consider the case when the number of arms/actions is comparable or much larger than the time horizon, and…

机器学习 · 统计学 2020-10-23 Yinglun Zhu , Robert Nowak

We study an interesting variant of the stochastic multi-armed bandit problem, called the Fair-SMAB problem, where each arm is required to be pulled for at least a given fraction of the total available rounds. We investigate the interplay…

机器学习 · 计算机科学 2019-07-24 Vishakha Patil , Ganesh Ghalme , Vineet Nair , Y. Narahari

We consider the classic online learning and stochastic multi-armed bandit (MAB) problems, when at each step, the online policy can probe and find out which of a small number ($k$) of choices has better reward (or loss) before making its…

数据结构与算法 · 计算机科学 2022-11-08 Aditya Bhaskara , Sreenivas Gollapudi , Sungjin Im , Kostas Kollias , Kamesh Munagala

We consider the nonstochastic multi-agent multi-armed bandit problem with agents collaborating via a communication network with delays. We show a lower bound for individual regret of all agents. We show that with suitable regularizers and…

机器学习 · 统计学 2023-10-24 Jialin Yi , Milan Vojnović

We study how representation learning can improve the efficiency of bandit problems. We study the setting where we play $T$ linear bandits with dimension $d$ concurrently, and these $T$ bandit tasks share a common $k (\ll d)$ dimensional…

机器学习 · 计算机科学 2021-05-06 Jiaqi Yang , Wei Hu , Jason D. Lee , Simon S. Du

In this paper, we introduce a distributed version of the classical stochastic Multi-Arm Bandit (MAB) problem. Our setting consists of a large number of agents $n$ that collaboratively and simultaneously solve the same instance of $K$ armed…

机器学习 · 计算机科学 2019-11-06 Abishek Sankararaman , Ayalvadi Ganesh , Sanjay Shakkottai

Consider a scenario where a player chooses an action in each round $t$ out of $T$ rounds and observes the incurred cost after a delay of $d_{t}$ rounds. The cost functions and the delay sequence are chosen by an adversary. We show that in a…

机器学习 · 计算机科学 2022-05-16 Ilai Bistritz , Zhengyuan Zhou , Xi Chen , Nicholas Bambos , Jose Blanchet

We study a decentralized cooperative stochastic multi-armed bandit problem with $K$ arms on a network of $N$ agents. In our model, the reward distribution of each arm is the same for each agent and rewards are drawn independently across…

机器学习 · 计算机科学 2019-10-25 David Martínez-Rubio , Varun Kanade , Patrick Rebeschini

We study the problem of $K$-armed dueling bandit for both stochastic and adversarial environments, where the goal of the learner is to aggregate information through relative preferences of pair of decisions points queried in an online…

机器学习 · 计算机科学 2022-02-15 Aadirupa Saha , Pierre Gaillard

This paper investigates stochastic multi-armed bandit algorithms that are robust to adversarial attacks, where an attacker can first observe the learner's action and {then} alter their reward observation. We study two cases of this model,…

机器学习 · 计算机科学 2024-08-19 Xuchuang Wang , Jinhang Zuo , Xutong Liu , John C. S. Lui , Mohammad Hajiesmaili

Consider N cooperative but non-communicating players where each plays one out of M arms for T turns. Players have different utilities for each arm, representable as an NxM matrix. These utilities are unknown to the players. In each turn…

计算机科学与博弈论 · 计算机科学 2020-08-24 Ilai Bistritz , Tavor Z. Baharav , Amir Leshem , Nicholas Bambos

Under the uncoupled learning setup, the last-iterate convergence guarantee towards Nash equilibrium is shown to be impossible in many games. This work studies the last-iterate convergence guarantee in general games toward rationalizability,…

计算机科学与博弈论 · 计算机科学 2023-12-27 Jibang Wu , Haifeng Xu , Fan Yao

We study how the regret guarantees of nonstochastic multi-armed bandits can be improved, if the effective range of the losses in each round is small (e.g. the maximal difference between two losses in a given round). Despite a recent…

机器学习 · 计算机科学 2020-01-03 Nicolò Cesa-Bianchi , Ohad Shamir

We consider the problem of learning in single-player and multiplayer multiarmed bandit models. Bandit problems are classes of online learning problems that capture exploration versus exploitation tradeoffs. In a multiarmed bandit model,…

机器学习 · 统计学 2016-12-02 Naumaan Nayyar , Dileep Kalathil , Rahul Jain

Optimal regret bounds for Multi-Armed Bandit problems are now well documented. They can be classified into two categories based on the growth rate with respect to the time horizon $T$: (i) small, distribution-dependent, bounds of order of…

数据结构与算法 · 计算机科学 2017-04-12 Arthur Flajolet , Patrick Jaillet

In this paper we study the adversarial combinatorial bandit with a known non-linear reward function, extending existing work on adversarial linear combinatorial bandit. {The adversarial combinatorial bandit with general non-linear reward is…

机器学习 · 统计学 2021-01-06 Xi Chen , Yanjun Han , Yining Wang

We study the problem of regret minimization in a multi-armed bandit setup where the agent is allowed to play multiple arms at each round by spreading the resources usually allocated to only one arm. At each iteration the agent selects a…

机器学习 · 计算机科学 2021-06-01 Matias I. Müller , Cristian R. Rojas

We study high-probability regret bounds for adversarial $K$-armed bandits with time-varying feedback graphs over $T$ rounds. For general strongly observable graphs, we develop an algorithm that achieves the optimal regret…

机器学习 · 计算机科学 2023-01-31 Haipeng Luo , Hanghang Tong , Mengxiao Zhang , Yuheng Zhang

Multi-armed Bandit motivates methods with provable upper bounds on regret and also the counterpart lower bounds have been extensively studied in this context. Recently, Multi-agent Multi-armed Bandit has gained significant traction in…

机器学习 · 计算机科学 2023-08-17 Mengfan Xu , Diego Klabjan