中文
相关论文

相关论文: Simultaneously Achieving Group Exposure Fairness a…

200 篇论文

Multi-armed Bandit motivates methods with provable upper bounds on regret and also the counterpart lower bounds have been extensively studied in this context. Recently, Multi-agent Multi-armed Bandit has gained significant traction in…

机器学习 · 计算机科学 2023-08-17 Mengfan Xu , Diego Klabjan

In this paper, we consider the stochastic multi-armed bandits problem with adversarial corruptions, where the random rewards of the arms are partially modified by an adversary to fool the algorithm. We apply the policy gradient algorithm…

机器学习 · 计算机科学 2025-02-21 Jiayuan Liu , Siwei Wang , Zhixuan Fang

We consider a stochastic bandit problem with countably many arms that belong to a finite set of types, each characterized by a unique mean reward. In addition, there is a fixed distribution over types which sets the proportion of each type…

机器学习 · 计算机科学 2021-05-25 Anand Kalvit , Assaf Zeevi

In many modern applications, a system must dynamically choose between several adaptive learning algorithms that are trained online. Examples include model selection in streaming environments, switching between trading strategies in finance,…

机器学习 · 计算机科学 2026-01-19 Ilgam Latypov , Alexandra Suvorikova , Alexey Kroshnin , Alexander Gasnikov , Yuriy Dorn

We consider a finite-armed structured bandit problem in which mean rewards of different arms are known functions of a common hidden parameter $\theta^*$. Since we do not place any restrictions of these functions, the problem setting…

机器学习 · 统计学 2021-02-04 Samarth Gupta , Shreyas Chaudhari , Subhojyoti Mukherjee , Gauri Joshi , Osman Yağan

We study a strategic variant of the multi-armed bandit problem, which we coin the strategic click-bandit. This model is motivated by applications in online recommendation where the choice of recommended items depends on both the…

机器学习 · 计算机科学 2023-11-28 Thomas Kleine Buening , Aadirupa Saha , Christos Dimitrakakis , Haifeng Xu

In this paper, we study the behavior of the Upper Confidence Bound-Variance (UCB-V) algorithm for the Multi-Armed Bandit (MAB) problems, a variant of the canonical Upper Confidence Bound (UCB) algorithm that incorporates variance estimates…

机器学习 · 统计学 2025-02-18 Yingying Fan , Yuxuan Han , Jinchi Lv , Xiaocong Xu , Zhengyuan Zhou

The study of collaborative multi-agent bandits has attracted significant attention recently. In light of this, we initiate the study of a new collaborative setting, consisting of $N$ agents such that each agent is learning one of $M$…

机器学习 · 计算机科学 2024-07-04 Ronshee Chawla , Daniel Vial , Sanjay Shakkottai , R. Srikant

We study the Linear Contextual Bandit problem in the hybrid reward setting. In this setting every arm's reward model contains arm specific parameters in addition to parameters shared across the reward models of all the arms. We can reduce…

机器学习 · 计算机科学 2024-09-05 Nirjhar Das , Gaurav Sinha

Multi-armed bandit (MAB) problems are widely applied to online optimization tasks that require balancing exploration and exploitation. In practical scenarios, these tasks often involve multiple conflicting objectives, giving rise to…

机器学习 · 计算机科学 2025-06-17 Mansoor Davoodi , Setareh Maghsudi

A general framework of personalized federated multi-armed bandits (PF-MAB) is proposed, which is a new bandit paradigm analogous to the federated learning (FL) framework in supervised learning and enjoys the features of FL with…

机器学习 · 计算机科学 2021-02-26 Chengshuai Shi , Cong Shen , Jing Yang

We present a formal model of human decision-making in explore-exploit tasks using the context of multi-armed bandit problems, where the decision-maker must choose among multiple options with uncertain rewards. We address the standard…

机器学习 · 计算机科学 2019-12-23 Paul Reverdy , Vaibhav Srivastava , Naomi E. Leonard

In this paper, we formulate the multi-agent graph bandit problem as a multi-agent extension of the graph bandit problem introduced by Zhang, Johansson, and Li [CISS 57, 1-6 (2023)]. In our formulation, $N$ cooperative agents travel on a…

机器学习 · 计算机科学 2024-11-05 Phevos Paschalidis , Runyu Zhang , Na Li

In this paper, we study multi-armed bandits (MAB) and stochastic linear bandits (SLB) with heavy-tailed rewards and quantum reward oracle. Unlike the previous work on quantum bandits that assumes bounded/sub-Gaussian distributions for…

机器学习 · 计算机科学 2023-01-25 Yulian Wu , Chaowen Guan , Vaneet Aggarwal , Di Wang

We study bandit algorithms under data poisoning attacks in a bounded reward setting. We consider a strong attacker model in which the attacker can observe both the selected actions and their corresponding rewards and can contaminate the…

机器学习 · 计算机科学 2022-05-05 Anshuka Rangi , Long Tran-Thanh , Haifeng Xu , Massimo Franceschetti

Continuously learning and leveraging the knowledge accumulated from prior tasks in order to improve future performance is a long standing machine learning problem. In this paper, we study the problem in the multi-armed bandit framework with…

机器学习 · 计算机科学 2020-12-29 Matthieu Jedor , Jonathan Louëdec , Vianney Perchet

Stochastic bandit algorithms are usually analyzed under a mean-reward criterion, yet many problems favor arms with strong upper-tail performance, which we study herein. For a fixed miscoverage level \(\alpha\), the natural upper-tail target…

机器学习 · 计算机科学 2026-05-11 Chengyu Du , Mengfan Xu

Many sequential decision-making problems in communication networks can be modeled as contextual bandit problems, which are natural extensions of the well-known multi-armed bandit problem. In contextual bandit problems, at each time, an…

机器学习 · 计算机科学 2016-05-10 Pranav Sakulkar , Bhaskar Krishnamachari

We consider a sequential stochastic multi-armed bandit problem where the agent interacts with bandit over multiple episodes. The reward distribution of the arms remain constant throughout an episode but can change over different episodes.…

机器学习 · 计算机科学 2024-03-20 Rahul N R , Vaibhav Katewa

We address the problem of \emph{`Internal Regret'} in \emph{Sleeping Bandits} in the fully adversarial setup, as well as draw connections between different existing notions of sleeping regrets in the multiarmed bandits (MAB) literature and…

机器学习 · 计算机科学 2022-10-28 Pierre Gaillard , Aadirupa Saha , Soham Dan