中文
相关论文

相关论文: Calibrated Fairness in Bandits

200 篇论文

When an AI system interacts with multiple users, it frequently needs to make allocation decisions. For instance, a virtual agent decides whom to pay attention to in a group setting, or a factory robot selects a worker to deliver a part.…

机器学习 · 计算机科学 2019-12-18 Yifang Chen , Alex Cuellar , Haipeng Luo , Jignesh Modi , Heramb Nemlekar , Stefanos Nikolaidis

We define a general framework for a large class of combinatorial multi-armed bandit (CMAB) problems, where subsets of base arms with unknown distributions form super arms. In each round, a super arm is played and the base arms contained in…

机器学习 · 计算机科学 2016-03-30 Wei Chen , Yajun Wang , Yang Yuan , Qinshi Wang

We study the problem of regret minimization in a multi-armed bandit setup where the agent is allowed to play multiple arms at each round by spreading the resources usually allocated to only one arm. At each iteration the agent selects a…

机器学习 · 计算机科学 2021-06-01 Matias I. Müller , Cristian R. Rojas

Thompson Sampling provides an efficient technique to introduce prior knowledge in the multi-armed bandit problem, along with providing remarkable empirical performance. In this paper, we revisit the Thompson Sampling algorithm under rewards…

机器学习 · 计算机科学 2019-12-09 Abhimanyu Dubey , Alex Pentland

We consider the problem of minimizing the regret in stochastic multi-armed bandit, when the measure of goodness of an arm is not the mean return, but some general function of the mean and the variance.We characterize the conditions under…

机器学习 · 计算机科学 2014-05-06 Alexander Zimin , Rasmus Ibsen-Jensen , Krishnendu Chatterjee

We consider a stochastic bandit problem with infinitely many arms. In this setting, the learner has no chance of trying all the arms even once and has to dedicate its limited number of samples only to a certain number of arms. All previous…

机器学习 · 计算机科学 2015-05-19 Alexandra Carpentier , Michal Valko

This paper is in the field of stochastic Multi-Armed Bandits (MABs), i.e. those sequential selection techniques able to learn online using only the feedback given by the chosen option (a.k.a. $arm$). We study a particular case of the rested…

机器学习 · 统计学 2024-11-28 Marco Fiandri , Alberto Maria Metelli , Francesco Trov`o

This paper considers the multi-armed bandit (MAB) problem and provides a new best-of-both-worlds (BOBW) algorithm that works nearly optimally in both stochastic and adversarial settings. In stochastic settings, some existing BOBW algorithms…

机器学习 · 计算机科学 2022-06-15 Shinji Ito , Taira Tsuchiya , Junya Honda

A matching platform is a system that matches different types of participants, such as companies and job-seekers. In such a platform, merely maximizing the number of matches can result in matches being concentrated on highly popular…

机器学习 · 计算机科学 2026-03-10 Yuki Shibukawa , Koichi Tanaka , Yuta Saito , Shinji Ito

Consider N cooperative but non-communicating players where each plays one out of M arms for T turns. Players have different utilities for each arm, representable as an NxM matrix. These utilities are unknown to the players. In each turn…

计算机科学与博弈论 · 计算机科学 2020-08-24 Ilai Bistritz , Tavor Z. Baharav , Amir Leshem , Nicholas Bambos

Restless Multi-Armed Bandits (RMAB) is an apt model to represent decision-making problems in public health interventions (e.g., tuberculosis, maternal, and child care), anti-poaching planning, sensor monitoring, personalized recommendations…

机器学习 · 计算机科学 2022-07-28 Dexun Li , Pradeep Varakantham

In sequential decision-making scenarios i.e., mobile health recommendation systems revenue management contextual multi-armed bandit algorithms have garnered attention for their performance. But most of the existing algorithms are built on…

机器学习 · 计算机科学 2023-01-24 Mubarrat Chowdhury , Elkhan Ismayilzada , Khalequzzaman Sayem , Gi-Soo Kim

We consider the Max $K$-Armed Bandit problem, where a learning agent is faced with several sources (arms) of items (rewards), and interested in finding the best item overall. At each time step the agent chooses an arm, and obtains a random…

机器学习 · 统计学 2015-08-25 Yahel David , Nahum Shimkin

Motivated by distributed selection problems, we formulate a new variant of multi-player multi-armed bandit (MAB) model, which captures stochastic arrival of requests to each arm, as well as the policy of allocating requests to players. The…

人工智能 · 计算机科学 2024-08-21 Hong Xie , Jinyu Mo , Defu Lian , Jie Wang , Enhong Chen

We study bandit learning in matching markets, where players and arms constitute the two market sides, and the players' utilities are linear in the arm contexts. In each round, new arms arrive with observable contexts. Then, the algorithm…

机器学习 · 计算机科学 2026-05-28 Shiyun Lin , Simon Mauras , Vianney Perchet , Nadav Merlis

We here adopt Bayesian nonparametric mixture models to extend multi-armed bandits in general, and Thompson sampling in particular, to scenarios where there is reward model uncertainty. In the stochastic multi-armed bandit, the reward for…

机器学习 · 统计学 2022-08-26 Iñigo Urteaga , Chris H. Wiggins

Unconscious bias has been shown to influence how we assess our peers, with consequences for hiring, promotions and admissions. In this work, we focus on affinity bias, the component of unconscious bias which leads us to prefer people who…

机器学习 · 统计学 2025-03-10 Matthew Faw , Constantine Caramanis , Jessica Hoffmann

In this paper, we study censored Semi-Bandits, a novel variant of the semi-bandits problem. The learner is assumed to have a fixed amount of resources, which it allocates to the arms at each time step. The loss observed from an arm is…

机器学习 · 计算机科学 2020-03-26 Arun Verma , Manjesh K. Hanawal , Arun Rajkumar , Raman Sankaran

The stochastic multi-armed bandit (MAB) problem is a common model for sequential decision problems. In the standard setup, a decision maker has to choose at every instant between several competing arms, each of them provides a scalar random…

机器学习 · 统计学 2021-10-27 Asaf Cassel , Shie Mannor , Assaf Zeevi

This paper considers the contextual multi-armed bandit (CMAB) problem with fairness and privacy guarantees in a federated environment. We consider merit-based exposure as the desired fair outcome, which provides exposure to each action in…

机器学习 · 计算机科学 2024-02-07 Sambhav Solanki , Shweta Jain , Sujit Gujar