English
Related papers

Related papers: Learning Fair Division from Bandit Feedback

200 papers

The fair allocation of indivisible resources is a fundamental problem. Existing research has developed various allocation mechanisms or algorithms to satisfy different fairness notions. For example, round robin (RR) was proposed to meet the…

Artificial Intelligence · Computer Science 2025-05-13 Ryota Maruo , Koh Takeuchi , Hisashi Kashima

How should a robot that collaborates with multiple people decide upon the distribution of resources (e.g. social attention, or parts needed for an assembly)? People are uniquely attuned to how resources are distributed. A decision to…

Artificial Intelligence · Computer Science 2020-12-08 Houston Claure , Yifang Chen , Jignesh Modi , Malte Jung , Stefanos Nikolaidis

We introduce the factored bandits model, which is a framework for learning with limited (bandit) feedback, where actions can be decomposed into a Cartesian product of atomic actions. Factored bandits incorporate rank-1 bandits as a special…

Machine Learning · Computer Science 2018-10-30 Julian Zimmert , Yevgeny Seldin

Recently a multi-agent variant of the classical multi-armed bandit was proposed to tackle fairness issues in online learning. Inspired by a long line of work in social choice and economics, the goal is to optimize the Nash social welfare…

Machine Learning · Computer Science 2022-09-27 Matthew Jones , Huy Lê Nguyen , Thy Nguyen

In an attempt to make algorithms fair, the machine learning literature has largely focused on equalizing decisions, outcomes, or error rates across race or gender groups. To illustrate, consider a hypothetical government rideshare program…

Machine Learning · Computer Science 2024-02-14 Alex Chohlas-Wood , Madison Coots , Henry Zhu , Emma Brunskill , Sharad Goel

In networked environments, users frequently share recommendations about content, products, services, and courses of action with others. The extent to which such recommendations are successful and adopted is highly contextual, dependent on…

Machine Learning · Computer Science 2025-10-23 Ahmed Sayeed Faruk , Mohammad Shahverdikondori , Elena Zheleva

Motivated by problems of learning to rank long item sequences, we introduce a variant of the cascading bandit model that considers flexible length sequences with varying rewards and losses. We formulate two generative models for this…

Machine Learning · Computer Science 2022-09-05 Anirban Santara , Claudio Gentile , Gaurav Aggarwal , Shuai Li

Traditional online learning models are typically initialized from scratch. By contrast, contemporary real-world applications often have access to historical datasets that can potentially enhanced the online learning processes. We study how…

Machine Learning · Computer Science 2025-12-19 Wang Chi Cheung , Lixing Lyu

Sequential decision-making under uncertainty often involves multiple agents learning which actions (arms) yield the highest rewards through repeated interaction with a stochastic environment. This setting is commonly modeled by cooperative…

Systems and Control · Electrical Eng. & Systems 2026-03-25 Evagoras Makridis , Themistoklis Charalambous

We consider the problem of episodic reinforcement learning where there are multiple stakeholders with different reward functions. Our goal is to output a policy that is socially fair with respect to different reward functions. Prior works…

Machine Learning · Computer Science 2023-02-06 Debmalya Mandal , Jiarui Gan

We propose a new partial-observability model for online learning problems where the learner, besides its own loss, also observes some noisy feedback about the other actions, depending on the underlying structure of the problem. We represent…

Machine Learning · Computer Science 2026-04-16 Tomáš Kocák , Gergely Neu , Michal Valko

We consider distributed linear bandits where $M$ agents learn collaboratively to minimize the overall cumulative regret incurred by all agents. Information exchange is facilitated by a central server, and both the uplink and downlink…

Machine Learning · Computer Science 2025-11-17 Sudeep Salgia , Qing Zhao

Multi-armed bandit problems are receiving a great deal of attention because they adequately formalize the exploration-exploitation trade-offs arising in several industrially relevant applications, such as online advertisement and, more…

Machine Learning · Computer Science 2013-11-05 Nicolò Cesa-Bianchi , Claudio Gentile , Giovanni Zappella

A contextual bandit problem is studied in a highly non-stationary environment, which is ubiquitous in various recommender systems due to the time-varying interests of users. Two models with disjoint and hybrid payoffs are considered to…

Machine Learning · Computer Science 2020-03-03 Xiao Xu , Fang Dong , Yanghua Li , Shaojian He , Xin Li

This paper examines whether widely used online learning algorithms in pricing can independently reach competitive outcomes or instead foster tacit collusion. This issue has drawn considerable attention from competition regulators as…

Computer Science and Game Theory · Computer Science 2025-11-25 Martin Bichler , Julius Durmann , Matthias Oberlechner

We consider the problem of learning personalized decision policies from observational bandit feedback data across multiple heterogeneous data sources. In our approach, we introduce a novel regret analysis that establishes finite-sample…

Machine Learning · Computer Science 2024-10-14 Aldo Gael Carranza , Susan Athey

We consider the problem of designing contextual bandit algorithms in the ``cross-learning'' setting of Balseiro et al., where the learner observes the loss for the action they play in all possible contexts, not just the context of the…

Machine Learning · Computer Science 2024-01-04 Jon Schneider , Julian Zimmert

Unconscious bias has been shown to influence how we assess our peers, with consequences for hiring, promotions and admissions. In this work, we focus on affinity bias, the component of unconscious bias which leads us to prefer people who…

Machine Learning · Statistics 2025-03-10 Matthew Faw , Constantine Caramanis , Jessica Hoffmann

We present online boosting algorithms for multiclass classification with bandit feedback, where the learner only receives feedback about the correctness of its prediction. We propose an unbiased estimate of the loss using a randomized…

Machine Learning · Statistics 2019-02-26 Daniel T. Zhang , Young Hun Jung , Ambuj Tewari

We study a distributed decision-making problem in which multiple agents face the same multi-armed bandit (MAB), and each agent makes sequential choices among arms to maximize its own individual reward. The agents cooperate by sharing their…

Optimization and Control · Mathematics 2020-08-13 Peter Landgren , Vaibhav Srivastava , Naomi Ehrich Leonard