English
Related papers

Related papers: Fair Contextual Multi-Armed Bandits: Theory and Ex…

200 papers

Most bandit policies are designed to either minimize regret in any problem instance, making very few assumptions about the underlying environment, or in a Bayesian sense, assuming a prior distribution over environment parameters. The former…

Machine Learning · Computer Science 2021-01-07 Branislav Kveton , Martin Mladenov , Chih-Wei Hsu , Manzil Zaheer , Csaba Szepesvari , Craig Boutilier

Understanding which parts of the retrieved context contribute to a large language model's generated answer is essential for building interpretable and trustworthy retrieval-augmented generation. We propose a novel framework that formulates…

Artificial Intelligence · Computer Science 2026-04-23 Deng Pan , Keerthiram Murugesan , Ting Hua , Nuno Moniz , Nitesh Chawla

Human-machine complementarity is important when neither the algorithm nor the human yield dominant performance across all instances in a given domain. Most research on algorithmic decision-making solely centers on the algorithm's…

Human-Computer Interaction · Computer Science 2021-12-14 Ruijiang Gao , Maytal Saar-Tsechansky , Maria De-Arteaga , Ligong Han , Min Kyung Lee , Matthew Lease

We study fair multi-agent multi-armed bandit learning under collision-only coordination. Agents cannot communicate explicitly during learning and observe only their own rewards and whether collisions occur when several agents access the…

Machine Learning · Computer Science 2026-05-05 Amir Leshem

We consider a contextual version of multi-armed bandit problem with global knapsack constraints. In each round, the outcome of pulling an arm is a scalar reward and a resource consumption vector, both dependent on the context, and the…

Machine Learning · Computer Science 2016-07-12 Shipra Agrawal , Nikhil R. Devanur , Lihong Li

In this work we consider adversarial contextual bandits with risk constraints. At each round, nature prepares a context, a cost for each arm, and additionally a risk for each arm. The learner leverages the context to pull an arm and then…

Machine Learning · Computer Science 2016-10-18 Wen Sun , Debadeepta Dey , Ashish Kapoor

AI is increasingly used to aid decision-making about the allocation of scarce societal resources, for example housing for homeless people, organs for transplantation, and food donations. Recently, there have been several proposals for how…

Computers and Society · Computer Science 2021-12-03 Sanmay Das

Multiwinner voting rules are used to select a small representative subset of candidates or items from a larger set given the preferences of voters. However, if candidates have sensitive attributes such as gender or ethnicity (when selecting…

Computers and Society · Computer Science 2018-06-20 L. Elisa Celis , Lingxiao Huang , Nisheeth K. Vishnoi

Fair allocation has been studied intensively in both economics and computer science, and fair sharing of resources has aroused renewed interest with the advent of virtualization and cloud computing. Prior work has typically focused on…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-06-15 Danny Dolev , Dror G. Feitelson , Joseph Y. Halpern , Raz Kupferman , Nati Linial

Taking advantage of contextual information can potentially boost the performance of recommender systems. In the era of big data, such side information often has several dimensions. Thus, developing decision-making algorithms to cope with…

Machine Learning · Computer Science 2023-07-26 Saeed Ghoorchian , Evgenii Kortukov , Setareh Maghsudi

We consider a scenario where an agent has multiple available strategies to explore an unknown environment. For each new interaction with the environment, the agent must select which exploration strategy to use. We provide a new…

Machine Learning · Computer Science 2018-08-24 Fabien C. Y. Benureau , Pierre-Yves Oudeyer

As automated decision making and decision assistance systems become common in everyday life, research on the prevention or mitigation of potential harms that arise from decisions made by these systems has proliferated. However, various…

Computers and Society · Computer Science 2023-01-18 Samer B. Nashed , Justin Svegliato , Su Lin Blodgett

We consider settings in which we wish to incentivize myopic agents (such as Airbnb landlords, who may emphasize short-term profits and property safety) to treat arriving clients fairly, in order to prevent overall discrimination against…

Computer Science and Game Theory · Computer Science 2017-05-08 Sampath Kannan , Michael Kearns , Jamie Morgenstern , Mallesh Pai , Aaron Roth , Rakesh Vohra , Z. Steven Wu

Machine-learned systems are in widespread use for making decisions about humans, and it is important that they are fair, i.e., not biased against individuals based on sensitive attributes. We present a general framework of runtime…

Machine Learning · Computer Science 2025-07-08 Thomas A. Henzinger , Mahyar Karimi , Konstantin Kueffner , Kaushik Mallik

A key feature of sequential decision making under uncertainty is a need to balance between exploiting--choosing the best action according to the current knowledge, and exploring--obtaining information about values of other actions. The…

Machine Learning · Computer Science 2021-08-27 Dimitrije Markovic , Hrvoje Stojic , Sarah Schwoebel , Stefan J. Kiebel

Algorithms are now regularly used to decide whether defendants awaiting trial are too dangerous to be released back into the community. In some cases, black defendants are substantially more likely than white defendants to be incorrectly…

Computers and Society · Computer Science 2017-06-13 Sam Corbett-Davies , Emma Pierson , Avi Feller , Sharad Goel , Aziz Huq

Algorithmic fairness is often studied in static or single-agent settings, yet many real-world decision-making systems involve multiple interacting entities whose multi-stage actions jointly influence long-term outcomes. Existing fairness…

We study bandit learning in matching markets, where players and arms constitute the two market sides, and the players' utilities are linear in the arm contexts. In each round, new arms arrive with observable contexts. Then, the algorithm…

Machine Learning · Computer Science 2026-05-28 Shiyun Lin , Simon Mauras , Vianney Perchet , Nadav Merlis

Contextual bandits are online learners that, given an input, select an arm and receive a reward for that arm. They use the reward as a learning signal and aim to maximize the total reward over the inputs. Contextual bandits are commonly…

Machine Learning · Computer Science 2020-02-14 Awni Hannun , Brian Knott , Shubho Sengupta , Laurens van der Maaten

This paper establishes the equivalence between cognitive medium access and the competitive multi-armed bandit problem. First, the scenario in which a single cognitive user wishes to opportunistically exploit the availability of empty…

Information Theory · Computer Science 2007-10-09 Lifeng Lai , Hesham El Gamal , Hai Jiang , H. Vincent Poor