English
Related papers

Related papers: Group Meritocratic Fairness in Linear Contextual B…

200 papers

Fairness has emerged as an important consideration in algorithmic decision-making. Unfairness occurs when an agent with higher merit obtains a worse outcome than an agent with lower merit. Our central point is that a primary cause of…

Machine Learning · Computer Science 2021-11-11 Ashudeep Singh , David Kempe , Thorsten Joachims

We consider a setting in which a group of agents share resources that must be allocated among them in each discrete time period. Agents have time-varying demands and derive constant marginal utility from each unit of resource received up to…

Computer Science and Game Theory · Computer Science 2026-01-27 Seyed Majid Zahedi , Rupert Freeman

Sequential Social Dilemmas (SSDs) provide a key framework for studying how cooperation emerges when individual incentives conflict with collective welfare. In Multi-Agent Reinforcement Learning, these problems are often addressed by…

Machine Learning · Computer Science 2026-02-18 Alper Demir , Hüseyin Aydın , Kale-ab Abebe Tessera , David Abel , Stefano V. Albrecht

We consider the model selection task in the stochastic contextual bandit setting. Suppose we are given a collection of base contextual bandit algorithms. We provide a master algorithm that combines them and achieves the same performance, up…

Machine Learning · Computer Science 2020-06-09 Aurélien F. Bibaut , Antoine Chambaz , Mark J. van der Laan

We consider the contextual bandit problem on general action and context spaces, where the learner's rewards depend on their selected actions and an observable context. This generalizes the standard multi-armed bandit to the case where side…

Machine Learning · Statistics 2023-01-03 Moise Blanchard , Steve Hanneke , Patrick Jaillet

We consider the kernelized contextual bandit problem with a large feature space. This problem involves $K$ arms, and the goal of the forecaster is to maximize the cumulative rewards through learning the relationship between the contexts and…

Machine Learning · Statistics 2025-05-21 Shogo Iwazaki , Junpei Komiyama , Masaaki Imaizumi

We study the problem of contextual combinatorial semi-bandits, where input contexts are mapped into subsets of size $m$ of a collection of $K$ possible actions. In each round, the learner observes the realized reward of the predicted…

Machine Learning · Computer Science 2026-02-24 Liad Erez , Tomer Koren

We study sequential decision making in environments where rewards are only partially observed, but can be modeled as a function of observed contexts and the chosen action by the decision maker. This setting, known as contextual bandits,…

Methodology · Statistics 2015-03-11 Miroslav Dudík , Dumitru Erhan , John Langford , Lihong Li

Contextual pricing strategies are prevalent in online retailing, where the seller adjusts prices based on products' attributes and buyers' characteristics. Although such strategies can enhance seller's profits, they raise concerns about…

Computer Science and Game Theory · Computer Science 2026-03-17 Pangpang Liu , Will Wei Sun

We study the stochastic combinatorial semi-bandit problem with unrestricted feedback delays under merit-based fairness constraints. This is motivated by applications such as crowdsourcing, and online advertising, where immediate feedback is…

Machine Learning · Computer Science 2024-07-30 Ziqun Chen , Kechao Cai , Zhuoyue Chen , Jinbei Zhang , John C. S. Lui

In this paper we consider the contextual multi-armed bandit problem for linear payoffs under a risk-averse criterion. At each round, contexts are revealed for each arm, and the decision maker chooses one arm to pull and receives the…

Machine Learning · Computer Science 2022-06-28 Yifan Lin , Yuhao Wang , Enlu Zhou

Machine learning systems are increasingly being used to make impactful decisions such as loan applications and criminal justice risk assessments, and as such, ensuring fairness of these systems is critical. This is often challenging as the…

Machine Learning · Computer Science 2020-12-18 YooJung Choi , Meihua Dang , Guy Van den Broeck

We study the problem of estimating the expected reward of the optimal policy in the stochastic disjoint linear bandit setting. We prove that for certain settings it is possible to obtain an accurate estimate of the optimal policy value even…

Machine Learning · Computer Science 2019-12-17 Weihao Kong , Gregory Valiant , Emma Brunskill

The fair-ranking problem, which asks to rank a given set of items to maximize utility subject to group fairness constraints, has received attention in the fairness, information retrieval, and machine learning literature. Recent works,…

Machine Learning · Computer Science 2022-12-01 Anay Mehrotra , Nisheeth K. Vishnoi

We consider the multi-armed bandit setting with a twist. Rather than having just one decision maker deciding which arm to pull in each round, we have $n$ different decision makers (agents). In the simple stochastic setting, we show that a…

Machine Learning · Computer Science 2022-02-07 Christopher Jung , Sampath Kannan , Neil Lutz

We consider an online learning problem with one-sided feedback, in which the learner is able to observe the true label only for positively predicted instances. On each round, $k$ instances arrive and receive classification outcomes…

Machine Learning · Computer Science 2022-06-10 Yahav Bechavod , Aaron Roth

We study fairness in social choice settings under single-peaked preferences. Construction and characterization of social choice rules in the single-peaked domain has been extensively studied in prior works. In fact, in the single-peaked…

Computer Science and Game Theory · Computer Science 2022-07-19 Gogulapati Sreedurga , Soumyarup Sadhukhan , Souvik Roy , Yadati Narahari

In sequential decision-making problems involving sensitive attributes like race and gender, reinforcement learning (RL) agents must carefully consider long-term fairness while maximizing returns. Recent works have proposed many different…

Machine Learning · Computer Science 2024-04-30 Zhihong Deng , Jing Jiang , Guodong Long , Chengqi Zhang

Contextual bandits are a form of multi-armed bandit in which the agent has access to predictive side information (known as the context) for each arm at each time step, and have been used to model personalized news recommendation, ad…

Machine Learning · Statistics 2017-05-25 Aniket Anand Deshmukh , Urun Dogan , Clayton Scott

In this paper, we study the prediction of a real-valued target, such as a risk score or recidivism rate, while guaranteeing a quantitative notion of fairness with respect to a protected attribute such as gender or race. We call this class…

Machine Learning · Computer Science 2019-05-31 Alekh Agarwal , Miroslav Dudík , Zhiwei Steven Wu