English
Related papers

Related papers: Fairness in Reinforcement Learning

200 papers

While implicit feedback (e.g., clicks, dwell times, etc.) is an abundant and attractive source of data for learning to rank, it can produce unfair ranking policies for both exogenous and endogenous reasons. Exogenous reasons typically…

Machine Learning · Computer Science 2021-05-11 Himank Yadav , Zhengxiao Du , Thorsten Joachims

An increasing number of decisions regarding the daily lives of human beings are being controlled by artificial intelligence (AI) algorithms in spheres ranging from healthcare, transportation, and education to college admissions,…

Computers and Society · Computer Science 2020-01-28 Dana Pessach , Erez Shmueli

Human lives are increasingly being affected by the outcomes of automated decision-making systems and it is essential for the latter to be, not only accurate, but also fair. The literature of algorithmic fairness has grown considerably over…

Machine Learning · Computer Science 2022-11-15 Ainhize Barrainkua , Paula Gordaliza , Jose A. Lozano , Novi Quadrianto

Fairness of machine learning algorithms has been of increasing interest. In order to suppress or eliminate discrimination in prediction, various notions as well as approaches have been proposed to impose fairness. Given a notion of…

Machine Learning · Computer Science 2022-02-25 Zeyu Tang , Kun Zhang

How should we decide which fairness criteria or definitions to adopt in machine learning systems? To answer this question, we must study the fairness preferences of actual users of machine learning systems. Stringent parity constraints on…

Artificial Intelligence · Computer Science 2020-12-09 Angie Peng , Jeff Naecker , Ben Hutchinson , Andrew Smart , Nyalleng Moorosi

We consider the problem of reinforcement learning under safety requirements, in which an agent is trained to complete a given task, typically formalized as the maximization of a reward signal over time, while concurrently avoiding…

Machine Learning · Computer Science 2018-09-25 Tu-Hoa Pham , Giovanni De Magistris , Don Joven Agravante , Subhajit Chaudhury , Asim Munawar , Ryuki Tachibana

In standard reinforcement learning (RL), a learning agent seeks to optimize the overall reward. However, many key aspects of a desired behavior are more naturally expressed as constraints. For instance, the designer may want to limit the…

Machine Learning · Computer Science 2021-01-29 Sobhan Miryoosefi , Kianté Brantley , Hal Daumé , Miroslav Dudik , Robert Schapire

In sequential decision-making problems involving sensitive attributes like race and gender, reinforcement learning (RL) agents must carefully consider long-term fairness while maximizing returns. Recent works have proposed many different…

Machine Learning · Computer Science 2024-04-30 Zhihong Deng , Jing Jiang , Guodong Long , Chengqi Zhang

Algorithmic fairness has emerged as a central issue in ML, and it has become standard practice to adjust ML algorithms so that they will satisfy fairness requirements such as Equal Opportunity. In this paper we consider the effects of…

Machine Learning · Computer Science 2025-10-28 Ronen Gradwohl , Eilam Shapira , Moshe Tennenholtz

We consider a setting for Inverse Reinforcement Learning (IRL) where the learner is extended with the ability to actively select multiple environments, observing an agent's behavior on each environment. We first demonstrate that if the…

Artificial Intelligence · Computer Science 2016-01-26 Kareem Amin , Satinder Singh

Machine learning algorithms learn to solve a task, but are unable to improve their ability to learn. Meta-learning methods learn about machine learning algorithms and improve them so that they learn more quickly. However, existing…

Machine Learning · Computer Science 2025-01-28 Calarina Muslimani , Alex Lewandowski , Dale Schuurmans , Matthew E. Taylor , Jun Luo

Fairness is essential for human society, contributing to stability and productivity. Similarly, fairness is also the key for many multi-agent systems. Taking fairness into multi-agent learning could help multi-agent systems become both…

Machine Learning · Computer Science 2019-11-01 Jiechuan Jiang , Zongqing Lu

There is increasing regulatory interest in whether machine learning algorithms deployed in consequential domains (e.g. in criminal justice) treat different demographic groups "fairly." However, there are several proposed notions of…

Theoretical Economics · Economics 2020-02-19 Christopher Jung , Sampath Kannan , Changhwa Lee , Mallesh M. Pai , Aaron Roth , Rakesh Vohra

What does it mean for a machine learning model to be `fair', in terms which can be operationalised? Should fairness consist of ensuring everyone has an equal probability of obtaining some benefit, or should we aim instead to minimise the…

Computers and Society · Computer Science 2021-03-24 Reuben Binns

In an attempt to make algorithms fair, the machine learning literature has largely focused on equalizing decisions, outcomes, or error rates across race or gender groups. To illustrate, consider a hypothetical government rideshare program…

Machine Learning · Computer Science 2024-02-14 Alex Chohlas-Wood , Madison Coots , Henry Zhu , Emma Brunskill , Sharad Goel

Many instances of algorithmic bias are caused by subpopulation shifts. For example, ML models often perform worse on demographic groups that are underrepresented in the training data. In this paper, we study whether enforcing algorithmic…

Machine Learning · Statistics 2021-10-28 Subha Maity , Debarghya Mukherjee , Mikhail Yurochkin , Yuekai Sun

We initiate the study of fair classifiers that are robust to perturbations in the training distribution. Despite recent progress, the literature on fairness has largely ignored the design of fair and robust classifiers. In this work, we…

Machine Learning · Computer Science 2020-11-05 Debmalya Mandal , Samuel Deng , Suman Jana , Jeannette M. Wing , Daniel Hsu

Computers are increasingly used to make decisions that have significant impact in people's lives. Often, these predictions can affect different population subgroups disproportionately. As a result, the issue of fairness has received much…

Access to resources strongly constrains the decisions we make. While we might wish to offer every student a scholarship, or schedule every patient for follow-up meetings with a specialist, limited resources mean that this is not possible.…

Machine Learning · Computer Science 2025-02-11 Sofie Goethals , Eoin Delaney , Brent Mittelstadt , Chris Russell

Predictive algorithms are now used to help distribute a large share of our society's resources and sanctions, such as healthcare, loans, criminal detentions, and tax audits. Under the right circumstances, these algorithms can improve the…

Machine Learning · Computer Science 2023-02-21 Alex Chohlas-Wood , Madison Coots , Sharad Goel , Julian Nyarko