English
Related papers

Related papers: Why Is My Classifier Discriminatory?

200 papers

To reduce human error and prejudice, many high-stakes decisions have been turned over to machine algorithms. However, recent research suggests that this does not remove discrimination, and can perpetuate harmful stereotypes. While…

Computers and Society · Computer Science 2019-12-18 Yuzi He , Keith Burghardt , Kristina Lerman

Systems based on machine learning may exhibit discriminatory behavior based on sensitive characteristics such as gender, sex, religion, or race. In light of this, various notions of fairness and methods to quantify discrimination were…

Machine Learning · Computer Science 2024-12-23 Drago Plecko , Elias Bareinboim

As algorithmic prediction systems have become widespread, fears that these systems may inadvertently discriminate against members of underrepresented populations have grown. With the goal of understanding fundamental principles that…

Machine Learning · Computer Science 2019-08-02 Sumegha Garg , Michael P. Kim , Omer Reingold

Fair machine learning is receiving an increasing attention in machine learning fields. Researchers in fair learning have developed correlation or association-based measures such as demographic disparity, mistreatment disparity, calibration,…

Computers and Society · Computer Science 2019-11-20 Wen Huang , Yongkai Wu , Lu Zhang , Xintao Wu

There has been concern within the artificial intelligence (AI) community and the broader society regarding the potential lack of fairness of AI-based decision-making systems. Surprisingly, there is little work quantifying and guaranteeing…

Machine Learning · Computer Science 2023-01-31 Wenbin Zhang , Jeremy C. Weiss

How can we build recommender systems to take into account fairness? Real-world recommender systems are often composed of multiple models, built by multiple teams. However, most research on fairness focuses on improving fairness in a single…

Machine Learning · Computer Science 2021-01-27 Xuezhi Wang , Nithum Thain , Anu Sinha , Flavien Prost , Ed H. Chi , Jilin Chen , Alex Beutel

We present an optimization framework for learning a fair classifier in the presence of noisy perturbations in the protected attributes. Compared to prior work, our framework can be employed with a very general class of linear and…

Machine Learning · Computer Science 2021-02-17 L. Elisa Celis , Lingxiao Huang , Vijay Keswani , Nisheeth K. Vishnoi

Fairness metrics are used to assess discrimination and bias in decision-making processes across various domains, including machine learning models and human decision-makers in real-world applications. This involves calculating the…

Machine Learning · Computer Science 2024-11-05 Manh Khoi Duong , Stefan Conrad

Explicit and implicit bias clouds human judgement, leading to discriminatory treatment of minority groups. A fundamental goal of algorithmic fairness is to avoid the pitfalls in human judgement by learning policies that improve the overall…

Machine Learning · Computer Science 2020-11-02 Yuzi He , Keith Burghardt , Siyi Guo , Kristina Lerman

Machine learning algorithms often struggle to eliminate inherent data biases, particularly those arising from unreliable labels, which poses a significant challenge in ensuring fairness. Existing fairness techniques that address label bias…

Machine Learning · Computer Science 2024-12-17 Yixuan Zhang , Zhidong Li , Yang Wang , Fang Chen , Xuhui Fan , Feng Zhou

Automated decision systems are increasingly used to take consequential decisions in problems such as job hiring and loan granting with the hope of replacing subjective human decisions with objective machine learning (ML) algorithms.…

Computers and Society · Computer Science 2023-06-21 Guilherme Alves , Fabien Bernier , Miguel Couceiro , Karima Makhlouf , Catuscia Palamidessi , Sami Zhioua

Machine learning models are increasingly being used in important decision-making software such as approving bank loans, recommending criminal sentencing, hiring employees, and so on. It is important to ensure the fairness of these models so…

Machine Learning · Computer Science 2020-09-23 Sumon Biswas , Hridesh Rajan

Machine learning models have demonstrated promising performance in many areas. However, the concerns that they can be biased against specific demographic groups hinder their adoption in high-stake applications. Thus, it is essential to…

Machine Learning · Computer Science 2023-05-31 Canyu Chen , Yueqing Liang , Xiongxiao Xu , Shangyu Xie , Ashish Kundu , Ali Payani , Yuan Hong , Kai Shu

How can we learn a classifier that is "fair" for a protected or sensitive group, when we do not know if the input to the classifier belongs to the protected group? How can we train such a classifier when data on the protected group is…

Machine Learning · Computer Science 2017-07-10 Alex Beutel , Jilin Chen , Zhe Zhao , Ed H. Chi

The wide spread usage of automated data-driven decision support systems has raised a lot of concerns regarding accountability and fairness of the employed models in the absence of human supervision. Existing fairness-aware approaches tackle…

Machine Learning · Computer Science 2020-01-24 Vasileios Iosifidis , Thi Ngoc Han Tran , Eirini Ntoutsi

As the decisions made or influenced by machine learning models increasingly impact our lives, it is crucial to detect, understand, and mitigate unfairness. But even simply determining what "unfairness" should mean in a given context is…

Machine Learning · Computer Science 2020-10-16 Tom Begley , Tobias Schwedes , Christopher Frye , Ilya Feige

As an important problem in modern data analytics, classification has witnessed varieties of applications from different domains. Different from conventional classification approaches, fair classification concerns the issues of unintentional…

Machine Learning · Statistics 2020-12-25 Qing Ye , Weijun Xie

Machine learning (ML) algorithms are increasingly deployed to make critical decisions in socioeconomic applications such as finance, criminal justice, and autonomous driving. However, due to their data-driven and pattern-seeking nature, ML…

Software Engineering · Computer Science 2026-01-08 Verya Monjezi , Ashish Kumar , Ashutosh Trivedi , Gang Tan , Saeid Tizpaz-Niari

In recent years, machine learning algorithms have become ubiquitous in a multitude of high-stakes decision-making applications. The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to…

Machine Learning · Computer Science 2022-07-14 José Pombal , André F. Cruz , João Bravo , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

In consequential domains such as recidivism prediction, facility inspection, and benefit assignment, it's important for individuals to know the decision-relevant information for the model's prediction. In addition, predictions should be…

Artificial Intelligence · Computer Science 2022-02-11 Moniba Keymanesh , Tanya Berger-Wolf , Micha Elsner , Srinivasan Parthasarathy