English
Related papers

Related papers: Fair Enough: Standardizing Evaluation and Model Se…

200 papers

Testing machine learning software for ethical bias has become a pressing current concern. In response, recent research has proposed a plethora of new fairness metrics, for example, the dozens of fairness metrics in the IBM AIF360 toolkit.…

Machine Learning · Computer Science 2022-03-22 Suvodeep Majumder , Joymallya Chakraborty , Gina R. Bai , Kathryn T. Stolee , Tim Menzies

In recent years, machine learning techniques have been increasingly applied in sensitive decision making processes, raising fairness concerns. Past research has shown that machine learning may reproduce and even exacerbate human bias due to…

Machine Learning · Computer Science 2019-05-16 Benjamin Paaßen , Astrid Bunge , Carolin Hainke , Leon Sindelar , Matthias Vogelsang

As machine learning increasingly influences critical domains such as credit underwriting, public policy, and talent acquisition, ensuring compliance with fairness constraints is both a legal and ethical imperative. This paper introduces a…

Machine Learning · Computer Science 2025-04-24 Léandre Eberhard , Nirek Sharma , Filipp Shelobolin , Aalok Ganesh Shanbhag

We survey 146 papers analyzing "bias" in NLP systems, finding that their motivations are often vague, inconsistent, and lacking in normative reasoning, despite the fact that analyzing "bias" is an inherently normative process. We further…

Computation and Language · Computer Science 2020-06-01 Su Lin Blodgett , Solon Barocas , Hal Daumé , Hanna Wallach

The increasing use of Machine Learning (ML) software can lead to unfair and unethical decisions, thus fairness bugs in software are becoming a growing concern. Addressing these fairness bugs often involves sacrificing ML performance, such…

Software Engineering · Computer Science 2026-03-17 Zichong Wang , Yang Zhou , David Lo , Wenbin Zhang

Ensuring that machine learning (ML) models are safe, effective, and equitable across all patients is critical for clinical decision-making and for preventing the amplification of existing health disparities. In this work, we examine how…

Machine Learning · Computer Science 2025-05-28 Jianhui Gao , Benson Chou , Zachary R. McCaw , Hilary Thurston , Paul Varghese , Chuan Hong , Jessica Gronsbell

We study fairness in Machine Learning (FairML) through the lens of attribute-based explanations generated for machine learning models. Our hypothesis is: Biased Models have Biased Explanations. To establish that, we first translate existing…

Machine Learning · Computer Science 2020-12-22 Aditya Jain , Manish Ravula , Joydeep Ghosh

Fairness in machine learning (ML) has a critical importance for building trustworthy machine learning system as artificial intelligence (AI) systems increasingly impact various aspects of society, including healthcare decisions and legal…

Machine Learning · Computer Science 2025-06-19 Modar Sulaiman , Kallol Roy

The rapid growth of data in the recent years has led to the development of complex learning algorithms that are often used to make decisions in real world. While the positive impact of the algorithms has been tremendous, there is a need to…

Machine Learning · Computer Science 2022-01-03 Ankit Kulshrestha , Ilya Safro

Decision making in crucial applications such as lending, hiring, and college admissions has witnessed increasing use of algorithmic models and techniques as a result of a confluence of factors such as ubiquitous connectivity, ability to…

Artificial Intelligence · Computer Science 2020-09-08 G Roshan Lal , Sahin Cem Geyik , Krishnaram Kenthapadi

Existing work on fairness typically focuses on making known machine learning algorithms fairer. Fair variants of classification, clustering, outlier detection and other styles of algorithms exist. However, an understudied area is the topic…

Artificial Intelligence · Computer Science 2022-09-27 Ian Davidson , S. S. Ravi

Despite the rapid development and great success of machine learning models, extensive studies have exposed their disadvantage of inheriting latent discrimination and societal bias from the training data. This phenomenon hinders their…

Machine Learning · Computer Science 2021-12-30 Tianxiang Zhao , Enyan Dai , Kai Shu , Suhang Wang

Models for natural language understanding (NLU) tasks often rely on the idiosyncratic biases of the dataset, which make them brittle against test cases outside the training distribution. Recently, several proposed debiasing methods are…

Computation and Language · Computer Science 2020-05-04 Prasetya Ajie Utama , Nafise Sadat Moosavi , Iryna Gurevych

As machine learning algorithms grow in popularity and diversify to many industries, ethical and legal concerns regarding their fairness have become increasingly relevant. We explore the problem of algorithmic fairness, taking an…

Machine Learning · Computer Science 2021-01-01 Joshua Lee , Yuheng Bu , Prasanna Sattigeri , Rameswar Panda , Gregory Wornell , Leonid Karlinsky , Rogerio Feris

Fairness in AI and machine learning systems has become a fundamental problem in the accountability of AI systems. While the need for accountability of AI models is near ubiquitous, healthcare in particular is a challenging field where…

Machine Learning · Computer Science 2021-02-09 Ming Yuan , Vikas Kumar , Muhammad Aurangzeb Ahmad , Ankur Teredesai

As more researchers have become aware of and passionate about algorithmic fairness, there has been an explosion in papers laying out new metrics, suggesting algorithms to address issues, and calling attention to issues in existing…

Machine Learning · Computer Science 2019-01-16 Alex Beutel , Jilin Chen , Tulsee Doshi , Hai Qian , Allison Woodruff , Christine Luu , Pierre Kreitmann , Jonathan Bischof , Ed H. Chi

Training and evaluation of fair classifiers is a challenging problem. This is partly due to the fact that most fairness metrics of interest depend on both the sensitive attribute information and label information of the data points. In many…

Machine Learning · Computer Science 2021-02-18 Pranjal Awasthi , Alex Beutel , Matthaeus Kleindessner , Jamie Morgenstern , Xuezhi Wang

Fair graph learning plays a pivotal role in numerous practical applications. Recently, many fair graph learning methods have been proposed; however, their evaluation often relies on poorly constructed semi-synthetic datasets or substandard…

Machine Learning · Computer Science 2024-06-19 Xiaowei Qian , Zhimeng Guo , Jialiang Li , Haitao Mao , Bingheng Li , Suhang Wang , Yao Ma

Employing Large Language Models (LLM) in various downstream applications such as classification is crucial, especially for smaller companies lacking the expertise and resources required for fine-tuning a model. Fairness in LLMs helps ensure…

Computation and Language · Computer Science 2024-02-29 Garima Chhikara , Anurag Sharma , Kripabandhu Ghosh , Abhijnan Chakraborty

Training ML models which are fair across different demographic groups is of critical importance due to the increased integration of ML in crucial decision-making scenarios such as healthcare and recruitment. Federated learning has been…

Machine Learning · Computer Science 2022-11-28 Yahya H. Ezzeldin , Shen Yan , Chaoyang He , Emilio Ferrara , Salman Avestimehr