English
Related papers

Related papers: Automatic Fairness Testing of Neural Classifiers t…

200 papers

Fairness-aware learning involves designing algorithms that do not discriminate with respect to some sensitive feature (e.g., race or gender). Existing work on the problem operates under the assumption that the sensitive feature available in…

Machine Learning · Computer Science 2020-01-10 Alexandre Louis Lamy , Ziyuan Zhong , Aditya Krishna Menon , Nakul Verma

A growing specter in the rise of machine learning is whether the decisions made by machine learning models are fair. While research is already underway to formalize a machine-learning concept of fairness and to design frameworks for…

Machine Learning · Computer Science 2020-09-28 Tao Zhang , Tianqing Zhu , Jing Li , Mengde Han , Wanlei Zhou , Philip S. Yu

Data and algorithms have the potential to produce and perpetuate discrimination and disparate treatment. As such, significant effort has been invested in developing approaches to defining, detecting, and eliminating unfair outcomes in…

Machine Learning · Computer Science 2025-02-07 Alexander Asemota , Giles Hooker

As the data-driven decision process becomes dominating for industrial applications, fairness-aware machine learning arouses great attention in various areas. This work proposes fairness penalties learned by neural networks with a simple…

Machine Learning · Statistics 2024-03-12 Jinwon Sohn , Qifan Song , Guang Lin

Fairness-aware learning aims at satisfying various fairness constraints in addition to the usual performance criteria via data-driven machine learning techniques. Most of the research in fairness-aware learning employs the setting of…

Machine Learning · Computer Science 2022-05-23 Pratik Gajane , Akrati Saxena , Maryam Tavakol , George Fletcher , Mykola Pechenizkiy

Artificial intelligence systems, especially those using machine learning, are being deployed in domains from hiring to loan issuance in order to automate these complex decisions. Judging both the effectiveness and fairness of these AI…

Artificial Intelligence · Computer Science 2025-07-04 Disa Sariola , Patrick Button , Aron Culotta , Nicholas Mattei

Fairness in machine learning has received considerable attention. However, most studies on fair learning focus on either supervised learning or unsupervised learning. Very few consider semi-supervised settings. Yet, in reality, most machine…

Machine Learning · Computer Science 2020-09-15 Tao Zhang , Tianqing Zhu , Mengde Han , Jing Li , Wanlei Zhou , Philip S. Yu

Fairness in machine learning seeks to mitigate model bias against individuals based on sensitive features such as sex or age, often caused by an uneven representation of the population in the training data due to selection bias. Notably,…

Machine Learning · Computer Science 2024-10-10 Yasin I. Tepeli , Joana P. Gonçalves

The subject of "fairness" in artificial intelligence (AI) refers to assessing AI algorithms for potential bias based on demographic characteristics such as race and gender, and the development of algorithms to address this bias. Most…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Esther Puyol-Anton , Bram Ruijsink , Stefan K. Piechnik , Stefan Neubauer , Steffen E. Petersen , Reza Razavi , Andrew P. King

Data-driven learning algorithms are employed in many online applications, in which data become available over time, like network monitoring, stock price prediction, job applications, etc. The underlying data distribution might evolve over…

Machine Learning · Computer Science 2021-08-16 Vasileios Iosifidis , Wenbin Zhang , Eirini Ntoutsi

Although deep learning (DL) models have shown great success in many medical image analysis tasks, deployment of the resulting models into real clinical contexts requires: (1) that they exhibit robustness and fairness across different…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Raghav Mehta , Changjian Shui , Tal Arbel

In this paper, we present an empirical study on image recognition fairness, i.e., extreme class accuracy disparity on balanced data like ImageNet. We experimentally demonstrate that classes are not equal and the fairness issue is prevalent…

Machine Learning · Computer Science 2024-03-14 Jiequan Cui , Beier Zhu , Xin Wen , Xiaojuan Qi , Bei Yu , Hanwang Zhang

Machine learning models are extensively being used to make decisions that have a significant impact on human life. These models are trained over historical data that may contain information about sensitive attributes such as race, sex,…

Machine Learning · Computer Science 2020-10-22 Ramanujam Madhavan , Mohit Wadhwa

Deep neural networks (DNNs) have made significant progress, but often suffer from fairness issues, as deep models typically show distinct accuracy differences among certain subgroups (e.g., males and females). Existing research addresses…

Machine Learning · Computer Science 2023-06-28 Tianlin Li , Qing Guo , Aishan Liu , Mengnan Du , Zhiming Li , Yang Liu

As machine learning algorithms have been widely deployed across applications, many concerns have been raised over the fairness of their predictions, especially in high stakes settings (such as facial recognition and medical imaging). To…

Machine Learning · Computer Science 2021-02-16 Valeriia Cherepanova , Vedant Nanda , Micah Goldblum , John P. Dickerson , Tom Goldstein

Artificial intelligence (AI) systems, particularly those based on deep learning models, have increasingly achieved expert-level performance in medical applications. However, there is growing concern that such AI systems may reflect and…

Computation and Language · Computer Science 2025-04-25 Xiuying Chen , Tairan Wang , Juexiao Zhou , Zirui Song , Xin Gao , Xiangliang Zhang

Machine learning models often inherit biases from historical data, raising critical concerns about fairness and accountability. Conventional fairness interventions typically require access to sensitive attributes like gender or race, but…

Machine Learning · Statistics 2026-04-21 Yixiao Lin , James Booth

As learning machines increase their influence on decisions concerning human lives, analyzing their fairness properties becomes a subject of central importance. Yet, our best tools for measuring the fairness of learning systems are rigid…

Machine Learning · Statistics 2022-07-21 David Lopez-Paz , Diane Bouchacourt , Levent Sagun , Nicolas Usunier

A central goal of algorithmic fairness is to reduce bias in automated decision making. An unavoidable tension exists between accuracy gains obtained by using sensitive information (e.g., gender or ethnic group) as part of a statistical…

Machine Learning · Statistics 2020-02-03 Luca Oneto , Michele Donini , Amon Elders , Massimiliano Pontil

Given a discriminating neural network, the problem of fairness improvement is to systematically reduce discrimination without significantly scarifies its performance (i.e., accuracy). Multiple categories of fairness improving methods have…

Machine Learning · Computer Science 2022-09-16 Mengdi Zhang , Jun Sun