English
Related papers

Related papers: DCAST: Diverse Class-Aware Self-Training Mitigates…

200 papers

Deep learning models have reached or surpassed human-level performance in the field of medical imaging, especially in disease diagnosis using chest x-rays. However, prior work has found that such classifiers can exhibit biases in the form…

Machine Learning · Computer Science 2022-03-24 Haoran Zhang , Natalie Dullerud , Karsten Roth , Lauren Oakden-Rayner , Stephen Robert Pfohl , Marzyeh Ghassemi

Fairness in machine learning remains challenging due to its ethical complexity, the absence of a universal definition, and the need for context-specific bias metrics. Existing methods still struggle with intersectionality, multiclass…

Machine Learning · Computer Science 2026-05-01 Jeanne Monnier , Thomas George , Frédéric Guyard , Christèle Tarnec , Marios Kountouris

We propose a discrimination-aware learning method to improve both accuracy and fairness of biased face recognition algorithms. The most popular face recognition benchmarks assume a distribution of subjects without paying much attention to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Ignacio Serna , Aythami Morales , Julian Fierrez , Manuel Cebrian , Nick Obradovich , Iyad Rahwan

Unintended bias in Machine Learning can manifest as systemic differences in performance for different demographic groups, potentially compounding existing challenges to fairness in society at large. In this paper, we introduce a suite of…

Machine Learning · Computer Science 2019-05-09 Daniel Borkan , Lucas Dixon , Jeffrey Sorensen , Nithum Thain , Lucy Vasserman

The goal of fairness in classification is to learn a classifier that does not discriminate against groups of individuals based on sensitive attributes, such as race and gender. One approach to designing fair algorithms is to use relaxations…

Machine Learning · Computer Science 2021-06-09 Kirtan Padh , Diego Antognini , Emma Lejal Glaude , Boi Faltings , Claudiu Musat

Deep neural networks trained on biased data often inadvertently learn unintended inference rules, particularly when labels are strongly correlated with biased features. Existing bias mitigation methods typically involve either a)…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Rajeev Ranjan Dwivedi , Priyadarshini Kumari , Vinod K Kurmi

We propose a fairness-aware learning framework that mitigates intersectional subgroup bias associated with protected attributes. Prior research has primarily focused on mitigating one kind of bias by incorporating complex fairness-driven…

Machine Learning · Computer Science 2022-12-27 Narine Kokhlikyan , Bilal Alsallakh , Fulton Wang , Vivek Miglani , Oliver Aobo Yang , David Adkins

Achieving the generalization of an invariant classifier from training domains to shifted test domains while simultaneously considering model fairness is a substantial and complex challenge in machine learning. Existing methods address the…

Machine Learning · Computer Science 2024-08-20 Dong Li , Chen Zhao , Minglai Shao , Wenjun Wang

Language models are prone to dataset biases, known as shortcuts and spurious correlations in data, which often result in performance drop on new data. We present a new debiasing framework called ``FairFlow'' that mitigates dataset biases by…

Machine Learning · Computer Science 2025-03-25 Jiali Cheng , Hadi Amiri

Machine learning models built on datasets containing discriminative instances attributed to various underlying factors result in biased and unfair outcomes. It's a well founded and intuitive fact that existing bias mitigation strategies…

Machine Learning · Computer Science 2022-10-25 Bhushan Chaudhari , Akash Agarwal , Tanmoy Bhowmik

A growing specter in the rise of machine learning is whether the decisions made by machine learning models are fair. While research is already underway to formalize a machine-learning concept of fairness and to design frameworks for…

Machine Learning · Computer Science 2020-09-28 Tao Zhang , Tianqing Zhu , Jing Li , Mengde Han , Wanlei Zhou , Philip S. Yu

The underlying assumption of many machine learning algorithms is that the training data and test data are drawn from the same distributions. However, the assumption is often violated in real world due to the sample selection bias between…

Machine Learning · Computer Science 2021-05-26 Wei Du , Xintao Wu

Models notoriously suffer from dataset biases which are detrimental to robustness and generalization. The identify-emphasize paradigm shows a promising effect in dealing with unknown biases. However, we find that it is still plagued by two…

Machine Learning · Computer Science 2022-11-29 Bowen Zhao , Chen Chen , Qian-Wei Wang , Anfeng He , Shu-Tao Xia

Automated gender classification has important applications in many domains, such as demographic research, law enforcement, online advertising, as well as human-computer interaction. Recent research has questioned the fairness of this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Anoop Krishnan , Ali Almadan , Ajita Rattani

Deep neural networks are highly susceptible to learning biases in visual data. While various methods have been proposed to mitigate such bias, the majority require explicit knowledge of the biases present in the training data in order to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Rebecca S Stone , Nishant Ravikumar , Andrew J Bulpitt , David C Hogg

Rapid development of artificial intelligence (AI) systems amplify many concerns in society. These AI algorithms inherit different biases from humans due to mysterious operational flow and because of that it is becoming adverse in usage. As…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Artem Domnich , Gholamreza Anbarjafari

Student diversity, like academic background, learning styles, career and life goals, ethnicity, age, social and emotional characteristics, course load and work schedule, offers unique opportunities in education, like learning new skills,…

Computers and Society · Computer Science 2022-05-02 Alex Doboli , Simona Doboli , Ryan Duke , Sangjin Hong , Wendy Tang

In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented…

Machine Learning · Computer Science 2021-05-11 Yan Zhou , Murat Kantarcioglu , Chris Clifton

Machine learning has become more important in real-life decision-making but people are concerned about the ethical problems it may bring when used improperly. Recent work brings the discussion of machine learning fairness into the causal…

Machine Learning · Statistics 2022-02-28 Haoyu Chen , Wenbin Lu , Rui Song , Pulak Ghosh

Current AI regulations require discarding sensitive features (e.g., gender, race, religion) in the algorithm's decision-making process to prevent unfair outcomes. However, even without sensitive features in the training set, algorithms can…

Machine Learning · Computer Science 2023-08-29 Giandomenico Cornacchia , Vito Walter Anelli , Fedelucio Narducci , Azzurra Ragone , Eugenio Di Sciascio