English
Related papers

Related papers: Benign Shortcut for Debiasing: Fair Visual Recogni…

200 papers

Controlling the patterns a model learns is essential to preventing reliance on irrelevant or misleading features. Such reliance on irrelevant features, often called shortcut features, has been observed across domains, including medical…

Machine Learning · Computer Science 2025-09-23 Mihnea Ghitu , Vihari Piratla , Matthew Wicker

Recent discoveries have revealed that deep neural networks might behave in a biased manner in many real-world scenarios. For instance, deep networks trained on a large-scale face recognition dataset CelebA tend to predict blonde hair for…

Machine Learning · Computer Science 2023-11-06 Ruizhe Chen , Jianfei Yang , Huimin Xiong , Jianhong Bai , Tianxiang Hu , Jin Hao , Yang Feng , Joey Tianyi Zhou , Jian Wu , Zuozhu Liu

A variety of fairness constraints have been proposed in the literature to mitigate group-level statistical bias. Their impacts have been largely evaluated for different groups of populations corresponding to a set of sensitive attributes,…

Machine Learning · Computer Science 2022-07-01 Jialu Wang , Xin Eric Wang , Yang Liu

Biases in the dataset often enable the model to achieve high performance on in-distribution data, while poorly performing on out-of-distribution data. To mitigate the detrimental effect of the bias on the networks, previous works have…

Computation and Language · Computer Science 2023-12-07 Eojin Jeon , Mingyu Lee , Juhyeong Park , Yeachan Kim , Wing-Lam Mok , SangKeun Lee

The growing capability and accessibility of machine learning has led to its application to many real-world domains and data about people. Despite the benefits algorithmic systems may bring, models can reflect, inject, or exacerbate implicit…

Machine Learning · Computer Science 2021-10-28 Ángel Alexander Cabrera , Will Epperson , Fred Hohman , Minsuk Kahng , Jamie Morgenstern , Duen Horng Chau

Removing bias while keeping all task-relevant information is challenging for fair representation learning methods since they would yield random or degenerate representations w.r.t. labels when the sensitive attributes correlate with labels.…

Machine Learning · Computer Science 2022-08-02 Yixuan Zhang , Feng Zhou , Zhidong Li , Yang Wang , Fang Chen

Machine learning models built on datasets containing discriminative instances attributed to various underlying factors result in biased and unfair outcomes. It's a well founded and intuitive fact that existing bias mitigation strategies…

Machine Learning · Computer Science 2022-10-25 Bhushan Chaudhari , Akash Agarwal , Tanmoy Bhowmik

While Diffusion Models (DM) exhibit remarkable performance across various image generative tasks, they nonetheless reflect the inherent bias presented in the training set. As DMs are now widely used in real-world applications, these biases…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Yilei Jiang , Weihong Li , Yiyuan Zhang , Minghong Cai , Xiangyu Yue

Although many fairness criteria have been proposed to ensure that machine learning algorithms do not exhibit or amplify our existing social biases, these algorithms are trained on datasets that can themselves be statistically biased. In…

Machine Learning · Computer Science 2023-05-04 Yiqiao Liao , Parinaz Naghizadeh

The performance of algorithmic decision rules is largely dependent on the quality of training datasets available to them. Biases in these datasets can raise economic and ethical concerns due to the resulting algorithms' disparate treatment…

Machine Learning · Computer Science 2025-04-14 Yifan Yang , Yang Liu , Parinaz Naghizadeh

Machine learning models have achieved widespread success but often inherit and amplify historical biases, resulting in unfair outcomes. Traditional fairness methods typically impose constraints at the prediction level, without addressing…

Machine Learning · Statistics 2026-02-10 Enze Shi , Pankaj Bhagwat , Zhixian Yang , Linglong Kong , Bei Jiang

We propose a fairness-aware learning framework that mitigates intersectional subgroup bias associated with protected attributes. Prior research has primarily focused on mitigating one kind of bias by incorporating complex fairness-driven…

Machine Learning · Computer Science 2022-12-27 Narine Kokhlikyan , Bilal Alsallakh , Fulton Wang , Vivek Miglani , Oliver Aobo Yang , David Adkins

Human society had a long history of suffering from cognitive biases leading to social prejudices and mass injustice. The prevalent existence of cognitive biases in large volumes of historical data can pose a threat of being manifested as…

Computers and Society · Computer Science 2020-07-29 Procheta Sen , Debasis Ganguly

While task-agnostic debiasing provides notable generalizability and reduced reliance on downstream data, its impact on language modeling ability and the risk of relearning social biases from downstream task-specific data remain as the two…

Computation and Language · Computer Science 2024-06-07 Guangliang Liu , Milad Afshari , Xitong Zhang , Zhiyu Xue , Avrajit Ghosh , Bidhan Bashyal , Rongrong Wang , Kristen Johnson

Research has shown that, machine learning models might inherit and propagate undesired social biases encoded in the data. To address this problem, fair training algorithms are developed. However, most algorithms assume we know…

Machine Learning · Computer Science 2022-04-12 Mustafa Safa Ozdayi , Murat Kantarcioglu , Rishabh Iyer

Most works on gender bias focus on intrinsic bias -- removing traces of information about a protected group from the model's internal representation. However, these works are often disconnected from the impact of such debiasing on…

Computation and Language · Computer Science 2024-06-04 Bar Iluz , Yanai Elazar , Asaf Yehudai , Gabriel Stanovsky

Deep neural networks are susceptible to learn biased models with entangled feature representations, which may lead to subpar performances on various downstream tasks. This is particularly true for under-represented classes, where a lack of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Sanghyeok Chu , Dongwan Kim , Bohyung Han

In the social sciences, it is often necessary to debias studies and surveys before valid conclusions can be drawn. Debiasing algorithms enable the computational removal of bias using sample weights. However, an issue arises when only a…

Machine Learning · Computer Science 2026-03-03 Tony Hauptmann , Stefan Kramer

In medical image analysis, model predictions can be affected by sensitive attributes, such as race and gender, leading to fairness concerns and potential biases in diagnostic outcomes. To mitigate this, we present a causal modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Bowei Tian , Yexiao He , Meng Liu , Yucong Dai , Ziyao Wang , Shwai He , Guoheng Sun , Zheyu Shen , Wanghao Ye , Yongkai Wu , Ang Li

Fairness in visual recognition is becoming a prominent and critical topic of discussion as recognition systems are deployed at scale in the real world. Models trained from data in which target labels are correlated with protected attributes…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Vikram V. Ramaswamy , Sunnie S. Y. Kim , Olga Russakovsky