English
Related papers

Related papers: Improving Fairness using Vision-Language Driven Im…

200 papers

Deep learning-based facial recognition systems have experienced increased media attention due to exhibiting unfair behavior. Large enterprises, such as IBM, shut down their facial recognition and age prediction systems as a consequence. Age…

Computer Vision and Pattern Recognition · Computer Science 2021-11-17 Yushi Cao , David Berend , Palina Tolmach , Guy Amit , Moshe Levy , Yang Liu , Asaf Shabtai , Yuval Elovici

Deep learning models often learn to make predictions that rely on sensitive social attributes like gender and race, which poses significant fairness risks, especially in societal applications, e.g., hiring, banking, and criminal justice.…

Machine Learning · Computer Science 2022-11-03 Yi Zhang , Jitao Sang , Junyang Wang

In this work, we propose {\it Fair-CDA}, a fine-grained data augmentation strategy for imposing fairness constraints. We use a feature disentanglement method to extract the features highly related to the sensitive attributes. Then we show…

Machine Learning · Computer Science 2023-04-04 Rui Sun , Fengwei Zhou , Zhenhua Dong , Chuanlong Xie , Lanqing Hong , Jiawei Li , Rui Zhang , Zhen Li , Zhenguo Li

Numerous studies have revealed that deep learning-based medical image classification models may exhibit bias towards specific demographic attributes, such as race, gender, and age. Existing bias mitigation methods often achieve high level…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Qingpeng Kong , Ching-Hao Chiu , Dewen Zeng , Yu-Jen Chen , Tsung-Yi Ho , Jingtong hu , Yiyu Shi

Generative AI models have recently achieved astonishing results in quality and are consequently employed in a fast-growing number of applications. However, since they are highly data-driven, relying on billion-sized datasets randomly…

Computer vision models learn to perform a task by capturing relevant statistics from training data. It has been shown that models learn spurious age, gender, and race correlations when trained for seemingly unrelated tasks like activity…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Zeyu Wang , Klint Qinami , Ioannis Christos Karakozis , Kyle Genova , Prem Nair , Kenji Hata , Olga Russakovsky

Deep learning has achieved remarkable success in image classification and segmentation tasks. However, fairness concerns persist, as models often exhibit biases that disproportionately affect demographic groups defined by sensitive…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Milad Masroor , Tahir Hassan , Yu Tian , Kevin Wells , David Rosewarne , Thanh-Toan Do , Gustavo Carneiro

Despite being responsible for state-of-the-art results in several computer vision and natural language processing tasks, neural networks have faced harsh criticism due to some of their current shortcomings. One of them is that neural…

Model fairness is an essential element for Trustworthy AI. While many techniques for model fairness have been proposed, most of them assume that the training and deployment data distributions are identical, which is often not true in…

Machine Learning · Computer Science 2023-02-07 Yuji Roh , Kangwook Lee , Steven Euijong Whang , Changho Suh

As the use of artificial intelligence rapidly increases, the development of trustworthy artificial intelligence has become important. However, recent studies have shown that deep neural networks are susceptible to learn spurious…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Yooshin Cho , Hanbyel Cho , Janghyeon Lee , HyeongGwon Hong , Jaesung Ahn , Junmo Kim

Deep neural networks often rely on spurious correlations in training data, leading to biased or unfair predictions in safety-critical domains such as medicine and autonomous driving. While conventional bias mitigation typically requires…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Sai Siddhartha Chary Aylapuram , Veeraraju Elluru , Shivang Agarwal

Face recognition systems are widely deployed in safety-critical applications, including law enforcement, yet they exhibit bias across a range of socio-demographic dimensions, such as gender and race. Conventional wisdom dictates that model…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Samuel Dooley , Rhea Sanjay Sukthanker , John P. Dickerson , Colin White , Frank Hutter , Micah Goldblum

Deep Learning models have achieved remarkable success. Training them is often accelerated by building on top of pre-trained models which poses the risk of perpetuating encoded biases. Here, we investigate biases in the representations of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Valerie Krug , Sebastian Stober

Deep learning models have achieved great success in automating skin lesion diagnosis. However, the ethnic disparity in these models' predictions, where lesions on darker skin types are usually underrepresented and have lower diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Siyi Du , Ben Hers , Nourhan Bayasi , Ghassan Hamarneh , Rafeef Garbi

Fairness in deep learning models trained with high-dimensional inputs and subjective labels remains a complex and understudied area. Facial emotion recognition, a domain where datasets are often racially imbalanced, can lead to models that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Alex Fan , Xingshuo Xiao , Peter Washington

Identifying and mitigating bias in deep learning algorithms has gained significant popularity in the past few years due to its impact on the society. Researchers argue that models trained on balanced datasets with good representation…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Puspita Majumdar , Surbhi Mittal , Richa Singh , Mayank Vatsa

Data-driven predictive solutions predominant in commercial applications tend to suffer from biases and stereotypes, which raises equity concerns. Prediction models may discover, use, or amplify spurious correlations based on gender or other…

Computation and Language · Computer Science 2022-11-28 Abdelrahman Zayed , Prasanna Parthasarathi , Goncalo Mordido , Hamid Palangi , Samira Shabanian , Sarath Chandar

Published research highlights the presence of demographic bias in automated facial attribute classification algorithms, particularly impacting women and individuals with darker skin tones. Existing bias mitigation techniques typically…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Ayesha Manzoor , Ajita Rattani

Deep learning is increasingly being used in high-stake decision making applications that affect individual lives. However, deep learning models might exhibit algorithmic discrimination behaviors with respect to protected groups, potentially…

Machine Learning · Computer Science 2020-03-20 Mengnan Du , Fan Yang , Na Zou , Xia Hu

Despite being widely used, face recognition models suffer from bias: the probability of a false positive (incorrect face match) strongly depends on sensitive attributes such as the ethnicity of the face. As a result, these models can…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Tiago Salvador , Stephanie Cairns , Vikram Voleti , Noah Marshall , Adam Oberman