English
Related papers

Related papers: Uncovering Bias in Face Generation Models

200 papers

Synthetically generated images can be used to create media content or to complement datasets for training image analysis models. Several methods have recently been proposed for the synthesis of high-fidelity face images; however, the…

Machine Learning · Computer Science 2024-05-21 Emmanouil Maragkoudakis , Symeon Papadopoulos , Iraklis Varlamis , Christos Diou

Text-to-image generative AI models such as Stable Diffusion are used daily by millions worldwide. However, the extent to which these models exhibit racial and gender stereotypes is not yet fully understood. Here, we document significant…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Nouar AlDahoul , Talal Rahwan , Yasir Zaki

Generative models are widely used to compensate for class imbalance in AI training pipelines, yet their failure modes under low-data conditions are poorly understood. This paper reports a controlled benchmark comparing three augmentation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Shesh Narayan Gupta , Nik Bear Brown

In this paper, we show that popular Generative Adversarial Networks (GANs) exacerbate biases along the axes of gender and skin tone when given a skewed distribution of face-shots. While practitioners celebrate synthetic data generation…

Machine Learning · Computer Science 2021-06-17 Niharika Jain , Alberto Olmo , Sailik Sengupta , Lydia Manikonda , Subbarao Kambhampati

Diffusion models have achieved great progress in face generation. However, these models amplify the bias in the generation process, leading to an imbalance in distribution of sensitive attributes such as age, gender and race. This paper…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Basudha Pal , Arunkumar Kannan , Ram Prabhakar Kathirvel , Alice J. O'Toole , Rama Chellappa

Face recognition systems (FRS) exhibit significant accuracy differences based on the user's gender. Since such a gender gap reduces the trustworthiness of FRS, more recent efforts have tried to find the causes. However, these studies make…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Paul Jonas Kurz , Haiyu Wu , Kevin W. Bowyer , Philipp Terhörst

Gender classification algorithms have important applications in many domains today such as demographic research, law enforcement, as well as human-computer interaction. Recent research showed that algorithms trained on biased benchmark…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Wenying Wu , Pavlos Protopapas , Zheng Yang , Panagiotis Michalatos

Pretrained machine learning models are known to perpetuate and even amplify existing biases in data, which can result in unfair outcomes that ultimately impact user experience. Therefore, it is crucial to understand the mechanisms behind…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Laura Cabello , Emanuele Bugliarello , Stephanie Brandl , Desmond Elliott

Text-to-image diffusion models have achieved widespread popularity due to their unprecedented image generation capability. In particular, their ability to synthesize and modify human faces has spurred research into using generated face…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Harrison Rosenberg , Shimaa Ahmed , Guruprasad V Ramesh , Ramya Korlakai Vinayak , Kassem Fawaz

Gender classification systems often inherit and amplify demographic imbalances in their training data. We first audit five widely used gender classification datasets, revealing that all suffer from significant intersectional…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Tadesse K Bahiru , Natnael Tilahun Sinshaw , Teshager Hailemariam Moges , Dheeraj Kumar Singh

Artificial intelligence (AI) systems, particularly those based on deep learning models, have increasingly achieved expert-level performance in medical applications. However, there is growing concern that such AI systems may reflect and…

Computation and Language · Computer Science 2025-04-25 Xiuying Chen , Tairan Wang , Juexiao Zhou , Zirui Song , Xin Gao , Xiangliang Zhang

Societal bias towards certain communities is a big problem that affects a lot of machine learning systems. This work aims at addressing the racial bias present in many modern gender recognition systems. We learn race invariant…

Machine Learning · Computer Science 2019-11-21 Komal K. Teru , Aishik Chakraborty

Face recognition systems are widely deployed in safety-critical applications, including law enforcement, yet they exhibit bias across a range of socio-demographic dimensions, such as gender and race. Conventional wisdom dictates that model…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Samuel Dooley , Rhea Sanjay Sukthanker , John P. Dickerson , Colin White , Frank Hutter , Micah Goldblum

Ensuring consistent performance across diverse populations and incorporating fairness into machine learning models are crucial for advancing medical image diagnostics and promoting equitable healthcare. However, many databases do not…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Dilermando Queiroz , André Anjos , Lilian Berton

In this paper, we propose a new framework for mitigating biases in machine learning systems. The problem of the existing mitigation approaches is that they are model-oriented in the sense that they focus on tuning the training algorithms to…

Machine Learning · Computer Science 2019-05-27 Adel Abusitta , Esma Aïmeur , Omar Abdel Wahab

Machine learning models can inherit biases from their training data, leading to discriminatory or inaccurate predictions. This is particularly concerning with the increasing use of large, unsupervised datasets for training foundational…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Iris Dominguez-Catena , Daniel Paternain , Aranzazu Jurio , Mikel Galar

We investigate bias trends in text-to-image generative models over time, focusing on the increasing availability of models through open platforms like Hugging Face. While these platforms democratize AI, they also facilitate the spread of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jordan Vice , Naveed Akhtar , Richard Hartley , Ajmal Mian

Real-world datasets are often biased with respect to key demographic factors such as race and gender. Due to the latent nature of the underlying factors, detecting and mitigating bias is especially challenging for unsupervised machine…

Machine Learning · Computer Science 2020-07-01 Kristy Choi , Aditya Grover , Trisha Singh , Rui Shu , Stefano Ermon

Face parsing is a fundamental task in computer vision, enabling applications such as identity verification, facial editing, and controllable image synthesis. However, existing face parsing models often lack fairness and robustness, leading…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Sophia J. Abraham , Jonathan D. Hauenstein , Walter J. Scheirer

Racial bias in medicine, such as in dermatology, presents significant ethical and clinical challenges. This is likely to happen because there is a significant underrepresentation of darker skin tones in training datasets for machine…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Miguel López-Pérez , Søren Hauberg , Aasa Feragen