English
Related papers

Related papers: Bias Analysis in Unconditional Image Generative Mo…

200 papers

Fairness has become an essential problem in many domains of Machine Learning (ML), such as classification, natural language processing, and Generative Adversarial Networks (GANs). In this research effort, we study the unfairness of GANs. We…

Machine Learning · Computer Science 2022-07-22 Patrik Joslin Kenfack , Kamil Sabbagh , Adín Ramírez Rivera , Adil Khan

This study analyzed images generated by three popular generative artificial intelligence (AI) tools - Midjourney, Stable Diffusion, and DALLE 2 - representing various occupations to investigate potential bias in AI generators. Our analysis…

General Economics · Economics 2024-03-06 Mi Zhou , Vibhanshu Abhishek , Timothy Derdenger , Jaymo Kim , Kannan Srinivasan

Exposure bias refers to the train-test discrepancy that seemingly arises when an autoregressive generative model uses only ground-truth contexts at training time but generated ones at test time. We separate the contributions of the model…

Machine Learning · Computer Science 2019-11-11 Florian Schmidt

Diffusion models have demonstrated impressive capabilities in synthesizing diverse content. However, despite their high-quality outputs, these models often perpetuate social biases, including those related to gender and race. These biases…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yingdong Shi , Changming Li , Yifan Wang , Yongxiang Zhao , Anqi Pang , Sibei Yang , Jingyi Yu , Kan Ren

Social bias in generative AI can manifest not only as performance disparities but also as associational bias, whereby models learn and reproduce stereotypical associations between concepts and demographic groups, even in the absence of…

Computers and Society · Computer Science 2026-01-30 Fethiye Irmak Dogan , Yuval Weiss , Kajal Patel , Jiaee Cheong , Hatice Gunes

Training and evaluation of fair classifiers is a challenging problem. This is partly due to the fact that most fairness metrics of interest depend on both the sensitive attribute information and label information of the data points. In many…

Machine Learning · Computer Science 2021-02-18 Pranjal Awasthi , Alex Beutel , Matthaeus Kleindessner , Jamie Morgenstern , Xuezhi Wang

Real-world datasets are often biased with respect to key demographic factors such as race and gender. Due to the latent nature of the underlying factors, detecting and mitigating bias is especially challenging for unsupervised machine…

Machine Learning · Computer Science 2020-07-01 Kristy Choi , Aditya Grover , Trisha Singh , Rui Shu , Stefano Ermon

Facial Attribute Classification (FAC) holds substantial promise in widespread applications. However, FAC models trained by traditional methodologies can be unfair by exhibiting accuracy inconsistencies across varied data subpopulations.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Fengda Zhang , Qianpei He , Kun Kuang , Jiashuo Liu , Long Chen , Chao Wu , Jun Xiao , Hanwang Zhang

Mitigating bias in machine learning models is a critical endeavor for ensuring fairness and equity. In this paper, we propose a novel approach to address bias by leveraging pixel image attributions to identify and regularize regions of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Sander De Coninck , Sam Leroux , Pieter Simoens

AI systems have been shown to produce unfair results for certain subgroups of population, highlighting the need to understand bias on certain sensitive attributes. Current research often falls short, primarily focusing on the subgroups…

Machine Learning · Computer Science 2024-06-10 Gezheng Xu , Qi Chen , Charles Ling , Boyu Wang , Changjian Shui

Accurately measuring discrimination in machine learning-based automated decision systems is required to address the vital issue of fairness between subpopulations and/or individuals. Any bias in measuring discrimination can lead to either…

Machine Learning · Computer Science 2023-10-23 Rūta Binkytė , Sami Zhioua , Yassine Turki

Deep neural networks are often ignorant about what they do not know and overconfident when they make uninformed predictions. Some recent approaches quantify classification uncertainty directly by training the model to output high…

Machine Learning · Computer Science 2020-06-09 Murat Sensoy , Lance Kaplan , Federico Cerutti , Maryam Saleki

This work tackles the issue of fairness in the context of generative procedures, such as image super-resolution, which entail different definitions from the standard classification setting. Moreover, while traditional group fairness…

Machine Learning · Computer Science 2021-07-05 Ajil Jalal , Sushrut Karmalkar , Jessica Hoffmann , Alexandros G. Dimakis , Eric Price

Perceptual estimates exhibit a reversal in bias depending on uncertainty: they shift toward prior expectations under high stimulus noise, but away from them when sensory noise dominates. The normative framework of a Bayesian observer model…

Neurons and Cognition · Quantitative Biology 2025-10-16 Hyun-Jun Jeon , Hansol Choi , Oh-Sang Kwon

The significant advancements in applying Artificial Intelligence (AI) to healthcare decision-making, medical diagnosis, and other domains have simultaneously raised concerns about the fairness and bias of AI systems. This is particularly…

Computers and Society · Computer Science 2024-01-30 Emilio Ferrara

In recent years, the rapid development of artificial intelligence (AI) systems has raised concerns about our ability to ensure their fairness, that is, how to avoid discrimination based on protected characteristics such as gender, race, or…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Iris Dominguez-Catena , Daniel Paternain , Mikel Galar , MaryBeth Defrance , Maarten Buyl , Tijl De Bie

Distinguishing between real and AI-generated images, commonly referred to as 'image detection', presents a timely and significant challenge. Despite extensive research in the (semi-)supervised regime, zero-shot and few-shot solutions have…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Jonathan Brokman , Amit Giloni , Omer Hofman , Roman Vainshtein , Hisashi Kojima , Guy Gilboa

Bias discovery is critical for black-box generative models, especiall text-to-image (TTI) models. Existing works predominantly focus on output-level demographic distributions, which do not necessarily guarantee concept representations to be…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Rajatsubhra Chakraborty , Xujun Che , Depeng Xu , Cori Faklaris , Xi Niu , Shuhan Yuan

Despite being trained on balanced datasets, existing AI-generated image detectors often exhibit systematic bias at test time, frequently misclassifying fake images as real. We hypothesize that this behavior stems from distributional shift…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Muli Yang , Gabriel James Goenawan , Henan Wang , Huaiyuan Qin , Chenghao Xu , Yanhua Yang , Fen Fang , Ying Sun , Joo-Hwee Lim , Hongyuan Zhu

Generative Adversarial Networks (GANs) advance face synthesis through learning the underlying distribution of observed data. Despite the high-quality generated faces, some minority groups can be rarely generated from the trained models due…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Shuhan Tan , Yujun Shen , Bolei Zhou