English
Related papers

Related papers: BiasEdit: A Training-Free Bias-Detect-and-Edit Fra…

200 papers

Text-driven multi-object image editing which aims to precisely modify multiple objects within an image based on text descriptions, has recently attracted considerable interest. Existing works primarily follow the localize-editing paradigm,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Fengyi Fu , Mengqi Huang , Lei Zhang , Zhendong Mao

Recent research has identified discriminatory behavior of automated prediction algorithms towards groups identified on specific protected attributes (e.g., gender, ethnicity, age group, etc.). When deployed in real-world scenarios, such…

Machine Learning · Computer Science 2023-12-20 Anubha Pandey , Aditi Rai , Maneet Singh , Deepak Bhatt , Tanmoy Bhowmik

AI algorithms are not immune to biases. Traditionally, non-experts have little control in uncovering potential social bias (e.g., gender bias) in the algorithms that may impact their lives. We present a preliminary design for an interactive…

Human-Computer Interaction · Computer Science 2020-01-13 Chelsea M. Myers , Evan Freed , Luis Fernando Laris Pardo , Anushay Furqan , Sebastian Risi , Jichen Zhu

We propose a novel regularization algorithm to train deep neural networks, in which data at training time is severely biased. Since a neural network efficiently learns data distribution, a network is likely to learn the bias information to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Byungju Kim , Hyunwoo Kim , Kyungsu Kim , Sungjin Kim , Junmo Kim

This paper is the first to explore an automatic way to detect bias in deep convolutional neural networks by simply looking at their weights. Furthermore, it is also a step towards understanding neural networks and how they work. We show…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Ignacio Serna , Daniel DeAlcala , Aythami Morales , Julian Fierrez , Javier Ortega-Garcia

Many datasets have been shown to contain incidental correlations created by idiosyncrasies in the data collection process. For example, sentence entailment datasets can have spurious word-class correlations if nearly all contradiction…

Machine Learning · Computer Science 2020-11-10 Christopher Clark , Mark Yatskar , Luke Zettlemoyer

Although many fairness criteria have been proposed to ensure that machine learning algorithms do not exhibit or amplify our existing social biases, these algorithms are trained on datasets that can themselves be statistically biased. In…

Machine Learning · Computer Science 2023-05-04 Yiqiao Liao , Parinaz Naghizadeh

Modern machine learning datasets can have biases for certain representations that are leveraged by algorithms to achieve high performance without learning to solve the underlying task. This problem is referred to as "representation bias".…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Yi Li , Nuno Vasconcelos

Computer vision models learn to perform a task by capturing relevant statistics from training data. It has been shown that models learn spurious age, gender, and race correlations when trained for seemingly unrelated tasks like activity…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Zeyu Wang , Klint Qinami , Ioannis Christos Karakozis , Kyle Genova , Prem Nair , Kenji Hata , Olga Russakovsky

We empirically investigate the camera bias of person re-identification (ReID) models. Previously, camera-aware methods have been proposed to address this issue, but they are largely confined to training domains of the models. We measure the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Myungseo Song , Jin-Woo Park , Jong-Seok Lee

Model explanations such as saliency maps can improve user trust in AI by highlighting important features for a prediction. However, these become distorted and misleading when explaining predictions of images that are subject to systematic…

Human-Computer Interaction · Computer Science 2022-03-02 Wencan Zhang , Mariella Dimiccoli , Brian Y. Lim

Deep learning algorithms mine knowledge from the training data and thus would likely inherit the dataset's bias information. As a result, the obtained model would generalize poorly and even mislead the decision process in real-life…

Machine Learning · Computer Science 2021-08-16 Wei Zhu , Haitian Zheng , Haofu Liao , Weijian Li , Jiebo Luo

Despite their high predictive accuracies, current machine learning systems often exhibit systematic biases stemming from annotation artifacts or insufficient support for certain classes in the dataset. Recent work proposes automatic methods…

Computation and Language · Computer Science 2024-10-30 Rakesh R. Menon , Shashank Srivastava

It has recently been shown that deep learning models for anatomical segmentation in medical images can exhibit biases against certain sub-populations defined in terms of protected attributes like sex or ethnicity. In this context, auditing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Nicolás Gaggion , Rodrigo Echeveste , Lucas Mansilla , Diego H. Milone , Enzo Ferrante

Research has shown that, machine learning models might inherit and propagate undesired social biases encoded in the data. To address this problem, fair training algorithms are developed. However, most algorithms assume we know…

Machine Learning · Computer Science 2022-04-12 Mustafa Safa Ozdayi , Murat Kantarcioglu , Rishabh Iyer

Naively trained AI models can be heavily biased. This can be particularly problematic when the biases involve legally or morally protected attributes such as ethnic background, age or gender. Existing solutions to this problem come at the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Nicholas Rosa , Tom Drummond , Mehrtash Harandi

In a world increasingly reliant on artificial intelligence, it is more important than ever to consider the ethical implications of artificial intelligence on humanity. One key under-explored challenge is labeler bias, which can create…

Machine Learning · Computer Science 2024-10-25 Luke Haliburton , Sinksar Ghebremedhin , Robin Welsch , Albrecht Schmidt , Sven Mayer

In image editing, it is essential to incorporate a context image to convey the user's precise requirements, such as subject appearance or image style. Existing training-based visual context-aware editing methods incur data collection effort…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Rui Song , Guo-Hua Wang , Qing-Guo Chen , Weihua Luo , Tongda Xu , Zhening Liu , Yan Wang , Zehong Lin , Jun Zhang

Large pre-trained vision-language models (VLMs) reduce the time for developing predictive models for various vision-grounded language downstream tasks by providing rich, adaptable image and text representations. However, these models suffer…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Ashish Seth , Mayur Hemani , Chirag Agarwal

Visual text recognition is undoubtedly one of the most extensively researched topics in computer vision. Great progress have been made to date, with the latest models starting to focus on the more practical "in-the-wild" setting. However, a…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Ayan Kumar Bhunia , Pinaki Nath Chowdhury , Aneeshan Sain , Yi-Zhe Song