English
Related papers

Related papers: Men Also Do Laundry: Multi-Attribute Bias Amplific…

200 papers

Disaggregated performance metrics across demographic groups are a hallmark of fairness assessments in computer vision. These metrics successfully incentivized performance improvements on person-centric tasks such as face analysis and are…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Melissa Hall , Bobbie Chern , Laura Gustafson , Denisse Ventura , Harshad Kulkarni , Candace Ross , Nicolas Usunier

Pretrained machine learning models are known to perpetuate and even amplify existing biases in data, which can result in unfair outcomes that ultimately impact user experience. Therefore, it is crucial to understand the mechanisms behind…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Laura Cabello , Emanuele Bugliarello , Stephanie Brandl , Desmond Elliott

The blind application of machine learning runs the risk of amplifying biases present in data. Such a danger is facing us with word embedding, a popular framework to represent text data as vectors which has been used in many machine learning…

Computation and Language · Computer Science 2016-07-25 Tolga Bolukbasi , Kai-Wei Chang , James Zou , Venkatesh Saligrama , Adam Kalai

Real world images frequently exhibit multiple overlapping biases, including textures, watermarks, gendered makeup, scene object pairings, etc. These biases collectively impair the performance of modern vision models, undermining both their…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Rajeev Ranjan Dwivedi , Ankur Kumar , Vinod K Kurmi

Machine learning algorithms are optimized to model statistical properties of the training data. If the input data reflects stereotypes and biases of the broader society, then the output of the learning algorithm also captures these…

Computation and Language · Computer Science 2016-06-21 Tolga Bolukbasi , Kai-Wei Chang , James Zou , Venkatesh Saligrama , Adam Kalai

Diffusion-based generative models demonstrate state-of-the-art performance across various image synthesis tasks, yet their tendency to replicate and amplify dataset biases remains poorly understood. Although previous research has viewed…

Machine Learning · Computer Science 2025-12-24 Nathan Roos , Ekaterina Iakovleva , Ani Gjergji , Vito Paolo Pastore , Enzo Tartaglione

Gender classification algorithms have important applications in many domains today such as demographic research, law enforcement, as well as human-computer interaction. Recent research showed that algorithms trained on biased benchmark…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Wenying Wu , Pavlos Protopapas , Zheng Yang , Panagiotis Michalatos

Recent studies in the field of Machine Translation (MT) and Natural Language Processing (NLP) have shown that existing models amplify biases observed in the training data. The amplification of biases in language technology has mainly been…

Computation and Language · Computer Science 2021-02-02 Eva Vanmassenhove , Dimitar Shterionov , Matthew Gwilliam

Artificial Intelligence has the capacity to amplify and perpetuate societal biases and presents profound ethical implications for society. Gender bias has been identified in the context of employment advertising and recruitment tools, due…

Computation and Language · Computer Science 2020-05-19 Susan Leavy , Gerardine Meaney , Karen Wade , Derek Greene

Machine learning models built on datasets containing discriminative instances attributed to various underlying factors result in biased and unfair outcomes. It's a well founded and intuitive fact that existing bias mitigation strategies…

Machine Learning · Computer Science 2022-10-25 Bhushan Chaudhari , Akash Agarwal , Tanmoy Bhowmik

Recommendation systems are now an integral part of our daily lives. We rely on them for tasks such as discovering new movies, finding friends on social media, and connecting job seekers with relevant opportunities. Given their vital role,…

Artificial Intelligence · Computer Science 2025-02-26 Tahsin Alamgir Kheya , Mohamed Reda Bouadjenek , Sunil Aryal

An increased awareness concerning risks of algorithmic bias has driven a surge of efforts around bias mitigation strategies. A vast majority of the proposed approaches fall under one of two categories: (1) imposing algorithmic fairness…

Machine Learning · Computer Science 2023-07-11 Yunyi Li , Maria De-Arteaga , Maytal Saar-Tsechansky

This dissertation explores the impact of bias in deep neural networks and presents methods for reducing its influence on model performance. The first part begins by categorizing and describing potential sources of bias and errors in data…

Machine Learning · Computer Science 2023-08-21 Agnieszka Mikołajczyk-Bareła

Whereas previous post-processing approaches for increasing the fairness of predictions of biased classifiers address only group fairness, we propose a method for increasing both individual and group fairness. Our novel framework includes an…

Concerns regarding fairness and bias have been raised in recent years due to the growing use of machine learning models in crucial decision-making processes, especially when it comes to delicate characteristics like gender. In order to…

Machine Learning · Computer Science 2024-08-30 Saish Shinde

To safely deploy deep learning-based computer vision models for computer-aided detection and diagnosis, we must ensure that they are robust and reliable. Towards that goal, algorithmic auditing has received substantial attention. To guide…

Machine Learning · Computer Science 2023-04-07 Mitchell Pavlak , Nathan Drenkow , Nicholas Petrick , Mohammad Mehdi Farhangi , Mathias Unberath

With the rapid development of large language models (LLMs), they have significantly improved efficiency across a wide range of domains. However, recent studies have revealed that LLMs often exhibit gender bias, leading to serious social…

Computation and Language · Computer Science 2025-06-17 Xiaoqing Cheng , Hongying Zan , Lulu Kong , Jinwang Song , Min Peng

Machine learning actively impacts our everyday life in almost all endeavors and domains such as healthcare, finance, and energy. As our dependence on the machine learning increases, it is inevitable that these algorithms will be used to…

Machine Learning · Computer Science 2021-02-23 Ankit Kulshrestha , Ilya Safro

Prior work has shown that Visual Recognition datasets frequently underrepresent bias groups $B$ (\eg Female) within class labels $Y$ (\eg Programmers). This dataset bias can lead to models that learn spurious correlations between class…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Maan Qraitem , Kate Saenko , Bryan A. Plummer

With the rapid growth in language processing applications, fairness has emerged as an important consideration in data-driven solutions. Although various fairness definitions have been explored in the recent literature, there is lack of…

Machine Learning · Computer Science 2022-03-17 Satyapriya Krishna , Rahul Gupta , Apurv Verma , Jwala Dhamala , Yada Pruksachatkun , Kai-Wei Chang