English
Related papers

Related papers: Gender Slopes: Counterfactual Fairness for Compute…

200 papers

Most machine learning methods are known to capture and exploit biases of the training data. While some biases are beneficial for learning, others are harmful. Specifically, image captioning models tend to exaggerate biases present in…

Computer Vision and Pattern Recognition · Computer Science 2019-03-15 Kaylee Burns , Lisa Anne Hendricks , Kate Saenko , Trevor Darrell , Anna Rohrbach

The performance of deep neural networks for image recognition tasks such as predicting a smiling face is known to degrade with under-represented classes of sensitive attributes. We address this problem by introducing fairness-aware…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Tobias Hänel , Nishant Kumar , Dmitrij Schlesinger , Mengze Li , Erdem Ünal , Abouzar Eslami , Stefan Gumhold

Computer-based decision systems are widely used to automate decisions in many aspects of everyday life, which include sensitive areas like hiring, loaning and even criminal sentencing. A decision pipeline heavily relies on large volumes of…

Machine Learning · Computer Science 2023-10-02 Orestis Loukas , Ho-Ryun Chung

Image captioning is an important task for benchmarking visual reasoning and for enabling accessibility for people with vision impairments. However, as in many machine learning settings, social biases can influence image captioning in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Dora Zhao , Angelina Wang , Olga Russakovsky

Face recognition and verification are two computer vision tasks whose performance has progressed with the introduction of deep representations. However, ethical, legal, and technical challenges due to the sensitive character of face data…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Alexandre Fournier-Montgieux , Michael Soumm , Adrian Popescu , Bertrand Luvison , Hervé Le Borgne

Measuring biases of vision systems with respect to protected attributes like gender and age is critical as these systems gain widespread use in society. However, significant correlations between attributes in benchmark datasets make it…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Chandan Singh , Guha Balakrishnan , Pietro Perona

We propose a novel approach to mitigate biases in computer vision models by utilizing counterfactual generation and fine-tuning. While counterfactuals have been used to analyze and address biases in DNN models, the counterfactuals…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Pushkar Shukla , Dhruv Srikanth , Lee Cohen , Matthew Turk

Automatic Gender Recognition (AGR) systems are an increasingly widespread application in the Machine Learning (ML) landscape. While these systems are typically understood as detecting gender, they often classify datapoints based on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Camilla Quaresmini , Giacomo Zanotti

Biases inherent in both data and algorithms make the fairness of widespread machine learning (ML)-based decision-making systems less than optimal. To improve the trustfulness of such ML decision systems, it is crucial to be aware of the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Biying Fu , Naser Damer

Computer-based scene understanding has influenced fields ranging from urban planning to autonomous vehicle performance, yet little is known about how well these technologies work across social differences. We investigate the biases of deep…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Michelle R. Greene , Mariam Josyula , Wentao Si , Jennifer A. Hart

Gender classification systems often inherit and amplify demographic imbalances in their training data. We first audit five widely used gender classification datasets, revealing that all suffer from significant intersectional…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Tadesse K Bahiru , Natnael Tilahun Sinshaw , Teshager Hailemariam Moges , Dheeraj Kumar Singh

The embedding spaces of image models have been shown to encode a range of social biases such as racism and sexism. Here, we investigate specific factors that contribute to the emergence of these biases in Vision Transformers (ViT).…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Jannik Brinkmann , Paul Swoboda , Christian Bartelt

Web search engines influence perception of social reality by filtering and ranking information. However, their outputs are often subjected to bias that can lead to skewed representation of subjects such as professional occupations or…

Information Retrieval · Computer Science 2021-06-29 Mykola Makhortykh , Aleksandra Urman , Roberto Ulloa

Computational social scientists often harness the Web as a "societal observatory" where data about human social behavior is collected. This data enables novel investigations of psychological, anthropological and sociological research…

Computers and Society · Computer Science 2016-03-15 Fariba Karimi , Claudia Wagner , Florian Lemmerich , Mohsen Jadidi , Markus Strohmaier

Predictive models often reinforce biases which were originally embedded in their training data, through skewed decisions. In such cases, mitigation methods are critical to ensure that, regardless of the prevailing disparities, model…

Machine Learning · Statistics 2025-07-15 Ricardo Inácio , Zafeiris Kokkinogenis , Vitor Cerqueira , Carlos Soares

As computer vision systems become more widely deployed, there is increasing concern from both the research community and the public that these systems are not only reproducing but amplifying harmful social biases. The phenomenon of bias…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Dora Zhao , Jerone T. A. Andrews , Alice Xiang

Computer vision systems have been deployed in various applications involving biometrics like human faces. These systems can identify social media users, search for missing persons, and verify identity of individuals. While computer vision…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Guruprasad V Ramesh , Harrison Rosenberg , Ashish Hooda , Shimaa Ahmed Kassem Fawaz

Recent news articles have accused face recognition of being "biased", "sexist" or "racist". There is consensus in the research literature that face recognition accuracy is lower for females, who often have both a higher false match rate and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Vítor Albiero , Kevin W. Bowyer

Much recent research has uncovered and discussed serious concerns of bias in facial analysis technologies, finding performance disparities between groups of people based on perceived gender, skin type, lighting condition, etc. These audits…

Machine learned models exhibit bias, often because the datasets used to train them are biased. This presents a serious problem for the deployment of such technology, as the resulting models might perform poorly on populations that are…

Machine Learning · Computer Science 2018-10-02 Daniel McDuff , Roger Cheng , Ashish Kapoor