English
Related papers

Related papers: Auditing and Mitigating Bias in Gender Classificat…

200 papers

In recent years, the rapid development of artificial intelligence (AI) systems has raised concerns about our ability to ensure their fairness, that is, how to avoid discrimination based on protected characteristics such as gender, race, or…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Iris Dominguez-Catena , Daniel Paternain , Mikel Galar , MaryBeth Defrance , Maarten Buyl , Tijl De Bie

This work summarizes the 2020 ChaLearn Looking at People Fair Face Recognition and Analysis Challenge and provides a description of the top-winning solutions and analysis of the results. The aim of the challenge was to evaluate accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Tomáš Sixta , Julio C. S. Jacques Junior , Pau Buch-Cardona , Neil M. Robertson , Eduard Vazquez , Sergio Escalera

Demographic bias is one of the major challenges for face recognition systems. The majority of existing studies on demographic biases are heavily dependent on specific demographic groups or demographic classifier, making it difficult to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Tetsushi Ohki , Yuya Sato , Masakatsu Nishigaki , Koichi Ito

AI models have become extremely popular and accessible to the general public. However, they are continuously under the scanner due to their demonstrable biases toward various sections of the society like people of color and non-binary…

Computers and Society · Computer Science 2023-10-11 Siddharth D Jaiswal , Ankit Kumar Verma , Animesh Mukherjee

This study delves into the pervasive issue of gender issues in artificial intelligence (AI), specifically within automatic scoring systems for student-written responses. The primary objective is to investigate the presence of gender biases,…

Computers and Society · Computer Science 2025-01-29 Ehsan Latif , Xiaoming Zhai , Lei Liu

We address the problem of bias in automated face recognition and demographic attribute estimation algorithms, where errors are lower on certain cohorts belonging to specific demographic groups. We present a novel de-biasing adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Sixue Gong , Xiaoming Liu , Anil K. Jain

Large scale image classification models trained on top of popular datasets such as Imagenet have shown to have a distributional skew which leads to disparities in prediction accuracies across different subsections of population…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Rohan Mahadev , Anindya Chakravarti

Machine learning (ML) is playing an increasingly important role in rendering decisions that affect a broad range of groups in society. ML models inform decisions in criminal justice, the extension of credit in banking, and the hiring…

Machine Learning · Computer Science 2022-07-14 Damien Dablain , Bartosz Krawczyk , Nitesh Chawla

In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented…

Machine Learning · Computer Science 2021-05-11 Yan Zhou , Murat Kantarcioglu , Chris Clifton

In spite of the high performance and reliability of deep learning algorithms in a wide range of everyday applications, many investigations tend to show that a lot of models exhibit biases, discriminating against specific subgroups of the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Jean-Rémy Conti , Nathan Noiry , Vincent Despiegel , Stéphane Gentric , Stéphan Clémençon

Societal bias towards certain communities is a big problem that affects a lot of machine learning systems. This work aims at addressing the racial bias present in many modern gender recognition systems. We learn race invariant…

Machine Learning · Computer Science 2019-11-21 Komal K. Teru , Aishik Chakraborty

Bias in computer vision systems can perpetuate or even amplify discrimination against certain populations. Considering that bias is often introduced by biased visual datasets, many recent research efforts focus on training fair models using…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Ioannis Sarridis , Christos Koutlis , Symeon Papadopoulos , Christos Diou

Facial Recognition Systems (FRSs) are being developed and deployed globally at unprecedented rates. Most platforms are designed in a limited set of countries but deployed in worldwide, without adequate checkpoints. This is especially…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Siddharth D Jaiswal , Animesh Ganai , Abhisek Dash , Saptarshi Ghosh , Animesh Mukherjee

The use of large-scale, web-scraped datasets to train face recognition models has raised significant privacy and bias concerns. Synthetic methods mitigate these concerns and provide scalable and controllable face generation to enable fair…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Michael Yeung , Toya Teramoto , Songtao Wu , Tatsuo Fujiwara , Kenji Suzuki , Tamaki Kojima

Auditing involves verifying the proper implementation of a given policy. As such, auditing is essential for ensuring compliance with the principles of fairness, equity, and transparency mandated by the European Union's AI Act. Moreover,…

Applications · Statistics 2025-12-04 Valentin Lafargue , Emmanuelle Claeys , Jean-Michel Loubes

As data-driven systems are increasingly deployed at scale, ethical concerns have arisen around unfair and discriminatory outcomes for historically marginalized groups that are underrepresented in training data. In response, work around AI…

Human-Computer Interaction · Computer Science 2022-09-21 Rie Kamikubo , Lining Wang , Crystal Marte , Amnah Mahmood , Hernisa Kacorri

Class imbalance and group (e.g., race, gender, and age) imbalance are acknowledged as two reasons in data that hinder the trade-off between fairness and utility of machine learning classifiers. Existing techniques have jointly addressed…

Machine Learning · Computer Science 2023-05-24 Ryosuke Sonoda

With the recent advances in computer vision, age estimation has significantly improved in overall accuracy. However, owing to the most common methods do not take into account the class imbalance problem in age estimation datasets, they…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yiping Zhang , Yuntao Shou , Wei Ai , Tao Meng , Keqin Li

Recent progress in face detection (including keypoint detection), and recognition is mainly being driven by (i) deeper convolutional neural network architectures, and (ii) larger datasets. However, most of the large datasets are maintained…

Computer Vision and Pattern Recognition · Computer Science 2017-05-23 Ankan Bansal , Anirudh Nanduri , Carlos Castillo , Rajeev Ranjan , Rama Chellappa

The performance of deep neural networks for image recognition tasks such as predicting a smiling face is known to degrade with under-represented classes of sensitive attributes. We address this problem by introducing fairness-aware…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Tobias Hänel , Nishant Kumar , Dmitrij Schlesinger , Mengze Li , Erdem Ünal , Abouzar Eslami , Stefan Gumhold