English
Related papers

Related papers: Metrics for Dataset Demographic Bias: A Case Study…

200 papers

Systems incorporating biometric technologies have become ubiquitous in personal, commercial, and governmental identity management applications. Both cooperative (e.g. access control) and non-cooperative (e.g. surveillance and forensics)…

Computers and Society · Computer Science 2021-03-08 P. Drozdowski , C. Rathgeb , A. Dantcheva , N. Damer , C. Busch

As equality issues in the use of face recognition have garnered a lot of attention lately, greater efforts have been made to debiased deep learning models to improve fairness to minorities. However, there is still no clear definition nor…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Jiazhi Li , Wael Abd-Almageed

This article investigates the critical issue of dataset bias in medical imaging, with a particular emphasis on racial disparities caused by uneven population distribution in dataset collection. Our analysis reveals that medical segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yixiao Chen , Yue Yao , Ruining Yang , Md Zakir Hossain , Ashu Gupta , Tom Gedeon

Rapid development of artificial intelligence (AI) systems amplify many concerns in society. These AI algorithms inherit different biases from humans due to mysterious operational flow and because of that it is becoming adverse in usage. As…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Artem Domnich , Gholamreza Anbarjafari

Bias in AI/ML-based systems is a ubiquitous problem and bias in AI/ML systems may negatively impact society. There are many reasons behind a system being biased. The bias can be due to the algorithm we are using for our problem or may be…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Vedant V. Kandge , Siddhant V. Kandge , Kajal Kumbharkar , Tanuja Pattanshetti

As language models grow in popularity, it becomes increasingly important to clearly measure all possible markers of demographic identity in order to avoid perpetuating existing societal harms. Many datasets for measuring bias currently…

Computation and Language · Computer Science 2022-10-31 Eric Michael Smith , Melissa Hall , Melanie Kambadur , Eleonora Presani , Adina Williams

Face recognition (FR) models are vulnerable to performance variations across demographic groups. The causes for these performance differences are unclear due to the highly complex deep learning-based structure of face recognition models.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Marco Huber , Fadi Boutros , Naser Damer

In order to analyze a trained model performance and identify its weak spots, one has to set aside a portion of the data for testing. The test set has to be large enough to detect statistically significant biases with respect to all the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Ran Shadmi , Jonathan Laserson , Gil Elbaz

Face biometrics are playing a key role in making modern smart city applications more secure and usable. Commonly, the recognition threshold of a face recognition system is adjusted based on the degree of security for the considered use…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Andrea Atzori , Gianni Fenu , Mirko Marras

Speaker recognition is a widely used voice-based biometric technology with applications in various industries, including banking, education, recruitment, immigration, law enforcement, healthcare, and well-being. However, while dataset…

Computers and Society · Computer Science 2023-08-21 Casandra Rusti , Anna Leschanowsky , Carolyn Quinlan , Michaela Pnacek , Lauriane Gorce , Wiebke Hutiri

There are demographic biases present in current facial recognition (FR) models. To measure these biases across different ethnic and gender subgroups, we introduce our Balanced Faces in the Wild (BFW) dataset. This dataset allows for the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Joseph P Robinson , Can Qin , Yann Henon , Samson Timoner , Yun Fu

Facial expression recognition (FER) algorithms classify facial expressions into emotions such as happy, sad, or angry. An evaluative challenge facing FER algorithms is the fall in performance when detecting spontaneous expressions compared…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Rina Khan , Catherine Stinson

Existing machine learning models have proven to fail when it comes to their performance for minority groups, mainly due to biases in data. In particular, datasets, especially social data, are often not representative of minorities. In this…

Databases · Computer Science 2023-06-27 Melika Mousavi , Nima Shahbazi , Abolfazl Asudeh

Undesirable biases encoded in the data are key drivers of algorithmic discrimination. Their importance is widely recognized in the algorithmic fairness literature, as well as legislation and standards on anti-discrimination in AI. Despite…

Machine Learning · Computer Science 2025-07-15 Marina Ceccon , Giandomenico Cornacchia , Davide Dalle Pezze , Alessandro Fabris , Gian Antonio Susto

Datasets play an important role in the progress of facial expression recognition algorithms, but they may suffer from obvious biases caused by different cultures and collection conditions. To look deeper into this bias, we first conduct…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Shan Li , Weihong Deng

Predictive algorithms have a powerful potential to offer benefits in areas as varied as medicine or education. However, these algorithms and the data they use are built by humans, consequently, they can inherit the bias and prejudices…

Human-Computer Interaction · Computer Science 2022-03-22 Cristina Manresa-Yee , Silvia Ramis

Algorithms deployed in education can shape the learning experience and success of a student. It is therefore important to understand whether and how such algorithms might create inequalities or amplify existing biases. In this paper, we…

Computers and Society · Computer Science 2022-12-21 Jade Maï Cock , Muhammad Bilal , Richard Davis , Mirko Marras , Tanja Käser

In recent years, image and video manipulations with Deepfake have become a severe concern for security and society. Many detection models and datasets have been proposed to detect Deepfake data reliably. However, there is an increased…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Ying Xu , Philipp Terhörst , Kiran Raja , Marius Pedersen

As the social impact of visual recognition has been under scrutiny, several protected-attribute balanced datasets emerged to address dataset bias in imbalanced datasets. However, in facial attribute classification, dataset bias stems from…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Jiazhi Li , Wael Abd-Almageed

Recently, concerns regarding potential biases in the underlying algorithms of many automated systems (including biometrics) have been raised. In this context, a biased algorithm produces statistically different outcomes for different groups…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 P. Drozdowski , B. Prommegger , G. Wimmer , R. Schraml , C. Rathgeb , A. Uhl , C. Busch