English
Related papers

Related papers: De-biasing facial detection system using VAE

200 papers

In recent years, machine learning algorithms have become ubiquitous in a multitude of high-stakes decision-making applications. The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to…

Machine Learning · Computer Science 2022-07-14 José Pombal , André F. Cruz , João Bravo , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

Much recent research has uncovered and discussed serious concerns of bias in facial analysis technologies, finding performance disparities between groups of people based on perceived gender, skin type, lighting condition, etc. These audits…

In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented…

Machine Learning · Computer Science 2021-05-11 Yan Zhou , Murat Kantarcioglu , Chris Clifton

Synthetic data is emerging as a substitute for authentic data to solve ethical and legal challenges in handling authentic face data. The current models can create real-looking face images of people who do not exist. However, it is a known…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Marco Huber , Anh Thi Luu , Fadi Boutros , Arjan Kuijper , Naser Damer

Many machine learning algorithms are trained and evaluated by splitting data from a single source into training and test sets. While such focus on in-distribution learning scenarios has led to interesting advancement, it has not been able…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Hyojin Bahng , Sanghyuk Chun , Sangdoo Yun , Jaegul Choo , Seong Joon Oh

A biased dataset is a dataset that generally has attributes with an uneven class distribution. These biases have the tendency to propagate to the models that train on them, often leading to a poor performance in the minority class. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Athiya Deviyani

Computer Vision (CV) has achieved remarkable results, outperforming humans in several tasks. Nonetheless, it may result in significant discrimination if not handled properly as CV systems highly depend on the data they are fed with and can…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Simone Fabbrizzi , Symeon Papadopoulos , Eirini Ntoutsi , Ioannis Kompatsiaris

Addressing biases in AI models is crucial for ensuring fair and accurate predictions. However, obtaining large, unbiased datasets for training can be challenging. This paper proposes a comprehensive approach using multiple methods to remove…

Machine Learning · Computer Science 2024-02-15 Ahmed Radwan , Layan Zaafarani , Jetana Abudawood , Faisal AlZahrani , Fares Fourati

Despite numerous efforts to mitigate their biases, ML systems continue to harm already-marginalized people. While predominant ML approaches assume bias can be removed and fair models can be created, we show that these are not always…

Computation and Language · Computer Science 2025-04-02 Lucy Havens , Benjamin Bach , Melissa Terras , Beatrice Alex

Neural networks achieve the state-of-the-art in image classification tasks. However, they can encode spurious variations or biases that may be present in the training data. For example, training an age predictor on a dataset that is not…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Mohsan Alvi , Andrew Zisserman , Christoffer Nellaker

Deep learning-based methods have pushed the limits of the state-of-the-art in face analysis. However, despite their success, these models have raised concerns regarding their bias towards certain demographics. This bias is inflicted both by…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Markos Georgopoulos , Yannis Panagakis , Maja Pantic

Face recognition algorithms, when used in the real world, can be very useful, but they can also be dangerous when biased toward certain demographics. So, it is essential to understand how these algorithms are trained and what factors affect…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Manideep Kolla , Aravinth Savadamuthu

Models that are learned from real-world data are often biased because the data used to train them is biased. This can propagate systemic human biases that exist and ultimately lead to inequitable treatment of people, especially minorities.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Daniel McDuff , Shuang Ma , Yale Song , Ashish Kapoor

Successful deployment of artificial intelligence (AI) in various settings has led to numerous positive outcomes for individuals and society. However, AI systems have also been shown to harm parts of the population due to biased predictions.…

Computers and Society · Computer Science 2023-07-21 Ondrej Bohdal , Timothy Hospedales , Philip H. S. Torr , Fazl Barez

This paper stresses the importance of biases in the field of artificial intelligence (AI) in two regards. First, in order to foster efficient algorithmic decision-making in complex, unstable, and uncertain real-world environments, we argue…

Machine Learning · Computer Science 2023-02-15 Sarah Fabi , Thilo Hagendorff

Machine learning model bias can arise from dataset composition: correlated sensitive features can distort the downstream classification model's decision boundary and lead to performance differences along these features. Existing de-biasing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Miao Zhang , Zee fryer , Ben Colman , Ali Shahriyari , Gaurav Bharaj

The understanding of bias in AI is currently undergoing a revolution. Initially understood as errors or flaws, biases are increasingly recognized as integral to AI systems and sometimes preferable to less biased alternatives. In this paper,…

Computers and Society · Computer Science 2025-03-11 Gabriella Waters , Phillip Honenberger

Face recognition algorithms have demonstrated very high recognition performance, suggesting suitability for real world applications. Despite the enhanced accuracies, robustness of these algorithms against attacks and bias has been…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Richa Singh , Akshay Agarwal , Maneet Singh , Shruti Nagpal , Mayank Vatsa

A common approach in neuroscience is to study neural representations as a means to understand a system -- increasingly, by relating the neural representations to the internal representations learned by computational models. However, a…

Neurons and Cognition · Quantitative Biology 2025-08-14 Andrew Kyle Lampinen , Stephanie C. Y. Chan , Yuxuan Li , Katherine Hermann

Mitigating biases in computer vision models is an essential step towards the trustworthiness of artificial intelligence models. Existing bias mitigation methods focus on a small set of predefined biases, limiting their applicability in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Ioannis Sarridis , Christos Koutlis , Symeon Papadopoulos , Christos Diou