English
Related papers

Related papers: Seeing the Unseen: Errors and Bias in Visual Datas…

200 papers

Machine learning software, deep neural networks (DNN) software in particular, discerns valuable information from a large dataset, a set of data. Outcomes of such DNN programs are dependent on the quality of both learning programs and…

Machine Learning · Computer Science 2019-11-27 Shin Nakajima

The presence of a bias in each image data collection has recently attracted a lot of attention in the computer vision community showing the limits in generalization of any learning method trained on a specific dataset. At the same time,…

Computer Vision and Pattern Recognition · Computer Science 2015-05-07 Tatiana Tommasi , Novi Patricia , Barbara Caputo , Tinne Tuytelaars

It is tempting to think that machines are less prone to unfairness and prejudice. However, machine learning approaches compute their outputs based on data. While biases can enter at any stage of the development pipeline, models are…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Patrick Esser , Robin Rombach , Björn Ommer

Systems incorporating biometric technologies have become ubiquitous in personal, commercial, and governmental identity management applications. Both cooperative (e.g. access control) and non-cooperative (e.g. surveillance and forensics)…

Computers and Society · Computer Science 2021-03-08 P. Drozdowski , C. Rathgeb , A. Dantcheva , N. Damer , C. Busch

Machine learning algorithms are routinely used for business decisions that may directly affect individuals, for example, because a credit scoring algorithm refuses them a loan. It is then relevant from an ethical (and legal) point of view…

Machine Learning · Statistics 2025-10-06 Roberta Pappadà , Francesco Pauli

Machine learning methods often fail when deployed in the real world. Worse still, they fail in high-stakes situations and across socially sensitive lines. These issues have a chilling effect on the adoption of machine learning methods in…

Machine Learning · Computer Science 2025-09-05 Charles Jones , Ben Glocker

The growing capability and accessibility of machine learning has led to its application to many real-world domains and data about people. Despite the benefits algorithmic systems may bring, models can reflect, inject, or exacerbate implicit…

Machine Learning · Computer Science 2021-10-28 Ángel Alexander Cabrera , Will Epperson , Fred Hohman , Minsuk Kahng , Jamie Morgenstern , Duen Horng Chau

Machine learning algorithms are now frequently used in sensitive contexts that substantially affect the course of human lives, such as credit lending or criminal justice. This is driven by the idea that `objective' machines base their…

Machine Learning · Computer Science 2019-01-17 Songül Tolan

Image classification models often learn to predict a class based on irrelevant co-occurrences between input features and an output class in training data. We call the unwanted correlations "data biases," and the visual features causing data…

Human-Computer Interaction · Computer Science 2022-09-15 Bum Chul Kwon , Jungsoo Lee , Chaeyeon Chung , Nyoungwoo Lee , Ho-Jin Choi , Jaegul Choo

We reveal critical insights into problems of bias in state-of-the-art facial recognition (FR) systems using a novel Balanced Faces In the Wild (BFW) dataset: data balanced for gender and ethnic groups. We show variations in the optimal…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Joseph P Robinson , Gennady Livitz , Yann Henon , Can Qin , Yun Fu , Samson Timoner

In a world increasingly reliant on artificial intelligence, it is more important than ever to consider the ethical implications of artificial intelligence on humanity. One key under-explored challenge is labeler bias, which can create…

Machine Learning · Computer Science 2024-10-25 Luke Haliburton , Sinksar Ghebremedhin , Robin Welsch , Albrecht Schmidt , Sven Mayer

Automated Face Recognition Systems (FRSs), developed using deep learning models, are deployed worldwide for identity verification and facial attribute analysis. The performance of these models is determined by a complex interdependence…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Siddharth D Jaiswal , Sagnik Basu , Sandipan Sikdar , Animesh Mukherjee

Machine learning models are known to perpetuate and even amplify the biases present in the data. However, these data biases frequently do not become apparent until after the models are deployed. Our work tackles this issue and enables the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Angelina Wang , Alexander Liu , Ryan Zhang , Anat Kleiman , Leslie Kim , Dora Zhao , Iroha Shirai , Arvind Narayanan , Olga Russakovsky

Recently, concerns regarding potential biases in the underlying algorithms of many automated systems (including biometrics) have been raised. In this context, a biased algorithm produces statistically different outcomes for different groups…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 P. Drozdowski , B. Prommegger , G. Wimmer , R. Schraml , C. Rathgeb , A. Uhl , C. Busch

Machine learned models exhibit bias, often because the datasets used to train them are biased. This presents a serious problem for the deployment of such technology, as the resulting models might perform poorly on populations that are…

Machine Learning · Computer Science 2018-10-02 Daniel McDuff , Roger Cheng , Ashish Kapoor

This article investigates the critical issue of dataset bias in medical imaging, with a particular emphasis on racial disparities caused by uneven population distribution in dataset collection. Our analysis reveals that medical segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yixiao Chen , Yue Yao , Ruining Yang , Md Zakir Hossain , Ashu Gupta , Tom Gedeon

Face recognition and verification are two computer vision tasks whose performance has progressed with the introduction of deep representations. However, ethical, legal, and technical challenges due to the sensitive character of face data…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Alexandre Fournier-Montgieux , Michael Soumm , Adrian Popescu , Bertrand Luvison , Hervé Le Borgne

In the rapidly advancing field of artificial intelligence, machine perception is becoming paramount to achieving increased performance. Image classification systems are becoming increasingly integral to various applications, ranging from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Javon Hickmon

The increasing importance of Vision-Based Navigation (VBN) algorithms in space missions raises numerous challenges in ensuring their reliability and operational robustness. Sensor faults can lead to inaccurate outputs from navigation…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Riccardo Gallon , Fabian Schiemenz , Alessandra Menicucci , Eberhard Gill

Applications based on Machine Learning models have now become an indispensable part of the everyday life and the professional world. A critical question then recently arised among the population: Do algorithmic decisions convey any type of…

Machine Learning · Statistics 2020-04-07 Philippe Besse , Eustasio del Barrio , Paula Gordaliza , Jean-Michel Loubes , Laurent Risser