English
Related papers

Related papers: Revealing Neural Network Bias to Non-Experts Throu…

200 papers

The authors present a visual instrument developed as part of the creation of the artwork Learning to See. The artwork explores bias in artificial neural networks and provides mechanisms for the manipulation of specifically trained for…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Memo Akten , Rebecca Fiebrink , Mick Grierson

Face recognition (FR) systems continue to spread in our daily lives with an increasing demand for higher explainability and interpretability of FR systems that are mainly based on deep learning. While bias across demographic groups in FR…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Marco Huber , Meiling Fang , Fadi Boutros , Naser Damer

AI systems frequently exhibit and amplify social biases, leading to harmful consequences in critical areas. This study introduces a novel encoder-decoder approach that leverages model gradients to learn a feature neuron encoding societal…

Machine Learning · Computer Science 2026-03-10 Jonathan Drechsel , Steffen Herbold

To advance the transparency of learning machines such as Deep Neural Networks (DNNs), the field of Explainable AI (XAI) was established to provide interpretations of DNNs' predictions. While different explanation techniques exist, a popular…

From massive face-recognition-based surveillance and machine-learning-based decision systems predicting crime recidivism rates, to the move towards automated health diagnostic systems, artificial intelligence (AI) is being used in scenarios…

Computers and Society · Computer Science 2019-08-20 Timnit Gebru

As the use of AI in society grows, addressing emerging biases is essential to prevent systematic discrimination. Several bias detection methods have been proposed, but, with few exceptions, these tend to ignore transparency. Instead,…

Artificial Intelligence · Computer Science 2025-11-18 Hamed Ayoobi , Nico Potyka , Anna Rapberger , Francesca Toni

Facial emotion recognition is the task to classify human emotions in face images. It is a difficult task due to high aleatoric uncertainty and visual ambiguity. A large part of the literature aims to show progress by increasing accuracy on…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Maryam Matin , Matias Valdenegro-Toro

Machine learning is a tool for building models that accurately represent input training data. When undesired biases concerning demographic groups are in the training data, well-trained models will reflect those biases. We present a…

Machine Learning · Computer Science 2018-01-25 Brian Hu Zhang , Blake Lemoine , Margaret Mitchell

Teaching unbiased decision-making is crucial for addressing biased decision-making in daily life. Although both raising awareness of personal biases and providing guidance on unbiased decision-making are essential, the latter topics remains…

Human-Computer Interaction · Computer Science 2024-04-09 Mingzhe Yang , Hiromi Arai , Naomi Yamashita , Yukino Baba

Existing facial analysis systems have been shown to yield biased results against certain demographic subgroups. Due to its impact on society, it has become imperative to ensure that these systems do not discriminate based on gender,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Richa Singh , Puspita Majumdar , Surbhi Mittal , Mayank Vatsa

While deep learning has led to huge progress in complex image classification tasks like ImageNet, unexpected failure modes, e.g. via spurious features, call into question how reliably these classifiers work in the wild. Furthermore, for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Maximilian Augustin , Yannic Neuhaus , Matthias Hein

Deep learning models, particularly Convolutional Neural Networks (CNNs), have demonstrated exceptional performance in diagnosing skin diseases, often outperforming dermatologists. However, they have also unveiled biases linked to specific…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Anshul Pundhir , Balasubramanian Raman , Pravendra Singh

We propose a novel approach to mitigate biases in computer vision models by utilizing counterfactual generation and fine-tuning. While counterfactuals have been used to analyze and address biases in DNN models, the counterfactuals…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Pushkar Shukla , Dhruv Srikanth , Lee Cohen , Matthew Turk

Recently, concerns regarding potential biases in the underlying algorithms of many automated systems (including biometrics) have been raised. In this context, a biased algorithm produces statistically different outcomes for different groups…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 P. Drozdowski , B. Prommegger , G. Wimmer , R. Schraml , C. Rathgeb , A. Uhl , C. Busch

Addressing biases in computer vision models is crucial for real-world AI deployments. However, mitigating visual biases is challenging due to their unexplainable nature, often identified indirectly through visualization or sample…

Machine Learning · Computer Science 2024-03-28 Younghyun Kim , Sangwoo Mo , Minkyu Kim , Kyungmin Lee , Jaeho Lee , Jinwoo Shin

In a world increasingly reliant on artificial intelligence, it is more important than ever to consider the ethical implications of artificial intelligence on humanity. One key under-explored challenge is labeler bias, which can create…

Machine Learning · Computer Science 2024-10-25 Luke Haliburton , Sinksar Ghebremedhin , Robin Welsch , Albrecht Schmidt , Sven Mayer

The need to detect bias in machine learning (ML) models has led to the development of multiple bias detection methods, yet utilizing them is challenging since each method: i) explores a different ethical aspect of bias, which may result in…

Machine Learning · Computer Science 2020-12-24 Amit Giloni , Edita Grolman , Tanja Hagemann , Ronald Fromm , Sebastian Fischer , Yuval Elovici , Asaf Shabtai

Concerns regarding fairness and bias have been raised in recent years due to the growing use of machine learning models in crucial decision-making processes, especially when it comes to delicate characteristics like gender. In order to…

Machine Learning · Computer Science 2024-08-30 Saish Shinde

The remarkable progress in Natural Language Processing (NLP) brought about by deep learning, particularly with the recent advent of large pre-trained neural language models, is brought into scrutiny as several studies began to discuss and…

Computation and Language · Computer Science 2023-01-25 Anoop K. , Manjary P. Gangan , Deepak P. , Lajish V. L

Automatic machine learning systems can inadvertently accentuate and perpetuate inappropriate human biases. Past work on examining inappropriate biases has largely focused on just individual systems. Further, there is no benchmark dataset…

Computation and Language · Computer Science 2018-05-14 Svetlana Kiritchenko , Saif M. Mohammad