English
Related papers

Related papers: Investigating Bias in Image Classification using M…

200 papers

Vision-language models can encode societal biases and stereotypes, but there are challenges to measuring and mitigating these multimodal harms due to lacking measurement robustness and feature degradation. To address these challenges, we…

Machine Learning · Computer Science 2022-10-27 Hugo Berg , Siobhan Mackenzie Hall , Yash Bhalgat , Wonsuk Yang , Hannah Rose Kirk , Aleksandar Shtedritski , Max Bain

Feature selection is an important but challenging task in causal inference for obtaining unbiased estimates of causal quantities. Properly selected features in causal inference not only significantly reduce the time required to implement a…

Methodology · Statistics 2025-02-04 Tianyu Yang , Md. Noor-E-Alam

We examine whether data generated by explanation techniques, which promote a process of self-reflection, can improve classifier performance. Our work is based on the idea that humans have the ability to make quick, intuitive decisions as…

Machine Learning · Computer Science 2025-03-05 Johannes Schneider , Michalis Vlachos

Given a pre-trained CNN without any testing samples, this paper proposes a simple yet effective method to diagnose feature representations of the CNN. We aim to discover representation flaws caused by potential dataset bias. More…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Quanshi Zhang , Wenguan Wang , Song-Chun Zhu

It is a mystery which input features contribute to a neural network's output. Various explanation (feature attribution) methods are proposed in the literature to shed light on the problem. One peculiar observation is that these explanations…

Machine Learning · Computer Science 2022-03-07 Ashkan Khakzar , Pedram Khorsandi , Rozhin Nobahari , Nassir Navab

It is well known that the usefulness of a machine learning model is due to its ability to generalize to unseen data. This study uses three popular cyberbullying datasets to explore the effects of data, how it's collected, and how it's…

Machine Learning · Computer Science 2024-12-03 Andrew Root , Liam Jakubowski , Mounika Vanamala

A myriad of explainability methods have been proposed in recent years, but there is little consensus on how to evaluate them. While automatic metrics allow for quick benchmarking, it isn't clear how such metrics reflect human interaction…

Computation and Language · Computer Science 2021-06-30 Ana Valeria Gonzalez , Anna Rogers , Anders Søgaard

This paper addresses the issue of implicit stereotypes that may arise during the generation process of large language models. It proposes an interpretable bias detection method aimed at identifying hidden social biases in model outputs,…

Computation and Language · Computer Science 2025-08-11 Renhan Zhang , Lian Lian , Zhen Qi , Guiran Liu

Deep learning has recently gained popularity in digital pathology due to its high prediction quality. However, the medical domain requires explanation and insight for a better understanding beyond standard quantitative performance…

Image and Video Processing · Electrical Eng. & Systems 2020-04-28 Miriam Hägele , Philipp Seegerer , Sebastian Lapuschkin , Michael Bockmayr , Wojciech Samek , Frederick Klauschen , Klaus-Robert Müller , Alexander Binder

Large language models are becoming the go-to solution for the ever-growing number of tasks. However, with growing capacity, models are prone to rely on spurious correlations stemming from biases and stereotypes present in the training data.…

Computation and Language · Computer Science 2024-05-30 Tomasz Limisiewicz , David Mareček , Tomáš Musil

Recognition of expressions of emotions and affect from facial images is a well-studied research problem in the fields of affective computing and computer vision with a large number of datasets available containing facial images and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-24 Tian Xu , Jennifer White , Sinan Kalkan , Hatice Gunes

Explainable Artificial Intelligence (XAI) aims to provide transparent insights into machine learning models, yet the reliability of many feature attribution methods remains a critical challenge. Prior research (Haufe et al., 2014; Wilming…

Machine Learning · Computer Science 2026-02-11 Benedict Clark , Stoyan Karastoyanov , Rick Wilming , Stefan Haufe

Many ML models are opaque to humans, producing decisions too complex for humans to easily understand. In response, explainable artificial intelligence (XAI) tools that analyze the inner workings of a model have been created. Despite these…

Computers and Society · Computer Science 2021-06-17 Kiana Alikhademi , Brianna Richardson , Emma Drobina , Juan E. Gilbert

In attempts to "explain" predictions of machine learning models, researchers have proposed hundreds of techniques for attributing predictions to features that are deemed important. While these attributions are often claimed to hold the…

Computation and Language · Computer Science 2022-08-23 Siddhant Arora , Danish Pruthi , Norman Sadeh , William W. Cohen , Zachary C. Lipton , Graham Neubig

While adversarial perturbation of images to attack deep image classification models pose serious security concerns in practice, this paper suggests a novel paradigm where the concept of image perturbation can benefit classification…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Juyeop Kim , Jun-Ho Choi , Soobeom Jang , Jong-Seok Lee

The objective of this paper is to assess the quality of explanation heatmaps for image classification tasks. To assess the quality of explainability methods, we approach the task through the lens of accuracy and stability. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Lassi Raatikainen , Esa Rahtu

In mission-critical domains such as law enforcement and medical diagnosis, the ability to explain and interpret the outputs of deep learning models is crucial for ensuring user trust and supporting informed decision-making. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Bharat Chandra Yalavarthi , Nalini Ratha

Facial analysis models are increasingly used in applications that have serious impacts on people's lives, ranging from authentication to surveillance tracking. It is therefore critical to develop techniques that can reveal unintended biases…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Remi Denton , Ben Hutchinson , Margaret Mitchell , Timnit Gebru , Andrew Zaldivar

The relevance of machine learning (ML) in our daily lives is closely intertwined with its explainability. Explainability can allow end-users to have a transparent and humane reckoning of a ML scheme's capability and utility. It will also…

Machine Learning · Computer Science 2022-12-27 Payel Sadhukhan , Sarbani palit , Kausik Sengupta

Existing visual explanation generating agents learn to fluently justify a class prediction. However, they may mention visual attributes which reflect a strong class prior, although the evidence may not actually be in the image. This is…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Lisa Anne Hendricks , Ronghang Hu , Trevor Darrell , Zeynep Akata