English
Related papers

Related papers: Caption-Driven Explainability: Probing CNNs for Bi…

200 papers

As machine learning systems increasingly inform critical decisions, the need for human-understandable explanations grows. Current evaluations of Explainable AI (XAI) often prioritize technical fidelity over cognitive accessibility which…

Human-Computer Interaction · Computer Science 2025-09-23 Tobias Labarta , Nhi Hoang , Katharina Weitz , Wojciech Samek , Sebastian Lapuschkin , Leander Weber

Methods based on class activation maps (CAM) provide a simple mechanism to interpret predictions of convolutional neural networks by using linear combinations of feature maps as saliency maps. By contrast, masking-based methods optimize a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Hanwei Zhang , Felipe Torres , Ronan Sicre , Yannis Avrithis , Stephane Ayache

Nowadays, deep neural networks are widely used in a variety of fields that have a direct impact on society. Although those models typically show outstanding performance, they have been used for a long time as black boxes. To address this,…

Machine Learning · Computer Science 2022-10-11 Huawei Sun , Lorenzo Servadei , Hao Feng , Michael Stephan , Robert Wille , Avik Santra

Visual quality inspection systems, crucial in sectors like manufacturing and logistics, employ computer vision and machine learning for precise, rapid defect detection. However, their unexplained nature can hinder trust, error…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Tobias Clement , Truong Thanh Hung Nguyen , Mohamed Abdelaal , Hung Cao

As the manufacturing industry advances with sensor integration and automation, the opaque nature of deep learning models in machine learning poses a significant challenge for fault detection and diagnosis. And despite the related predictive…

Artificial Intelligence · Computer Science 2024-06-11 Ahmed Maged , Salah Haridy , Herman Shen

We present a comprehensive analysis of quantitatively evaluating explainable artificial intelligence (XAI) techniques for remote sensing image classification. Our approach leverages state-of-the-art machine learning approaches to perform…

Machine Learning · Computer Science 2023-12-06 Akshatha Mohan , Joshua Peeples

Despite the popularity of Vision Transformers (ViTs) and eXplainable AI (XAI), only a few explanation methods have been designed specially for ViTs thus far. They mostly use attention weights of the [CLS] token on patch embeddings and often…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Weiyan Xie , Xiao-Hui Li , Caleb Chen Cao , Nevin L. Zhang

A longstanding challenge surrounding deep learning algorithms is unpacking and understanding how they make their decisions. Explainable Artificial Intelligence (XAI) offers methods to provide explanations of internal functions of algorithms…

Artificial Intelligence · Computer Science 2022-08-16 Amin Nayebi , Sindhu Tipirneni , Brandon Foreman , Chandan K. Reddy , Vignesh Subbian

The interpretability of deep neural networks has attracted increasing attention in recent years, and several methods have been created to interpret the "black box" model. Fundamental limitations remain, however, that impede the pace of…

Machine Learning · Computer Science 2023-12-05 Hao Xu , Yuntian Chen , Dongxiao Zhang

Explainable Artificial Intelligence (XAI) has become increasingly significant for improving the interpretability and trustworthiness of machine learning models. While saliency maps have stolen the show for the last few years in the XAI…

Artificial Intelligence · Computer Science 2023-09-08 Antonin Poché , Lucas Hervier , Mohamed-Chafik Bakkay

Black-box deep learning approaches have showcased significant potential in the realm of medical image analysis. However, the stringent trustworthiness requirements intrinsic to the medical field have catalyzed research into the utilization…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Yequan Bie , Luyang Luo , Hao Chen

Explainable AI (XAI) has a counterpart in analytical modeling which we refer to as model explainability. We tackle the issue of model explainability in the context of prediction models. We analyze a dataset of loans from a credit card…

Machine Learning · Computer Science 2024-06-03 Donald Kridel , Jacob Dineen , Daniel Dolk , David Castillo

The main objective of eXplainable Artificial Intelligence (XAI) is to provide effective explanations for black-box classifiers. The existing literature lists many desirable properties for explanations to be useful, but there is no consensus…

Artificial Intelligence · Computer Science 2021-06-02 Elvio G. Amparore , Alan Perotti , Paolo Bajardi

Machine learning models need to provide contrastive explanations, since people often seek to understand why a puzzling prediction occurred instead of some expected outcome. Current contrastive explanations are rudimentary comparisons…

Human-Computer Interaction · Computer Science 2022-03-30 Wencan Zhang , Brian Y. Lim

Explainable Artificial Intelligence (XAI) techniques hold significant potential for enhancing the causal discovery process, which is crucial for understanding complex systems in areas like healthcare, economics, and artificial intelligence.…

Machine Learning · Computer Science 2025-10-20 Jesus Renero , Idoia Ochoa , Roberto Maestre

We propose a novel taxonomy for bias evaluation of discriminative foundation models, such as Contrastive Language-Pretraining (CLIP), that are used for labeling tasks. We then systematically evaluate existing methods for mitigating bias in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Junaid Ali , Matthaeus Kleindessner , Florian Wenzel , Kailash Budhathoki , Volkan Cevher , Chris Russell

Convolutional Neural Networks (CNNs) have seen significant performance improvements in recent years. However, due to their size and complexity, they function as black-boxes, leading to transparency concerns. State-of-the-art saliency…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Antonio De Santis , Riccardo Campi , Matteo Bianchi , Marco Brambilla

In pre-clinical pathology, there is a paradox between the abundance of raw data (whole slide images from many organs of many individual animals) and the lack of pixel-level slide annotations done by pathologists. Due to time constraints and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Marco Bertolini , Van-Khoa Le , Jake Pencharz , Andreas Poehlmann , Djork-Arné Clevert , Santiago Villalba , Floriane Montanari

A large set of the explainable Artificial Intelligence (XAI) literature is emerging on feature relevance techniques to explain a deep neural network (DNN) output or explaining models that ingest image source data. However, assessing how XAI…

Artificial Intelligence · Computer Science 2020-12-21 Alexandre Heuillet , Fabien Couthouis , Natalia Díaz-Rodríguez

We describe an explainable AI saliency map method for use with deep convolutional neural networks (CNN) that is much more efficient than popular fine-resolution gradient methods. It is also quantitatively similar or better in accuracy. Our…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 T. Nathan Mundhenk , Barry Y. Chen , Gerald Friedland