English
Related papers

Related papers: Quantifying Explainability of Saliency Methods in …

200 papers

Over the last few years, convolutional neural networks (CNNs) have dominated the field of computer vision thanks to their ability to extract features and their outstanding performance in classification problems, for example in the automatic…

Image and Video Processing · Electrical Eng. & Systems 2022-08-01 Helena Liz , Javier Huertas-Tato , Manuel Sánchez-Montañés , Javier Del Ser , David Camacho

Understanding intermediate layers of a deep learning model and discovering the driving features of stimuli have attracted much interest, recently. Explainable artificial intelligence (XAI) provides a new way to open an AI black box and…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Amirhossein Tavanaei

Despite the remarkable performance, Deep Neural Networks (DNNs) behave as black-boxes hindering user trust in Artificial Intelligence (AI) systems. Research on opening black-box DNN can be broadly categorized into post-hoc methods and…

Machine Learning · Computer Science 2021-06-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee

Saliency methods generating visual explanatory maps representing the importance of image pixels for model classification is a popular technique for explaining neural network decisions. Hierarchical dynamic masks (HDM), a novel explanatory…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Yitao Peng , Longzhen Yang , Yihang Liu , Lianghua He

Explainable AI (XAI) has gained significant attention for providing insights into the decision-making processes of deep learning models, particularly for image classification tasks through visual explanations visualized by saliency maps.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yifei Zhang , James Song , Siyi Gu , Tianxu Jiang , Bo Pan , Guangji Bai , Liang Zhao

The practical application of deep neural networks are still limited by their lack of transparency. One of the efforts to provide explanation for decisions made by artificial intelligence (AI) is the use of saliency or heat maps highlighting…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Erico Tjoa , Guan Cuntai

Convolutional Neural Networks (CNNs) have seen significant performance improvements in recent years. However, due to their size and complexity, they function as black-boxes, leading to transparency concerns. State-of-the-art saliency…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Antonio De Santis , Riccardo Campi , Matteo Bianchi , Marco Brambilla

The increasing popularity of machine learning (ML) in catalysis has spurred interest in leveraging these techniques to enhance catalyst design. Our study aims to bridge the gap between physics-based studies and data-driven methodologies by…

Machine Learning · Computer Science 2024-12-05 Tirtha Vinchurkar , Janghoon Ock , Amir Barati Farimani

Improving the interpretability of geospatial artificial intelligence (GeoAI) models has become critically important to open the "black box" of complex AI models, such as deep learning. This paper compares popular saliency map generation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Chia-Yu Hsu , Wenwen Li

Deep Neural Networks (DNNs) have demonstrated impressive performance in complex machine learning tasks such as image classification or speech recognition. However, due to their multi-layer nonlinear structure, they are not transparent,…

Computer Vision and Pattern Recognition · Computer Science 2015-09-22 Wojciech Samek , Alexander Binder , Grégoire Montavon , Sebastian Bach , Klaus-Robert Müller

Deep Learning (DL) models processing images to recognize the health state of large infrastructure components can exhibit biases and rely on non-causal shortcuts. eXplainable Artificial Intelligence (XAI) can address these issues but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Giovanni Floreale , Piero Baraldi , Enrico Zio , Olga Fink

The generation of privacy-preserving synthetic datasets is a promising avenue for overcoming data scarcity in medical AI research. Post-hoc privacy filtering techniques, designed to remove samples containing personally identifiable…

Machine Learning · Computer Science 2025-10-03 Adil Koeken , Alexander Ziller , Moritz Knolle , Daniel Rueckert

Although deep neural networks hold the state-of-the-art in several remote sensing tasks, their black-box operation hinders the understanding of their decisions, concealing any bias and other shortcomings in datasets and model performance.…

Machine Learning · Computer Science 2021-09-21 Ioannis Kakogeorgiou , Konstantinos Karantzalos

Saliency maps are a popular approach for explaining classifications of (convolutional) neural networks. However, it remains an open question as to how best to evaluate salience maps, with three families of evaluation methods commonly being…

Human-Computer Interaction · Computer Science 2025-04-25 Felix Kares , Timo Speith , Hanwei Zhang , Markus Langer

As AI-based medical devices are becoming more common in imaging fields like radiology and histology, interpretability of the underlying predictive models is crucial to expand their use in clinical practice. Existing heatmap-based…

Image and Video Processing · Electrical Eng. & Systems 2021-01-20 Kathryn Schutte , Olivier Moindrot , Paul Hérent , Jean-Baptiste Schiratti , Simon Jégou

Due to the black-box nature of deep learning models, there is a recent development of solutions for visual explanations of CNNs. Given the high cost of user studies, metrics are necessary to compare and evaluate these different methods. In…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Tristan Gomez , Thomas Fréour , Harold Mouchère

This paper provides empirical concerns about post-hoc explanations of black-box ML models, one of the major trends in AI explainability (XAI), by showing its lack of interpretability and societal consequences. Using a representative…

Human-Computer Interaction · Computer Science 2021-10-01 Jean-Marie John-Mathews

We present a computational explainability approach for human comparison tasks, using Alignment Importance Score (AIS) heatmaps derived from deep-vision models. The AIS reflects a feature-map's unique contribution to the alignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Nhut Truong , Dario Pesenti , Uri Hasson

A new brand of technical artificial intelligence ( Explainable AI ) research has focused on trying to open up the 'black box' and provide some explainability. This paper presents a novel visual explanation method for deep learning networks…

Computer Vision and Pattern Recognition · Computer Science 2020-06-08 Satya M. Muddamsetty , Mohammad N. S. Jahromi , Thomas B. Moeslund

Understanding the reasons behind the predictions made by deep neural networks is critical for gaining human trust in many important applications, which is reflected in the increasing demand for explainability in AI (XAI) in recent years.…

Human-Computer Interaction · Computer Science 2021-08-31 Xiaotian Lu , Arseny Tolmachev , Tatsuya Yamamoto , Koh Takeuchi , Seiji Okajima , Tomoyoshi Takebayashi , Koji Maruhashi , Hisashi Kashima