English
Related papers

Related papers: CAM-Based Methods Can See through Walls

200 papers

Saliency maps can explain a neural model's predictions by identifying important input features. They are difficult to interpret for laypeople, especially for instances with many features. In order to make them more accessible, we formalize…

Computation and Language · Computer Science 2023-06-08 Nils Feldhus , Leonhard Hennig , Maximilian Dustin Nasert , Christopher Ebert , Robert Schwarzenberg , Sebastian Möller

In high-stakes applications of machine learning models, interpretability methods provide guarantees that models are right for the right reasons. In medical imaging, saliency maps have become the standard tool for determining whether a…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Jacob Pfau , Albert T. Young , Maria L. Wei , Michael J. Keiser

Self-supervised learning holds promise in leveraging large numbers of unlabeled data. However, its success heavily relies on the highly-curated dataset, e.g., ImageNet, which still needs human cleaning. Directly learning representations…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Meilin Chen , Yizhou Wang , Shixiang Tang , Feng Zhu , Haiyang Yang , Lei Bai , Rui Zhao , Donglian Qi , Wanli Ouyang

Improving the interpretability of geospatial artificial intelligence (GeoAI) models has become critically important to open the "black box" of complex AI models, such as deep learning. This paper compares popular saliency map generation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Chia-Yu Hsu , Wenwen Li

This paper presents a tutorial of an explainable approach using Convolutional Neural Network (CNN) and Gradient-weighted Class Activation Mapping (Grad-CAM) to classify four progressive dementia stages based on open MRI brain images. The…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Kevin Kam Fung Yuen

Deep neural networks are ubiquitous due to the ease of developing models and their influence on other domains. At the heart of this progress is convolutional neural networks (CNNs) that are capable of learning representations or features…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Mohammed Bany Muhammad , Mohammed Yeasin

Graph convolutional neural network (GCN) has drawn increasing attention and attained good performance in various computer vision tasks, however, there lacks a clear interpretation of GCN's inner mechanism. For standard convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Zhenpeng Feng , Xiyang Cui , Hongbing Ji , Mingzhe Zhu , Ljubisa Stankovic

Deep learning based approaches to Computer Aided Diagnosis (CAD) typically pose the problem as an image classification (Normal or Abnormal) problem. These systems achieve high to very high accuracy in specific disease detection for which…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Aniket Joshi , Gaurav Mishra , Jayanthi Sivaswamy

Visual explanation maps enhance the trustworthiness of decisions made by deep learning models and offer valuable guidance for developing new algorithms in image recognition tasks. Class activation maps (CAM) and their variants (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Yi Liao , Ugochukwu Ejike Akpudo , Jue Zhang , Yongsheng Gao , Jun Zhou , Wenyi Zeng , Weichuan Zhang

The explication of Convolutional Neural Networks (CNN) through xAI techniques often poses challenges in interpretation. The inherent complexity of input features, notably pixels extracted from images, engenders complex correlations.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Caroline Mazini Rodrigues , Nicolas Boutry , Laurent Najman

Deep Learning has revolutionized machine learning, reaching unprecedented levels of accuracy, but at the cost of reduced interpretability. Especially in image processing systems, deep networks transform local pixel information into more…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Xinyi Zhang , Manuel Günther

Saliency Map, the gradient of the score function with respect to the input, is the most basic technique for interpreting deep neural network decisions. However, saliency maps are often visually noisy. Although several hypotheses were…

Machine Learning · Computer Science 2019-09-17 Beomsu Kim , Junghoon Seo , SeungHyun Jeon , Jamyoung Koo , Jeongyeol Choe , Taegyun Jeon

This work proposes a saliency-based attribution framework to evaluate and compare 10 state-of-the-art explainability methods for deep learning models in astronomy, focusing on the classification of radio galaxy images. While previous work…

Instrumentation and Methods for Astrophysics · Physics 2025-02-25 M. T. Atemkeng , C. Chuma , S. Zaza , C. D. Nunhokee , O. M. Smirnov

We investigate the problem of explainability for visual object detectors. Specifically, we demonstrate on the example of the YOLO object detector how to integrate Grad-CAM into the model architecture and analyze the results. We show how to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Armin Kirchknopf , Djordje Slijepcevic , Ilkay Wunderlich , Michael Breiter , Johannes Traxler , Matthias Zeppelzauer

Deep learning models have achieved promising results in breast cancer classification, yet their 'black-box' nature raises interpretability concerns. This research addresses the crucial need to gain insights into the decision-making process…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Ann-Kristin Balve , Peter Hendrix

In recent years, considerable work has been devoted to explaining predictive, deep learning-based models, and in turn how to evaluate explanations. An important class of evaluation methods are ones that are human-centered, which typically…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Yayan Zhao , Mingwei Li , Matthew Berger

Decision processes of computer vision models - especially deep neural networks - are opaque in nature, meaning that these decisions cannot be understood by humans. Thus, over the last years, many methods to provide human-understandable…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Benjamin Fresz , Lena Lörcher , Marco Huber

A fundamental bottleneck in utilising complex machine learning systems for critical applications has been not knowing why they do and what they do, thus preventing the development of any crucial safety protocols. To date, no method exist…

Machine Learning · Computer Science 2023-01-18 Jan Rosenzweig , Zoran Cvetkovic , Ivana Rosenzweig

The pixel-wise dense prediction tasks based on weakly supervisions currently use Class Attention Maps (CAM) to generate pseudo masks as ground-truth. However, the existing methods typically depend on the painstaking training modules, which…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Yanpeng Sun , Zechao Li

Saliency methods interpret the prediction of a neural network by showing the importance of input elements for that prediction. A popular family of saliency methods utilize gradient information. In this work, we empirically show that two…

Machine Learning · Computer Science 2020-12-02 Ashkan Khakzar , Soroosh Baselizadeh , Nassir Navab