English
Related papers

Related papers: Visual Explanation via Similar Feature Activation …

200 papers

Class Activation Mapping (CAM) methods have recently gained much attention for weakly-supervised object localization (WSOL) tasks. They allow for CNN visualization and interpretation without training on fully annotated image datasets. CAM…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Soufiane Belharbi , Aydin Sarraf , Marco Pedersoli , Ismail Ben Ayed , Luke McCaffrey , Eric Granger

Convolutional neural networks (CNNs) achieve prevailing results in segmentation tasks nowadays and represent the state-of-the-art for image-based analysis. However, the understanding of the accurate decision-making process of a CNN is…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Tillmann Rheude , Andreas Wirtz , Arjan Kuijper , Stefan Wesarg

Understanding and explaining deep learning models is an imperative task. Towards this, we propose a method that obtains gradient-based certainty estimates that also provide visual attention maps. Particularly, we solve for visual question…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Badri N. Patro , Mayank Lunayach , Shivansh Patel , Vinay P. Namboodiri

Class activation maps are widely used for explaining deep neural networks. Due to its ability to highlight regions of interest, it has evolved in recent years as a key step in weakly supervised learning. A major limitation to the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Hang-Cheng Dong , Yuhao Jiang , Yingyan Huang , Jingxiao Liao , Bingguo Liu , Dong Ye , Guodong Liu

The pixel-wise dense prediction tasks based on weakly supervisions currently use Class Attention Maps (CAM) to generate pseudo masks as ground-truth. However, the existing methods typically depend on the painstaking training modules, which…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Yanpeng Sun , Zechao Li

Few-shot classification (FSC) is one of the most concerned hot issues in recent years. The general setting consists of two phases: (1) Pre-train a feature extraction model (FEM) with base data (has large amounts of labeled samples). (2) Use…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Shuai Shao , Lei Xing , Yixin Chen , Yan-Jiang Wang , Bao-Di Liu , Yicong Zhou

We consider the problem of visually explaining similarity models, i.e., explaining why a model predicts two images to be similar in addition to producing a scalar score. While much recent work in visual model interpretability has focused on…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Meng Zheng , Srikrishna Karanam , Terrence Chen , Richard J. Radke , Ziyan Wu

Convolutional neural networks (CNNs) are widely used for high-stakes applications like medicine, often surpassing human performance. However, most explanation methods rely on post-hoc attribution, approximating the decision-making process…

Machine Learning · Computer Science 2026-02-23 Kerol Djoumessi , Philipp Berens

Deep learning models suffer from opaqueness. For Convolutional Neural Networks (CNNs), current research strategies for explaining models focus on the target classes within the associated training dataset. As a result, the understanding of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Xuehao Liu , Sarah Jane Delany , Susan McKeever

Class Activation Mapping (CAM) methods are widely used to visualize neural network decisions, yet their underlying mechanisms remain incompletely understood. To enhance the understanding of CAM methods and improve their explainability, we…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Huaiguang Cai

This work explores the visual explanation for deep metric learning and its applications. As an important problem for learning representation, metric learning has attracted much attention recently, while the interpretation of such model is…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Sijie Zhu , Taojiannan Yang , Chen Chen

Class Activation Mapping (CAM) and its gradient-based variants (e.g., GradCAM) have become standard tools for explaining Convolutional Neural Network (CNN) predictions. However, these approaches typically focus on individual logits, while…

Machine Learning · Computer Science 2026-04-10 Jacob Piland , Chris Sweet , Adam Czajka

Judging the similarity of visualizations is crucial to various applications, such as visualization-based search and visualization recommendation systems. Recent studies show deep-feature-based similarity metrics correlate well with…

Human-Computer Interaction · Computer Science 2025-03-04 Sheng Long , Angelos Chatzimparmpas , Emma Alexander , Matthew Kay , Jessica Hullman

Recently, increasing attention has been drawn to the internal mechanisms of convolutional neural networks, and the reason why the network makes specific decisions. In this paper, we develop a novel post-hoc visual explanation method called…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Haofan Wang , Zifan Wang , Mengnan Du , Fan Yang , Zijian Zhang , Sirui Ding , Piotr Mardziel , Xia Hu

Machine learning models, by virtue of training, learn a large repertoire of decision rules for any given input, and any one of these may suffice to justify a prediction. However, in high-dimensional input spaces, such rules are difficult to…

Machine Learning · Computer Science 2025-12-02 Pirzada Suhail , Aditya Anand , Amit Sethi

Gradient-weighted Class Activation Mapping (Grad- CAM), is an example-based explanation method that provides a gradient activation heat map as an explanation for Convolution Neural Network (CNN) models. The drawback of this method is that…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Tanmay Chakraborty , Utkarsh Trehan , Khawla Mallat , Jean-Luc Dugelay

The need for clear, trustworthy explanations of deep learning model predictions is essential for high-criticality fields, such as medicine and biometric identification. Class Activation Maps (CAMs) are an increasingly popular category of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Emily Kaczmarek , Olivier X. Miguel , Alexa C. Bowie , Robin Ducharme , Alysha L. J. Dingwall-Harvey , Steven Hawken , Christine M. Armour , Mark C. Walker , Kevin Dick

Deep learning models often function as black boxes, providing no straightforward reasoning for their predictions. This is particularly true for computer vision models, which process tensors of pixel values to generate outcomes in tasks such…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Sachin Karmani , Thanushon Sivakaran , Gaurav Prasad , Mehmet Ali , Wenbo Yang , Sheyang Tang

Deep neural networks are ubiquitous due to the ease of developing models and their influence on other domains. At the heart of this progress is convolutional neural networks (CNNs) that are capable of learning representations or features…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Mohammed Bany Muhammad , Mohammed Yeasin

Class Activation Mapping (CAM) and its extensions have become indispensable tools for visualizing the evidence behind deep network predictions. However, by relying on a final softmax classifier, these methods suffer from two fundamental…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Yoojin Oh , Junhyug Noh