English
Related papers

Related papers: CAM-Based Methods Can See through Walls

200 papers

Deep learning models often function as black boxes, providing no straightforward reasoning for their predictions. This is particularly true for computer vision models, which process tensors of pixel values to generate outcomes in tasks such…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Sachin Karmani , Thanushon Sivakaran , Gaurav Prasad , Mehmet Ali , Wenbo Yang , Sheyang Tang

The widespread use of black-box AI models has raised the need for algorithms and methods that explain the decisions made by these models. In recent years, the AI research community is increasingly interested in models' explainability since…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Savvas Karatsiolis , Andreas Kamilaris

Compared with expensive pixel-wise annotations, image-level labels make it possible to learn semantic segmentation in a weakly-supervised manner. Within this pipeline, the class activation map (CAM) is obtained and further processed to…

Computer Vision and Pattern Recognition · Computer Science 2022-01-06 Jiawei Liu , Jing Zhang , Yicong Hong , Nick Barnes

Saliency maps are a popular approach for explaining classifications of (convolutional) neural networks. However, it remains an open question as to how best to evaluate salience maps, with three families of evaluation methods commonly being…

Human-Computer Interaction · Computer Science 2025-04-25 Felix Kares , Timo Speith , Hanwei Zhang , Markus Langer

Convolutional Neural Networks (CNNs) have seen significant performance improvements in recent years. However, due to their size and complexity, they function as black-boxes, leading to transparency concerns. State-of-the-art saliency…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Antonio De Santis , Riccardo Campi , Matteo Bianchi , Marco Brambilla

Given a grayscale photograph, the colorization system estimates a visually plausible colorful image. Conventional methods often use semantics to colorize grayscale images. However, in these methods, only classification semantic information…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Yuzhi Zhao , Lai-Man Po , Kwok-Wai Cheung , Wing-Yin Yu , Yasar Abbas Ur Rehman

Currently available methods for extracting saliency maps identify parts of the input which are the most important to a specific fixed classifier. We show that this strong dependence on a given classifier hinders their performance. To…

Machine Learning · Computer Science 2020-07-21 Konrad Zolna , Krzysztof J. Geras , Kyunghyun Cho

We present Gradient Activation Maps (GAM) - a machinery for explaining predictions made by visual similarity and classification models. By gleaning localized gradient and activation information from multiple network layers, GAM offers…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Oren Barkan , Omri Armstrong , Amir Hertz , Avi Caciularu , Ori Katz , Itzik Malkiel , Noam Koenigstein

Human eyes concentrate different facial regions during distinct cognitive activities. We study utilising facial visual saliency maps to classify different facial expressions into different emotions. Our results show that our novel method of…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Zhenyue Qin , Jie Wu

Class activation mapping (CAM) is a widely adopted class of saliency methods used to explain the behavior of convolutional neural networks (CNNs). These methods generate heatmaps that highlight the parts of the input most relevant to the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Alejandro Luque-Cerpa , Elizabeth Polgreen , Ajitha Rajan , Hazem Torfah

Saliency maps that identify the most informative regions of an image for a classifier are valuable for model interpretability. A common approach to creating saliency maps involves generating input masks that mask out portions of an image to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Jason Phang , Jungkyu Park , Krzysztof J. Geras

Convolutional neural networks have been shown to develop internal representations, which correspond closely to semantically meaningful objects and parts, although trained solely on class labels. Class Activation Mapping (CAM) is a recent…

Computer Vision and Pattern Recognition · Computer Science 2016-05-26 Amir Rosenfeld , Shimon Ullman

Class activation map (CAM) has been widely used to highlight image regions that contribute to class predictions. Despite its simplicity and computational efficiency, CAM often struggles to identify discriminative regions that distinguish…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Ziheng Zhang , Jianyang Gu , Arpita Chowdhury , Zheda Mai , David Carlyn , Tanya Berger-Wolf , Yu Su , Wei-Lun Chao

In recent years, several advances have been observed in Deep Learning with surprising results. Models in this area have been increasingly used in numerous applications, including those sensitive to human life, which require clear…

Machine Learning · Computer Science 2026-05-05 Daniel da Silva Costa , Pedro Nuno de Souza Moura , Adriana C. F. Alvim

Deep learning models are used in critical applications, in which mistakes can have serious consequences. Therefore, it is crucial to understand how and why models generate predictions. This understanding provides useful information to check…

The introduction of saliency map algorithms as an approach for assessing the interoperability of images has allowed for a deeper understanding of current black-box models with Artificial Intelligence. Their rise in popularity has led to…

Image and Video Processing · Electrical Eng. & Systems 2023-06-29 Evan Kellener , Ihina Nath , An Ngo , Thomas Nguyen , Joshua Schuman , Coen Adler , Arnav Kartikeya

Deep learning models have achieved remarkable success across diverse domains. However, the intricate nature of these models often impedes a clear understanding of their decision-making processes. This is where Explainable AI (XAI) becomes…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Soham Mitra , Atri Sukul , Swalpa Kumar Roy , Pravendra Singh , Vinay Verma

Conventional saliency maps highlight input features to which neural network predictions are highly sensitive. We take a different approach to saliency, in which we identify and analyze the network parameters, rather than inputs, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Roman Levin , Manli Shu , Eitan Borgnia , Furong Huang , Micah Goldblum , Tom Goldstein

Neural networks are becoming increasingly better at tasks that involve classifying and recognizing images. At the same time techniques intended to explain the network output have been proposed. One such technique is the Gradient-based Class…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Mirtha Lucas , Miguel Lerma , Jacob Furst , Daniela Raicu

Model explanations such as saliency maps can improve user trust in AI by highlighting important features for a prediction. However, these become distorted and misleading when explaining predictions of images that are subject to systematic…

Human-Computer Interaction · Computer Science 2022-03-02 Wencan Zhang , Mariella Dimiccoli , Brian Y. Lim