English
Related papers

Related papers: Metric-Guided Synthesis of Class Activation Mappin…

200 papers

Neural networks are becoming increasingly better at tasks that involve classifying and recognizing images. At the same time techniques intended to explain the network output have been proposed. One such technique is the Gradient-based Class…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Mirtha Lucas , Miguel Lerma , Jacob Furst , Daniela Raicu

We present Gradient Activation Maps (GAM) - a machinery for explaining predictions made by visual similarity and classification models. By gleaning localized gradient and activation information from multiple network layers, GAM offers…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Oren Barkan , Omri Armstrong , Amir Hertz , Avi Caciularu , Ori Katz , Itzik Malkiel , Noam Koenigstein

Deep neural networks have been widely adopted in numerous domains due to their high performance and accessibility to developers and application-specific end-users. Fundamental to image-based applications is the development of Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Emily Kaczmarek , Olivier X. Miguel , Alexa C. Bowie , Robin Ducharme , Alysha L. J. Dingwall-Harvey , Steven Hawken , Christine M. Armour , Mark C. Walker , Kevin Dick

Deep Learning has revolutionized machine learning, reaching unprecedented levels of accuracy, but at the cost of reduced interpretability. Especially in image processing systems, deep networks transform local pixel information into more…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Xinyi Zhang , Manuel Günther

Class activation map (CAM) has been widely used to highlight image regions that contribute to class predictions. Despite its simplicity and computational efficiency, CAM often struggles to identify discriminative regions that distinguish…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Ziheng Zhang , Jianyang Gu , Arpita Chowdhury , Zheda Mai , David Carlyn , Tanya Berger-Wolf , Yu Su , Wei-Lun Chao

This paper addresses the visualization task of deep learning models. To improve Class Activation Mapping (CAM) based visualization method, we offer two options. First, we propose Gaussian upsampling, an improved upsampling method that can…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Bum Jun Kim , Gyogwon Koo , Hyeyeon Choi , Sang Woo Kim

Security researchers grapple with the surge of malicious files, necessitating swift identification and classification of malware strains for effective protection. Visual classifiers and in particular Convolutional Neural Networks (CNNs)…

Cryptography and Security · Computer Science 2025-03-05 Matteo Brosolo , Vinod Puthuvath , Mauro Conti

Given a grayscale photograph, the colorization system estimates a visually plausible colorful image. Conventional methods often use semantics to colorize grayscale images. However, in these methods, only classification semantic information…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Yuzhi Zhao , Lai-Man Po , Kwok-Wai Cheung , Wing-Yin Yu , Yasar Abbas Ur Rehman

We propose a CNN based technique that aggregates feature maps from its multiple layers that can localize abnormalities with greater details as well as predict pathology under consideration. Existing class activation mapping (CAM) techniques…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Sumeet Shinde , Tanay Chougule , Jitender Saini , Madhura Ingalhalikar

Although saliency maps can highlight important regions to explain the reasoning behind image classification in artificial intelligence (AI), the meaning of these regions is left to the user's interpretation. In contrast, conceptbased…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Michihiro Kuroki , Toshihiko Yamasaki

The widespread use of black-box AI models has raised the need for algorithms and methods that explain the decisions made by these models. In recent years, the AI research community is increasingly interested in models' explainability since…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Savvas Karatsiolis , Andreas Kamilaris

Convolutional neural networks (CNNs) are commonly used for image classification. Saliency methods are examples of approaches that can be used to interpret CNNs post hoc, identifying the most relevant pixels for a prediction following the…

Machine Learning · Computer Science 2020-10-01 Nicholas Halliwell , Freddy Lecue

Saliency methods compute heat maps that highlight portions of an input that were most {\em important} for the label assigned to it by a deep net. Evaluations of saliency methods convert this heat map into a new {\em masked input} by…

Machine Learning · Statistics 2022-11-08 Arushi Gupta , Nikunj Saunshi , Dingli Yu , Kaifeng Lyu , Sanjeev Arora

Data series classification is an important and challenging problem in data science. Explaining the classification decisions by finding the discriminant parts of the input that led the algorithm to some decisions is a real need in many…

Machine Learning · Computer Science 2022-07-26 Paul Boniol , Mohammed Meftah , Emmanuel Remy , Themis Palpanas

This paper presents a tutorial of an explainable approach using Convolutional Neural Network (CNN) and Gradient-weighted Class Activation Mapping (Grad-CAM) to classify four progressive dementia stages based on open MRI brain images. The…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Kevin Kam Fung Yuen

Saliency methods can make deep neural network predictions more interpretable by identifying a set of critical features in an input sample, such as pixels that contribute most strongly to a prediction made by an image classifier.…

Machine Learning · Computer Science 2021-06-15 Yang Lu , Wenbo Guo , Xinyu Xing , William Stafford Noble

Extracting class activation maps (CAM) from a classification model often results in poor coverage on foreground objects, i.e., only the discriminative region (e.g., the "head" of "sheep") is recognized and the rest (e.g., the "leg" of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Zhaozheng Chen , Qianru Sun

The Convolutional Neural Network (CNN) is a widely used deep learning architecture for computer vision. However, its black box nature makes it difficult to interpret the behavior of the model. To mitigate this issue, AI practitioners have…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Seok-Yong Byun , Wonju Lee

We propose a framework inspired by biological vision systems to produce saliency maps of digital images. Well-known computational models for receptive fields of areas in the visual cortex that are specialized for color and orientation…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Reza Hojjaty Saeedy , Richard A. Messner

Machine Learning (ML) is a fundamental part of modern perception systems. In the last decade, the performance of computer vision using trained deep neural networks has outperformed previous approaches based on careful feature engineering.…

Software Engineering · Computer Science 2021-03-03 Markus Borg , Ronald Jabangwe , Simon Åberg , Arvid Ekblom , Ludwig Hedlund , August Lidfeldt