English
Related papers

Related papers: Conceptor Learning for Class Activation Mapping

200 papers

Deep learning based medical image classifiers have shown remarkable prowess in various application areas like ophthalmology, dermatology, pathology, and radiology. However, the acceptance of these Computer-Aided Diagnosis (CAD) systems in…

The class activation mapping, or CAM, has been the cornerstone of feature attribution methods for multiple vision tasks. Its simplicity and effectiveness have led to wide applications in the explanation of visual predictions and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Jae Myung Kim , Junsuk Choe , Zeynep Akata , Seong Joon Oh

In this paper two new learning-based eXplainable AI (XAI) methods for deep convolutional neural network (DCNN) image classifiers, called L-CAM-Fm and L-CAM-Img, are proposed. Both methods use an attention mechanism that is inserted in the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Ioanna Gkartzonika , Nikolaos Gkalelis , Vasileios Mezaris

Importance estimators are explainability methods that quantify feature importance for deep neural networks (DNN). In vision transformers (ViT), the self-attention mechanism naturally leads to attention maps, which are sometimes interpreted…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Lennart Brocki , Jakub Binda , Neo Christopher Chung

Deep Learning has revolutionized machine learning, reaching unprecedented levels of accuracy, but at the cost of reduced interpretability. Especially in image processing systems, deep networks transform local pixel information into more…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Xinyi Zhang , Manuel Günther

With the intervention of machine vision in our crucial day to day necessities including healthcare and automated power plants, attention has been drawn to the internal mechanisms of convolutional neural networks, and the reason why the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Ram S Iyer , Narayan S Iyer , Rugmini Ammal P

Interpretability is a critical factor in applying complex deep learning models to advance the understanding of brain disorders in neuroimaging studies. To interpret the decision process of a trained classifier, existing techniques typically…

Image and Video Processing · Electrical Eng. & Systems 2021-06-29 Zixuan Liu , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao

Deep Neural Networks have often been called the black box because of the complex, deep architecture and non-transparency presented by the inner layers. There is a lack of trust to use Artificial Intelligence in critical and high-precision…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Frincy Clement , Ji Yang , Irene Cheng

We propose a technique for producing "visual explanations" for decisions from a large class of CNN-based models, making them more transparent. Our approach - Gradient-weighted Class Activation Mapping (Grad-CAM), uses the gradients of any…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Ramprasaath R. Selvaraju , Michael Cogswell , Abhishek Das , Ramakrishna Vedantam , Devi Parikh , Dhruv Batra

Deep neural networks (DNNs) are being increasingly used to make predictions from functional magnetic resonance imaging (fMRI) data. However, they are widely seen as uninterpretable "black boxes", as it can be difficult to discover what…

Machine Learning · Computer Science 2020-12-18 Patrick McClure , Dustin Moraczewski , Ka Chun Lam , Adam Thomas , Francisco Pereira

We propose a technique for making Convolutional Neural Network (CNN)-based models more transparent by visualizing input regions that are 'important' for predictions -- or visual explanations. Our approach, called Gradient-weighted Class…

The need for clear, trustworthy explanations of deep learning model predictions is essential for high-criticality fields, such as medicine and biometric identification. Class Activation Maps (CAMs) are an increasingly popular category of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Emily Kaczmarek , Olivier X. Miguel , Alexa C. Bowie , Robin Ducharme , Alysha L. J. Dingwall-Harvey , Steven Hawken , Christine M. Armour , Mark C. Walker , Kevin Dick

Convolutional Neural Networks (CNNs) are known for their ability to learn hierarchical structures, naturally developing detectors for objects, and semantic concepts within their deeper layers. Activation maps (AMs) reveal these saliency…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Aray Karjauv , Sahin Albayrak

The Convolutional Neural Network (CNN) is a widely used deep learning architecture for computer vision. However, its black box nature makes it difficult to interpret the behavior of the model. To mitigate this issue, AI practitioners have…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Seok-Yong Byun , Wonju Lee

Convolutional Neural Networks (CNNs) have seen significant performance improvements in recent years. However, due to their size and complexity, they function as black-boxes, leading to transparency concerns. State-of-the-art saliency…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Antonio De Santis , Riccardo Campi , Matteo Bianchi , Marco Brambilla

Deep learning techniques have proven highly effective in image classification, but their deployment in resourceconstrained environments remains challenging due to high computational demands. Furthermore, their interpretability is of high…

Machine Learning · Computer Science 2024-12-06 Alireza Maleki , Mahsa Lavaei , Mohsen Bagheritabar , Salar Beigzad , Zahra Abadi

Visualizing the features captured by Convolutional Neural Networks (CNNs) is one of the conventional approaches to interpret the predictions made by these models in numerous image recognition applications. Grad-CAM is a popular solution…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Sam Sattarzadeh , Mahesh Sudhakar , Konstantinos N. Plataniotis , Jongseong Jang , Yeonjeong Jeong , Hyunwoo Kim

Can deep learning models achieve greater generalization if their training is guided by reference to human perceptual abilities? And how can we implement this in a practical manner? This paper proposes a training strategy to ConveY Brain…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Aidan Boyd , Patrick Tinsley , Kevin Bowyer , Adam Czajka

Traditional deep learning interpretability methods which are suitable for model users cannot explain network behaviors at the global level and are inflexible at providing fine-grained explanations. As a solution, concept-based explanations…

Human-Computer Interaction · Computer Science 2022-10-26 Jinbin Huang , Aditi Mishra , Bum Chul Kwon , Chris Bryan

Extracting class activation maps (CAM) is a key step for weakly-supervised semantic segmentation (WSSS). The CAM of convolution neural networks fails to capture long-range feature dependency on the image and result in the coverage on only…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Jianqiang Huang , Jian Wang , Qianru Sun , Hanwang Zhang