English
Related papers

Related papers: U-CAM: Visual Explanation using Uncertainty based …

200 papers

In this work, we introduce a novel Deep Learning-based method to perceive the environment of a vehicle based on radar scans while accounting for uncertainties in its predictions. The environment of the host vehicle is segmented into equally…

Machine Learning · Computer Science 2023-06-06 Marco Braun , Moritz Luszek , Jan Siegemund , Kevin Kollek , Anton Kummert

Visualizing the features captured by Convolutional Neural Networks (CNNs) is one of the conventional approaches to interpret the predictions made by these models in numerous image recognition applications. Grad-CAM is a popular solution…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Sam Sattarzadeh , Mahesh Sudhakar , Konstantinos N. Plataniotis , Jongseong Jang , Yeonjeong Jeong , Hyunwoo Kim

Class activation map (CAM) helps to formulate saliency maps that aid in interpreting the deep neural network's prediction. Gradient-based methods are generally faster than other branches of vision interpretability and independent of human…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Masud An Nur Islam Fahim , Nazmus Saqib , Shafkat Khan Siam , Ho Yub Jung

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

Machine Learning · Computer Science 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

This paper presents a novel approach to address the challenges of understanding the prediction process and debugging prediction errors in Vision Transformers (ViT), which have demonstrated superior performance in various computer vision…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Seok-Yong Byun , Wonju Lee

Uncertainty quantification in automated image analysis is highly desired in many applications. Typically, machine learning models in classification or segmentation are only developed to provide binary answers; however, quantifying the…

Predictions made by deep learning models are prone to data perturbations, adversarial attacks, and out-of-distribution inputs. To build a trusted AI system, it is therefore critical to accurately quantify the prediction uncertainties. While…

Machine Learning · Computer Science 2023-04-12 Hanjing Wang , Dhiraj Joshi , Shiqiang Wang , Qiang Ji

While there has been substantial progress in learning suitable distance metrics, these techniques in general lack transparency and decision reasoning, i.e., explaining why the input set of images is similar or dissimilar. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Meng Zheng , Srikrishna Karanam , Terrence Chen , Richard J. Radke , Ziyan Wu

Importance estimators are explainability methods that quantify feature importance for deep neural networks (DNN). In vision transformers (ViT), the self-attention mechanism naturally leads to attention maps, which are sometimes interpreted…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Lennart Brocki , Jakub Binda , Neo Christopher Chung

Over the last decade, Convolutional Neural Network (CNN) models have been highly successful in solving complex vision problems. However, these deep models are perceived as "black box" methods considering the lack of understanding of their…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Aditya Chattopadhyay , Anirban Sarkar , Prantik Howlader , Vineeth N Balasubramanian

The great success that deep models have achieved in the past is mainly owed to large amounts of labeled training data. However, the acquisition of labeled data for new tasks aside from existing benchmarks is both challenging and costly.…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Clemens-Alexander Brust , Christoph Käding , Joachim Denzler

Uncertainty quantification of deep neural networks has become an active field of research and plays a crucial role in various downstream tasks such as active learning. Recent advances in evidential deep learning shed light on the direct…

Machine Learning · Computer Science 2023-11-21 Ruxiao Duan , Brian Caffo , Harrison X. Bai , Haris I. Sair , Craig Jones

Vision Transformer(ViT) is one of the most widely used models in the computer vision field with its great performance on various tasks. In order to fully utilize the ViT-based architecture in various applications, proper visualization…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Saebom Leem , Hyunseok Seo

Neural networks are becoming increasingly better at tasks that involve classifying and recognizing images. At the same time techniques intended to explain the network output have been proposed. One such technique is the Gradient-based Class…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Mirtha Lucas , Miguel Lerma , Jacob Furst , Daniela Raicu

This document summarizes different visual explanations methods such as CAM, Grad-CAM, Localization using Multiple Instance Learning - Saliency-based methods, Saliency-driven Class-Impressions, Muting pixels in input image - Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Dipesh Tamboli

Visual explanation maps enhance the trustworthiness of decisions made by deep learning models and offer valuable guidance for developing new algorithms in image recognition tasks. Class activation maps (CAM) and their variants (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Yi Liao , Ugochukwu Ejike Akpudo , Jue Zhang , Yongsheng Gao , Jun Zhou , Wenyi Zeng , Weichuan Zhang

Decisions made by convolutional neural networks(CNN) can be understood and explained by visualizing discriminative regions on images. To this end, Class Activation Map (CAM) based methods were proposed as powerful interpretation tools,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Yi Liao , Yongsheng Gao , Weichuan Zhang

In this work, we propose a deep neural architecture that uses an attention mechanism which utilizes region based image features, the natural language question asked, and semantic knowledge extracted from the regions of an image to produce…

Computation and Language · Computer Science 2021-04-06 Tasmia Tasrin , Md Sultan Al Nahian , Brent Harrison

Class Activation Mapping (CAM) is a powerful technique used to understand the decision making of Convolutional Neural Network (CNN) in computer vision. Recently, there have been attempts not only to generate better visual explanations, but…

Machine Learning · Computer Science 2021-05-04 Kwang Hee Lee , Chaewon Park , Junghyun Oh , Nojun Kwak

Deep neural network models have recently draw lots of attention, as it consistently produce impressive results in many computer vision tasks such as image classification, object detection, etc. However, interpreting such model and show the…

Machine Learning · Computer Science 2019-01-30 Shipeng Xie , Da Chen , Rong Zhang , Hui Xue