中文
相关论文

相关论文: Evaluating Input Perturbation Methods for Interpre…

200 篇论文

Saliency maps can explain how deep neural networks classify images. But are they actually useful for humans? The present systematic review of 68 user studies found that while saliency maps can enhance human performance, null effects or even…

人机交互 · 计算机科学 2024-08-20 Romy Müller

The performance of convolutional neural networks has continued to improve over the last decade. At the same time, as model complexity grows, it becomes increasingly more difficult to explain model decisions. Such explanations may be of…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Colton Crum , Patrick Tinsley , Aidan Boyd , Jacob Piland , Christopher Sweet , Timothy Kelley , Kevin Bowyer , Adam Czajka

Methods based on class activation maps (CAM) provide a simple mechanism to interpret predictions of convolutional neural networks by using linear combinations of feature maps as saliency maps. By contrast, masking-based methods optimize a…

计算机视觉与模式识别 · 计算机科学 2024-04-08 Hanwei Zhang , Felipe Torres , Ronan Sicre , Yannis Avrithis , Stephane Ayache

Visual saliency prediction using transformers - Convolutional neural networks (CNNs) have significantly advanced computational modelling for saliency prediction. However, accurately simulating the mechanisms of visual attention in the human…

多媒体 · 计算机科学 2022-06-30 Jianxun Lou , Hanhe Lin , David Marshall , Dietmar Saupe , Hantao Liu

In this work, we investigate methods to reduce the noise in deep saliency maps coming from convolutional downsampling. Those methods make the investigated models more interpretable for gradient-based saliency maps, computed in hidden…

计算机视觉与模式识别 · 计算机科学 2024-08-09 Rudolf Herdt , Maximilian Schmidt , Daniel Otero Baguer , Peter Maaß

Saliency maps can explain a neural model's predictions by identifying important input features. They are difficult to interpret for laypeople, especially for instances with many features. In order to make them more accessible, we formalize…

Saliency methods have been widely used to highlight important input features in model predictions. Most existing methods use backpropagation on a modified gradient function to generate saliency maps. Thus, noisy gradients can result in…

计算机视觉与模式识别 · 计算机科学 2021-11-30 Aya Abdelsalam Ismail , Héctor Corrada Bravo , Soheil Feizi

Gradient-based analysis methods, such as saliency map visualizations and adversarial input perturbations, have found widespread use in interpreting neural NLP models due to their simplicity, flexibility, and most importantly, their…

计算与语言 · 计算机科学 2020-10-13 Junlin Wang , Jens Tuyls , Eric Wallace , Sameer Singh

Clinical applicability of automated decision support systems depends on a robust, well-understood classification interpretation. Artificial neural networks while achieving class-leading scores fall short in this regard. Therefore, numerous…

计算机视觉与模式识别 · 计算机科学 2020-04-06 David Major , Dimitrios Lenis , Maria Wimmer , Gert Sluiter , Astrid Berg , Katja Bühler

Long Short-Term Memory (LSTM) Networks and Convolutional Neural Networks (CNN) have become very common and are used in many fields as they were effective in solving many problems where the general neural networks were inefficient. They were…

机器学习 · 计算机科学 2019-03-19 Mahidhar Dwarampudi , N V Subba Reddy

Path loss prediction is a beneficial tool for efficient use of the radio frequency spectrum. Building on prior research on high-resolution map-based path loss models, this paper studies convolutional neural network input representations in…

机器学习 · 计算机科学 2026-02-05 Ryan G. Dempsey , Jonathan Ethier , Halim Yanikomeroglu

We present a set of metrics that utilize vision priors to effectively assess the performance of saliency methods on image classification tasks. To understand behavior in deep learning models, many methods provide visual saliency maps…

计算机视觉与模式识别 · 计算机科学 2023-09-21 Rangel Daroya , Aaron Sun , Subhransu Maji

Saliency maps have become a widely used method to make deep learning models more interpretable by providing post-hoc explanations of classifiers through identification of the most pertinent areas of the input medical image. They are…

Saliency methods seek to explain the predictions of a model by producing an importance map across each input sample. A popular class of such methods is based on backpropagating a signal and analyzing the resulting gradient. Despite much…

计算机视觉与模式识别 · 计算机科学 2020-04-07 Sylvestre-Alvise Rebuffi , Ruth Fong , Xu Ji , Andrea Vedaldi

Binarized Neural Networks (BNNs) have the potential to revolutionize the way that deep learning is carried out in edge computing platforms. However, the effectiveness of interpretability methods on these networks has not been assessed. In…

计算机视觉与模式识别 · 计算机科学 2021-06-24 Amy Widdicombe , Simon J. Julier

Deep neural networks (DNNs) are being increasingly used to make predictions from functional magnetic resonance imaging (fMRI) data. However, they are widely seen as uninterpretable "black boxes", as it can be difficult to discover what…

机器学习 · 计算机科学 2020-12-18 Patrick McClure , Dustin Moraczewski , Ka Chun Lam , Adam Thomas , Francisco Pereira

Existing saliency-guided training approaches improve model generalization by incorporating a loss term that compares the model's class activation map (CAM) for a sample's true-class ({\it i.e.}, correct-label class) against a human…

计算机视觉与模式识别 · 计算机科学 2025-07-24 Jacob Piland , Chris Sweet , Adam Czajka

With recent advances in deep learning, neuroimaging studies increasingly rely on convolutional networks (ConvNets) to predict diagnosis based on MR images. To gain a better understanding of how a disease impacts the brain, the studies…

机器学习 · 计算机科学 2021-06-29 Qingyu Zhao , Ehsan Adeli , Adolf Pfefferbaum , Edith V. Sullivan , Kilian M. Pohl

Visual saliency is a fundamental problem in both cognitive and computational sciences, including computer vision. In this CVPR 2015 paper, we discover that a high-quality visual saliency model can be trained with multiscale features…

计算机视觉与模式识别 · 计算机科学 2015-04-13 Guanbin Li , Yizhou Yu

Deep convolutional neural networks have demonstrated high performances for fixation prediction in recent years. How they achieve this, however, is less explored and they remain to be black box models. Here, we attempt to shed light on the…

计算机视觉与模式识别 · 计算机科学 2018-03-23 Sen He , Ali Borji , Yang Mi , Nicolas Pugeault