中文
相关论文

相关论文: Saliency Methods for Explaining Adversarial Attack…

200 篇论文

Deep neural networks have shown their profound impact on achieving human level performance in visual saliency prediction. However, it is still unclear how they learn the task and what it means in terms of understanding human visual system.…

计算机视觉与模式识别 · 计算机科学 2021-09-09 Sai Phani Kumar Malladi , Jayanta Mukhopadhyay , Chaker Larabi , Santanu Chaudhury

Saliency methods interpret the prediction of a neural network by showing the importance of input elements for that prediction. A popular family of saliency methods utilize gradient information. In this work, we empirically show that two…

机器学习 · 计算机科学 2020-12-02 Ashkan Khakzar , Soroosh Baselizadeh , Nassir Navab

Saliency maps are a popular approach for explaining classifications of (convolutional) neural networks. However, it remains an open question as to how best to evaluate salience maps, with three families of evaluation methods commonly being…

人机交互 · 计算机科学 2025-04-25 Felix Kares , Timo Speith , Hanwei Zhang , Markus Langer

Saliency maps have proven to be a highly efficacious approach for explicating the decisions of Convolutional Neural Networks. However, extant methodologies predominantly rely on gradients, which constrain their ability to explicate complex…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Zijian Ying , Qianmu Li , Zhichao Lian , Jun Hou , Tong Lin , Tao Wang

Convolutional neural networks have been used to achieve a string of successes during recent years, but their lack of interpretability remains a serious issue. Adversarial examples are designed to deliberately fool neural networks into…

机器学习 · 计算机科学 2020-04-28 Jan Philip Göpfert , André Artelt , Heiko Wersing , Barbara Hammer

Despite the remarkable success of deep neural networks, significant concerns have emerged about their robustness to adversarial perturbations to inputs. While most attacks aim to ensure that these are imperceptible, physical perturbation…

机器学习 · 计算机科学 2020-10-09 Liang Tong , Minzhe Guo , Atul Prakash , Yevgeniy Vorobeychik

Gradient-based saliency methods such as Vanilla Gradient (VG) and Integrated Gradients (IG) are widely used to explain image classifiers, yet the resulting maps are often noisy and unstable, limiting their usefulness in high-stakes…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Dipkamal Bhusal , Md Tanvirul Alam , Nidhi Rastogi

Adversarial algorithms have shown to be effective against neural networks for a variety of tasks. Some adversarial algorithms perturb all the pixels in the image minimally for the image classification task in image classification. In…

计算机视觉与模式识别 · 计算机科学 2021-06-11 Shashank Kotyan , Danilo Vasconcellos Vargas

Interpretability is crucial to understand the inner workings of deep neural networks (DNNs) and many interpretation methods generate saliency maps that highlight parts of the input image that contribute the most to the prediction made by…

密码学与安全 · 计算机科学 2022-07-21 Shihong Fang , Anna Choromanska

Decision processes of computer vision models - especially deep neural networks - are opaque in nature, meaning that these decisions cannot be understood by humans. Thus, over the last years, many methods to provide human-understandable…

计算机视觉与模式识别 · 计算机科学 2024-06-10 Benjamin Fresz , Lena Lörcher , Marco Huber

We consider the problem of the stability of saliency-based explanations of Neural Network predictions under adversarial attacks in a classification task. Saliency interpretations of deterministic Neural Networks are remarkably brittle even…

机器学习 · 计算机科学 2022-05-06 Ginevra Carbone , Guido Sanguinetti , Luca Bortolussi

We present a novel method for reliably explaining the predictions of neural networks. We consider an explanation reliable if it identifies input features relevant to the model output by considering the input and the neighboring data points.…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Dohun Lim , Hyeonseok Lee , Sungchan Kim

Deep neural networks (DNNs) are being increasingly used to make predictions from functional magnetic resonance imaging (fMRI) data. However, they are widely seen as uninterpretable "black boxes", as it can be difficult to discover what…

机器学习 · 计算机科学 2020-12-18 Patrick McClure , Dustin Moraczewski , Ka Chun Lam , Adam Thomas , Francisco Pereira

In this paper, we introduce an enhanced textual adversarial attack method, known as Saliency Attention and Semantic Similarity driven adversarial Perturbation (SASSP). The proposed scheme is designed to improve the effectiveness of…

密码学与安全 · 计算机科学 2025-05-22 Hetvi Waghela , Jaydip Sen , Sneha Rakshit

This paper investigates the role of saliency to improve the classification accuracy of a Convolutional Neural Network (CNN) for the case when scarce training data is available. Our approach consists in adding a saliency branch to an…

计算机视觉与模式识别 · 计算机科学 2019-05-07 Carola Figueroa Flores , Abel Gonzalez-García , Joost van de Weijer , Bogdan Raducanu

There is great interest in "saliency methods" (also called "attribution methods"), which give "explanations" for a deep net's decision, by assigning a "score" to each feature/pixel in the input. Their design usually involves…

机器学习 · 计算机科学 2019-06-10 Arushi Gupta , Sanjeev Arora

Currently available methods for extracting saliency maps identify parts of the input which are the most important to a specific fixed classifier. We show that this strong dependence on a given classifier hinders their performance. To…

机器学习 · 计算机科学 2020-07-21 Konrad Zolna , Krzysztof J. Geras , Kyunghyun Cho

Capsule Networks, as alternatives to Convolutional Neural Networks, have been proposed to recognize objects from images. The current literature demonstrates many advantages of CapsNets over CNNs. However, how to create explanations for…

计算机视觉与模式识别 · 计算机科学 2021-03-09 Jindong Gu , Volker Tresp

Transparency and explainability in image classification are essential for establishing trust in machine learning models and detecting biases and errors. State-of-the-art explainability methods generate saliency maps to show where a specific…

机器学习 · 计算机科学 2024-07-30 Matteo Bianchi , Antonio De Santis , Andrea Tocchetti , Marco Brambilla

Graph Neural Networks (GNNs) have gained prominence for their ability to process graph-structured data across various domains. However, interpreting GNN decisions remains a significant challenge, leading to the adoption of saliency maps for…

机器学习 · 统计学 2025-09-04 Shuichi Nishino , Tomohiro Shiraishi , Teruyuki Katsuoka , Ichiro Takeuchi