中文
相关论文

相关论文: Adversarial Attacks on the Interpretation of Neuro…

200 篇论文

Deep neural networks (DNNs) have had many successes, but they suffer from two major issues: (1) a vulnerability to adversarial examples and (2) a tendency to elude human interpretation. Interestingly, recent empirical and theoretical…

机器学习 · 计算机科学 2020-12-07 Adam Noack , Isaac Ahern , Dejing Dou , Boyang Li

Deep neural networks have been widely used in text classification. However, it is hard to interpret the neural models due to the complicate mechanisms. In this work, we study the interpretability of a variant of the typical text…

计算与语言 · 计算机科学 2019-10-25 Hao Cheng , Xiaoqing Yang , Zang Li , Yanghua Xiao , Yucheng Lin

Deep learning methods have gained increased attention in various applications due to their outstanding performance. For exploring how this high performance relates to the proper use of data artifacts and the accurate problem formulation of…

密码学与安全 · 计算机科学 2022-11-30 Eldor Abdukhamidov , Mohammed Abuhamad , Simon S. Woo , Eric Chan-Tin , Tamer Abuhmed

Adversarial attacks can generate adversarial inputs by applying small but intentionally worst-case perturbations to samples from the dataset, which leads to even state-of-the-art deep neural networks outputting incorrect answers with high…

机器学习 · 计算机科学 2024-01-08 Shorya Sharma

Deep reinforcement learning models are vulnerable to adversarial attacks that can decrease a victim's cumulative expected reward by manipulating the victim's observations. Despite the efficiency of previous optimization-based methods for…

机器学习 · 计算机科学 2023-02-28 You Qiaoben , Chengyang Ying , Xinning Zhou , Hang Su , Jun Zhu , Bo Zhang

When developing AI systems that interact with humans, it is essential to design both a system that can understand humans, and a system that humans can understand. Most deep network based agent-modeling approaches are 1) not interpretable…

机器学习 · 计算机科学 2021-07-14 Ini Oguntola , Dana Hughes , Katia Sycara

Deep neural networks have been shown to be fooled rather easily using adversarial attack algorithms. Practical methods such as adversarial patches have been shown to be extremely effective in causing misclassification. However, these…

计算机视觉与模式识别 · 计算机科学 2019-09-26 Akshayvarun Subramanya , Vipin Pillai , Hamed Pirsiavash

Deep neural networks (DNNs) trained on visual tasks develop feature representations that resemble those in the human visual system. Although DNN-based encoding models can accurately predict brain responses to visual stimuli, they offer…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Matthew W. Shinkle , Mark D. Lescroart

With the continue development of Convolutional Neural Networks (CNNs), there is a growing concern regarding representations that they encode internally. Analyzing these internal representations is referred to as model interpretation. While…

计算机视觉与模式识别 · 计算机科学 2023-05-18 Hamed Behzadi-Khormouji , José Oramas

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

机器学习 · 计算机科学 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

Deep neural networks (DNNs) have demonstrated state-of-the-art results on many pattern recognition tasks, especially vision classification problems. Understanding the inner workings of such computational brains is both fascinating basic…

神经与进化计算 · 计算机科学 2016-11-24 Anh Nguyen , Alexey Dosovitskiy , Jason Yosinski , Thomas Brox , Jeff Clune

Neural networks have greatly boosted performance in computer vision by learning powerful representations of input data. The drawback of end-to-end training for maximal overall performance are black-box models whose hidden representations…

计算机视觉与模式识别 · 计算机科学 2020-04-29 Patrick Esser , Robin Rombach , Björn Ommer

Methods for understanding the decisions of and mechanisms underlying deep neural networks (DNNs) typically rely on building intuition by emphasizing sensory or semantic features of individual examples. For instance, methods aim to visualize…

计算机与社会 · 计算机科学 2020-10-26 Matthew L. Leavitt , Ari Morcos

The fragility of deep neural networks to adversarially-chosen inputs has motivated the need to revisit deep learning algorithms. Including adversarial examples during training is a popular defense mechanism against adversarial attacks. This…

最优化与控制 · 数学 2020-05-05 Jacob H. Seidman , Mahyar Fazlyab , Victor M. Preciado , George J. Pappas

Adversarial sample attacks perturb benign inputs to induce DNN misbehaviors. Recent research has demonstrated the widespread presence and the devastating consequences of such attacks. Existing defense techniques either assume prior…

机器学习 · 计算机科学 2018-10-30 Guanhong Tao , Shiqing Ma , Yingqi Liu , Xiangyu Zhang

The proliferation of deep neural networks in various domains has seen an increased need for interpretability of these models. Preliminary work done along this line and papers that surveyed such, are focused on high-level representation…

计算与语言 · 计算机科学 2022-08-17 Hassan Sajjad , Nadir Durrani , Fahim Dalvi

Deep neural networks (DNNs) with high expressiveness have achieved state-of-the-art performance in many tasks. However, their distributed feature representations are difficult to interpret semantically. In this work, human-interpretable…

计算机视觉与模式识别 · 计算机科学 2019-10-22 Jindong Gu , Volker Tresp

Adversarial attacks are usually expressed in terms of a gradient-based operation on the input data and model, this results in heavy computations every time an attack is generated. In this work, we solidify the idea of representing…

机器学习 · 计算机科学 2023-08-01 Rajdeep Haldar , Qifan Song

Deep reinforcement learning techniques have demonstrated superior performance in a wide variety of environments. As improvements in training algorithms continue at a brisk pace, theoretical or empirical studies on understanding what these…

机器学习 · 计算机科学 2018-11-16 Raghuram Mandyam Annasamy , Katia Sycara

With the development of high computational devices, deep neural networks (DNNs), in recent years, have gained significant popularity in many Artificial Intelligence (AI) applications. However, previous efforts have shown that DNNs were…

计算与语言 · 计算机科学 2019-04-12 Wei Emma Zhang , Quan Z. Sheng , Ahoud Alhazmi , Chenliang Li