中文
相关论文

相关论文: Fooling Neural Network Interpretations via Adversa…

200 篇论文

Deep learning (DL) models find increasing application in mental state decoding, where researchers seek to understand the mapping between mental states (e.g., perceiving fear or joy) and brain activity by identifying those brain regions (and…

神经元与认知 · 定量生物学 2022-10-17 Armin W. Thomas , Christopher Ré , Russell A. Poldrack

Deep neural networks are normally executed in the forward direction. However, in this work, we identify a vulnerability that enables models to be trained in both directions and on different tasks. Adversaries can exploit this capability to…

机器学习 · 计算机科学 2024-05-20 Guy Amit , Mosh Levy , Yisroel Mirsky

In practice, deep neural networks have been found to be vulnerable to various types of noise, such as adversarial examples and corruption. Various adversarial defense methods have accordingly been developed to improve adversarial robustness…

机器学习 · 计算机科学 2020-12-24 Aishan Liu , Xianglong Liu , Chongzhi Zhang , Hang Yu , Qiang Liu , Dacheng Tao

The use of pretrained models from general computer vision tasks is widespread in remote sensing, significantly reducing training costs and improving performance. However, this practice also introduces vulnerabilities to downstream tasks,…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Tao Bai , Xingjian Tian , Yonghao Xu , Bihan Wen

Explanation methods aim to make neural networks more trustworthy and interpretable. In this paper, we demonstrate a property of explanation methods which is disconcerting for both of these purposes. Namely, we show that explanations can be…

Natural Language Processing (NLP) models based on Machine Learning (ML) are susceptible to adversarial attacks -- malicious algorithms that imperceptibly modify input text to force models into making incorrect predictions. However,…

计算与语言 · 计算机科学 2023-05-26 Salijona Dyrmishi , Salah Ghamizi , Maxime Cordy

Deep neural networks have proven to be quite effective in a wide variety of machine learning tasks, ranging from improved speech recognition systems to advancing the development of autonomous vehicles. However, despite their superior…

机器学习 · 计算机科学 2016-12-14 Qinglong Wang , Wenbo Guo , Alexander G. Ororbia , Xinyu Xing , Lin Lin , C. Lee Giles , Xue Liu , Peng Liu , Gang Xiong

Despite outstanding performance in a variety of NLP tasks, recent studies have revealed that NLP models are vulnerable to adversarial attacks that slightly perturb the input to cause the models to misbehave. Among these attacks, adversarial…

计算与语言 · 计算机科学 2024-06-11 Duy C. Hoang , Quang H. Nguyen , Saurav Manchanda , MinLong Peng , Kok-Seng Wong , Khoa D. Doan

From face recognition systems installed in phones to self-driving cars, the field of AI is witnessing rapid transformations and is being integrated into our everyday lives at an incredible pace. Any major failure in these system's…

密码学与安全 · 计算机科学 2020-12-14 Ayush Goel

Neural networks have demonstrated state-of-the-art performance in various machine learning fields. However, the introduction of malicious perturbations in input data, known as adversarial examples, has been shown to deceive neural network…

机器学习 · 计算机科学 2023-02-06 Dennis Y. Menn , Tzu-hsun Feng , Hung-yi Lee

Given the rapid changes in telecommunication systems and their higher dependence on artificial intelligence, it is increasingly important to have models that can perform well under different, possibly adverse, conditions. Deep Neural…

信号处理 · 电气工程与系统科学 2021-03-30 Javier Maroto , Gérôme Bovet , Pascal Frossard

Adversarial attacks are a type of attack on machine learning models where an attacker deliberately modifies the inputs to cause the model to make incorrect predictions. Adversarial attacks can have serious consequences, particularly in…

Artificial neural networks have proven to be extremely useful models that have allowed for multiple recent breakthroughs in the field of Artificial Intelligence and many others. However, they are typically regarded as black boxes, given how…

人工智能 · 计算机科学 2023-03-07 Manuel de Sousa Ribeiro , João Leite

Neural network architectures have been extensively employed in the fair representation learning setting, where the objective is to learn a new representation for a given vector which is independent of sensitive information. Various…

Methods for understanding the decisions of and mechanisms underlying deep neural networks (DNNs) typically rely on building intuition by emphasizing sensory or semantic features of individual examples. For instance, methods aim to visualize…

计算机与社会 · 计算机科学 2020-10-26 Matthew L. Leavitt , Ari Morcos

Deep neural networks have been applied successfully to a wide variety of inverse problems arising in computational imaging. These networks are typically trained using a forward model that describes the measurement process to be inverted,…

图像与视频处理 · 电气工程与系统科学 2021-04-14 Davis Gilton , Gregory Ongie , Rebecca Willett

To tackle interpretability in deep learning, we present a novel framework to jointly learn a predictive model and its associated interpretation model. The interpreter provides both local and global interpretability about the predictive…

机器学习 · 计算机科学 2022-02-24 Jayneel Parekh , Pavlo Mozharovskyi , Florence d'Alché-Buc

Neural language models show vulnerability to adversarial examples which are semantically similar to their original counterparts with a few words replaced by their synonyms. A common way to improve model robustness is adversarial training…

计算与语言 · 计算机科学 2022-03-25 Hanjie Chen , Yangfeng Ji

Deep neural networks are known to be vulnerable to adversarial examples, i.e., images that are maliciously perturbed to fool the model. Generating adversarial examples has been mostly limited to finding small perturbations that maximize the…

计算机视觉与模式识别 · 计算机科学 2018-04-03 Hossein Hosseini , Radha Poovendran

We introduce a new type of indirect, cross-modal injection attacks against visual language models that enable creation of self-interpreting images. These images contain hidden "meta-instructions" that control how models answer users'…

密码学与安全 · 计算机科学 2025-06-16 Tingwei Zhang , Collin Zhang , John X. Morris , Eugene Bagdasarian , Vitaly Shmatikov