English
Related papers

Related papers: Attacking interpretable NLP systems

200 papers

Deep neural networks (DNNs) have been found to be vulnerable to adversarial examples resulting from adding small-magnitude perturbations to inputs. Such adversarial examples can mislead DNNs to produce adversary-selected results. Different…

Cryptography and Security · Computer Science 2019-02-15 Chaowei Xiao , Bo Li , Jun-Yan Zhu , Warren He , Mingyan Liu , Dawn Song

Despite the impressive performances reported by deep neural networks in different application domains, they remain largely vulnerable to adversarial examples, i.e., input samples that are carefully perturbed to cause misclassification at…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Angelo Sotgiu , Ambra Demontis , Marco Melis , Battista Biggio , Giorgio Fumera , Xiaoyi Feng , Fabio Roli

Adversarial attacks expose vulnerabilities of deep learning models by introducing minor perturbations to the input, which lead to substantial alterations in the output. Our research focuses on the impact of such adversarial attacks on…

Computation and Language · Computer Science 2023-09-14 Pavel Burnyshev , Elizaveta Kostenok , Alexey Zaytsev

A fundamental issue in deep learning has been adversarial robustness. As these systems have scaled, such issues have persisted. Currently, large language models (LLMs) with billions of parameters suffer from adversarial attacks just like…

Machine Learning · Computer Science 2025-02-11 Brian Formento , Chuan Sheng Foo , See-Kiong Ng

Deep learning models suffer from a phenomenon called adversarial attacks: we can apply minor changes to the model input to fool a classifier for a particular example. The literature mostly considers adversarial attacks on models with images…

Machine Learning · Computer Science 2020-10-13 Ivan Fursov , Alexey Zaytsev , Nikita Kluchnikov , Andrey Kravchenko , Evgeny Burnaev

This paper introduces a novel adversarial algorithm for attacking the state-of-the-art speech-to-text systems, namely DeepSpeech, Kaldi, and Lingvo. Our approach is based on developing an extension for the conventional distortion condition…

Sound · Computer Science 2021-03-16 Mohammad Esmaeilpour , Patrick Cardinal , Alessandro Lameiras Koerich

Despite the recent advances in a wide spectrum of applications, machine learning models, especially deep neural networks, have been shown to be vulnerable to adversarial attacks. Attackers add carefully-crafted perturbations to input, where…

Machine Learning · Computer Science 2020-10-08 Ninghao Liu , Mengnan Du , Ruocheng Guo , Huan Liu , Xia Hu

Deep neural networks provide unprecedented performance in all image classification problems, taking advantage of huge amounts of data available for training. Recent studies, however, have shown their vulnerability to adversarial attacks,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Diego Gragnaniello , Francesco Marra , Giovanni Poggi , Luisa Verdoliva

Deep learning models have been used in creating various effective image classification applications. However, they are vulnerable to adversarial attacks that seek to misguide the models into predicting incorrect classes. Our study of major…

Cryptography and Security · Computer Science 2023-06-02 Mohammed Alkhowaiter , Hisham Kholidy , Mnassar Alyami , Abdulmajeed Alghamdi , Cliff Zou

Recent studies have shown that deep learning models are vulnerable to specifically crafted adversarial inputs that are quasi-imperceptible to humans. In this letter, we propose a novel method to detect adversarial inputs, by augmenting the…

Machine Learning · Computer Science 2020-02-25 Kirthi Shankar Sivamani , Rajeev Sahay , Aly El Gamal

Deep Neural Networks have been shown to be vulnerable to adversarial images. Conventional attacks strive for indistinguishable adversarial images with strictly restricted perturbations. Recently, researchers have moved to explore…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Zhengyu Zhao , Zhuoran Liu , Martha Larson

Adversarial attacks on Natural Language Processing (NLP) models expose vulnerabilities by introducing subtle perturbations to input text, often leading to misclassification while maintaining human readability. Existing methods typically…

Cryptography and Security · Computer Science 2025-06-12 Hetvi Waghela , Jaydip Sen , Sneha Rakshit , Subhasis Dasgupta

Adversarial examples are important for understanding the behavior of neural models, and can improve their robustness through adversarial training. Recent work in natural language processing generated adversarial examples by assuming…

Machine Learning · Computer Science 2019-04-05 Yotam Gil , Yoav Chai , Or Gorodissky , Jonathan Berant

NLP researchers propose different word-substitute black-box attacks that can fool text classification models. In such attack, an adversary keeps sending crafted adversarial queries to the target model until it can successfully achieve the…

Computation and Language · Computer Science 2022-06-13 Tianle Li , Yi Yang

Adversarial attacks pose significant challenges for detecting adversarial attacks at an early stage. We propose attack-agnostic detection on reinforcement learning-based interactive recommendation systems. We first craft adversarial…

Machine Learning · Computer Science 2020-06-16 Yuanjiang Cao , Xiaocong Chen , Lina Yao , Xianzhi Wang , Wei Emma Zhang

Deep learning has proven to be a powerful tool for computer vision and has seen widespread adoption for numerous tasks. However, deep learning algorithms are known to be vulnerable to adversarial examples. These adversarial inputs are…

Cryptography and Security · Computer Science 2018-07-25 Kevin Eykholt , Ivan Evtimov , Earlence Fernandes , Bo Li , Dawn Song , Tadayoshi Kohno , Amir Rahmati , Atul Prakash , Florian Tramer

Adversarial attacks dramatically change the output of an otherwise accurate learning system using a seemingly inconsequential modification to a piece of input data. Paradoxically, empirical evidence indicates that even systems which are…

Machine Learning · Computer Science 2024-09-13 Oliver J. Sutton , Qinghua Zhou , Ivan Y. Tyukin , Alexander N. Gorban , Alexander Bastounis , Desmond J. Higham

In recent years Deep Neural Networks (DNNs) have achieved remarkable results and even showed super-human capabilities in a broad range of domains. This led people to trust in DNNs' classifications and resulting actions even in…

Cryptography and Security · Computer Science 2020-12-14 Philip Sperl , Ching-Yu Kao , Peng Chen , Konstantin Böttinger

Natural language processing (NLP) models may leak private information in different ways, including membership inference, reconstruction or attribute inference attacks. Sensitive information may not be explicit in the text, but hidden in…

Computation and Language · Computer Science 2024-07-01 Pedro Faustini , Shakila Mahjabin Tonni , Annabelle McIver , Qiongkai Xu , Mark Dras

Adding perturbations via utilizing auxiliary gradient information or discarding existing details of the benign images are two common approaches for generating adversarial examples. Though visual imperceptibility is the desired property of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Zihan Chen , Ziyue Wang , Junjie Huang , Wentao Zhao , Xiao Liu , Dejian Guan
‹ Prev 1 3 4 5 6 7 10 Next ›