English
Related papers

Related papers: Attacking interpretable NLP systems

200 papers

With the emergence of more powerful large language models (LLMs), such as ChatGPT and GPT-4, in-context learning (ICL) has gained significant prominence in leveraging these models for specific tasks by utilizing data-label pairs as…

Computation and Language · Computer Science 2023-10-17 Jiongxiao Wang , Zichen Liu , Keun Hee Park , Zhuojun Jiang , Zhaoheng Zheng , Zhuofeng Wu , Muhao Chen , Chaowei Xiao

Deep learning has undoubtedly offered tremendous improvements in the performance of state-of-the-art speech emotion recognition (SER) systems. However, recent research on adversarial examples poses enormous challenges on the robustness of…

Machine Learning · Computer Science 2019-01-01 Siddique Latif , Rajib Rana , Junaid Qadir

Deep neural networks (DNNs) are inherently susceptible to adversarial attacks even under black-box settings, in which the adversary only has query access to the target models. In practice, while it may be possible to effectively detect such…

Machine Learning · Computer Science 2020-06-18 Ren Pang , Xinyang Zhang , Shouling Ji , Xiapu Luo , Ting Wang

Current adversarial attack algorithms, where an adversary changes a text to fool a victim model, have been repeatedly shown to be effective against text classifiers. These attacks, however, generally assume that the victim model is…

Computation and Language · Computer Science 2024-01-17 Tom Roth , Inigo Jauregi Unanue , Alsharif Abuadbba , Massimo Piccardi

Deep neural networks have been shown to exhibit an intriguing vulnerability to adversarial input images corrupted with imperceptible perturbations. However, the majority of adversarial attacks assume global, fine-grained control over the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Ameya Joshi , Amitangshu Mukherjee , Soumik Sarkar , Chinmay Hegde

Deep neural network (DNN) classifiers are powerful tools that drive a broad spectrum of important applications, from image recognition to autonomous vehicles. Unfortunately, DNNs are known to be vulnerable to adversarial attacks that affect…

Cryptography and Security · Computer Science 2022-08-08 Saikat Majumdar , Mohammad Hossein Samavatian , Kristin Barber , Radu Teodorescu

Deep learning models have shown their vulnerability when dealing with adversarial attacks. Existing attacks almost perform on low-level instances, such as pixels and super-pixels, and rarely exploit semantic clues. For face recognition…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Shuai Jia , Bangjie Yin , Taiping Yao , Shouhong Ding , Chunhua Shen , Xiaokang Yang , Chao Ma

Adversarial machine learning is an emerging area showing the vulnerability of deep learning models. Exploring attack methods to challenge state of the art artificial intelligence (A.I.) models is an area of critical concern. The reliability…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Samet Bayram , Kenneth Barner

Machine learning systems and also, specifically, automatic speech recognition (ASR) systems are vulnerable against adversarial attacks, where an attacker maliciously changes the input. In the case of ASR systems, the most interesting cases…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Sina Däubener , Lea Schönherr , Asja Fischer , Dorothea Kolossa

The discovery of adversarial examples has raised concerns about the practical deployment of deep learning systems. In this paper, we demonstrate that adversarial examples are capable of manipulating deep learning systems across three…

Cryptography and Security · Computer Science 2019-02-05 Samuel G. Finlayson , Hyung Won Chung , Isaac S. Kohane , Andrew L. Beam

Deep learning models are known to be vulnerable to adversarial examples. A practical adversarial attack should require as little as possible knowledge of attacked models. Current substitute attacks need pre-trained models to generate…

Cryptography and Security · Computer Science 2020-04-01 Mingyi Zhou , Jing Wu , Yipeng Liu , Xiaolin Huang , Shuaicheng Liu , Xiang Zhang , Ce Zhu

Vision-language models (VLMs) have significantly advanced autonomous driving (AD) by enhancing reasoning capabilities; however, these models remain highly susceptible to adversarial attacks. While existing research has explored white-box…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Lu Wang , Tianyuan Zhang , Yang Qu , Siyuan Liang , Yuwei Chen , Aishan Liu , Xianglong Liu , Dacheng Tao

Clean-label (CL) attack is a form of data poisoning attack where an adversary modifies only the textual input of the training data, without requiring access to the labeling function. CL attacks are relatively unexplored in NLP, as compared…

Computation and Language · Computer Science 2023-06-01 Ashim Gupta , Amrith Krishna

Deep neural networks (DNNs) have been found to be vulnerable to adversarial examples. Adversarial examples are malicious images with visually imperceptible perturbations. While these carefully crafted perturbations restricted with tight…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Yajie Wang , Shangbo Wu , Wenyi Jiang , Shengang Hao , Yu-an Tan , Quanxin Zhang

Adversarial attacks pose a significant threat to machine learning models by inducing incorrect predictions through imperceptible perturbations to input data. While these attacks are well studied in unstructured domains such as images, their…

Machine Learning · Computer Science 2025-12-09 Zhipeng He , Chun Ouyang , Lijie Wen , Cong Liu , Catarina Moreira

The emergence of Deep Neural Networks (DNNs) has revolutionized various domains by enabling the resolution of complex tasks spanning image recognition, natural language processing, and scientific problem-solving. However, this progress has…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Jindong Gu , Xiaojun Jia , Pau de Jorge , Wenqain Yu , Xinwei Liu , Avery Ma , Yuan Xun , Anjun Hu , Ashkan Khakzar , Zhijiang Li , Xiaochun Cao , Philip Torr

Decision-based attacks construct adversarial examples against a machine learning (ML) model by making only hard-label queries. These attacks have mainly been applied directly to standalone neural networks. However, in practice, ML models…

Cryptography and Security · Computer Science 2023-07-24 Chawin Sitawarin , Florian Tramèr , Nicholas Carlini

The vulnerability of artificial neural networks to adversarial perturbations in the black-box setting is widely studied in the literature. The majority of attack methods to construct these perturbations suffer from an impractically large…

Machine Learning · Computer Science 2024-10-22 Kirill Lukyanov , Andrew Perminov , Denis Turdakov , Mikhail Pautov

We investigate adversarial attacks for autoencoders. We propose a procedure that distorts the input image to mislead the autoencoder in reconstructing a completely different target image. We attack the internal latent representations,…

Neural and Evolutionary Computing · Computer Science 2016-12-02 Pedro Tabacof , Julia Tavares , Eduardo Valle

Currently, natural language processing (NLP) models are wildly used in various scenarios. However, NLP models, like all deep models, are vulnerable to adversarially generated text. Numerous works have been working on mitigating the…

Computation and Language · Computer Science 2023-02-14 Lujia Shen , Xuhong Zhang , Shouling Ji , Yuwen Pu , Chunpeng Ge , Xing Yang , Yanghe Feng