English
Related papers

Related papers: Attacking interpretable NLP systems

200 papers

State-of-art deep neural networks (DNN) are vulnerable to attacks by adversarial examples: a carefully designed small perturbation to the input, that is imperceptible to human, can mislead DNN. To understand the root cause of adversarial…

Machine Learning · Statistics 2019-10-29 Xupeng Shi , A. Adam Ding

Adversarial attacks are often considered as threats to the robustness of Deep Neural Networks (DNNs). Various defending techniques have been developed to mitigate the potential negative impact of adversarial attacks against task…

Machine Learning · Computer Science 2022-04-12 Jianzhang Zheng , Fan Yang , Hao Shen , Xuan Tang , Mingsong Chen , Liang Song , Xian Wei

The automatic evaluation of natural language generation (NLG) systems presents a long-lasting challenge. Recent studies have highlighted various neural metrics that align well with human evaluations. Yet, the robustness of these evaluators…

Computation and Language · Computer Science 2024-10-03 Yiming Chen , Chen Zhang , Danqing Luo , Luis Fernando D'Haro , Robby T. Tan , Haizhou Li

Neural text detectors are models trained to detect whether a given text was generated by a language model or written by a human. In this paper, we investigate three simple and resource-efficient strategies (parameter tweaking, prompt…

Computation and Language · Computer Science 2023-11-06 Vitalii Fishchuk , Daniel Braun

Neural networks have changed the way machines interpret the world. At their core, they learn by following gradients, adjusting their parameters step by step until they identify the most discriminant patterns in the data. This process gives…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Samarup Bhattacharya , Anubhab Bhattacharya , Abir Chakraborty

Production machine learning systems are consistently under attack by adversarial actors. Various deep learning models must be capable of accurately detecting fake or adversarial input while maintaining speed. In this work, we propose one…

Machine Learning · Computer Science 2021-06-15 Matthew Ciolino , Josh Kalin , David Noever

We propose a new adversarial attack to Deep Neural Networks for image classification. Different from most existing attacks that directly perturb input pixels, our attack focuses on perturbing abstract features, more specifically, features…

Machine Learning · Computer Science 2020-12-17 Qiuling Xu , Guanhong Tao , Siyuan Cheng , Xiangyu Zhang

Adversarial attacks in Natural Language Processing apply perturbations in the character or token levels. Token-level attacks, gaining prominence for their use of gradient-based methods, are susceptible to altering sentence semantics,…

Machine Learning · Computer Science 2024-09-05 Elias Abad Rocamora , Yongtao Wu , Fanghui Liu , Grigorios G. Chrysos , Volkan Cevher

Recent studies have shown that deep neural networks are vulnerable to intentionally crafted adversarial examples, and various methods have been proposed to defend against adversarial word-substitution attacks for neural NLP models. However,…

Computation and Language · Computer Science 2021-10-07 Zongyi Li , Jianhan Xu , Jiehang Zeng , Linyang Li , Xiaoqing Zheng , Qi Zhang , Kai-Wei Chang , Cho-Jui Hsieh

Deep neural networks have been shown to be vulnerable to small perturbations of their inputs, known as adversarial attacks. In this paper, we investigate the vulnerability of Neural Machine Translation (NMT) models to adversarial attacks…

Computation and Language · Computer Science 2023-06-19 Sahar Sadrizadeh , Ljiljana Dolamic , Pascal Frossard

Machine learning has been applied to a broad range of applications and some of them are available online as application programming interfaces (APIs) with either free (trial) or paid subscriptions. In this paper, we study adversarial…

Machine Learning · Computer Science 2018-11-06 Yi Shi , Yalin E. Sagduyu , Kemal Davaslioglu , Jason H. Li

The literature on adversarial attacks in computer vision typically focuses on pixel-level perturbations. These tend to be very difficult to interpret. Recent work that manipulates the latent representations of image generators to create…

Machine Learning · Computer Science 2023-09-12 Stephen Casper , Max Nadeau , Dylan Hadfield-Menell , Gabriel Kreiman

We present a Reinforcement Learning Platform for Adversarial Black-box untargeted and targeted attacks, RLAB, that allows users to select from various distortion filters to create adversarial examples. The platform uses a Reinforcement…

Deep neural networks (DNNs) have achieved remarkable success in various tasks (e.g., image classification, speech recognition, and natural language processing (NLP)). However, researchers have demonstrated that DNN-based models are…

Computation and Language · Computer Science 2021-04-22 Wenqi Wang , Run Wang , Lina Wang , Zhibo Wang , Aoshuang Ye

The application of deep recurrent networks to audio transcription has led to impressive gains in automatic speech recognition (ASR) systems. Many have demonstrated that small adversarial perturbations can fool deep neural networks into…

Machine Learning · Computer Science 2019-08-21 Rohan Taori , Amog Kamsetty , Brenton Chu , Nikita Vemuri

Tool learning serves as a powerful auxiliary mechanism that extends the capabilities of large language models (LLMs), enabling them to tackle complex tasks requiring real-time relevance or high precision operations. Behind its powerful…

Cryptography and Security · Computer Science 2025-04-08 Liuji Chen , Hao Gao , Jinghao Zhang , Qiang Liu , Shu Wu , Liang Wang

Explainable AI is a strong strategy implemented to understand complex black-box model predictions in a human interpretable language. It provides the evidence required to execute the use of trustworthy and reliable AI systems. On the other…

Computation and Language · Computer Science 2025-03-12 Esther Chiramal , Kelvin Soh Boon Kai

Arabic handwriting recognition (AHR) has made significant progress with deep learning models. AHR research has largely focused on performance, with security receiving little attention. This study provides what appears to be a new line of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Mohsine EL Khayati , Abdelillah Semma , Abdelaziz Courr , Rachid Elouahbi

Neural methods have been shown to achieve high performance in Named Entity Recognition (NER), but rely on costly high-quality labeled data for training, which is not always available across languages. While previous works have shown that…

Computation and Language · Computer Science 2021-06-08 Weile Chen , Huiqiang Jiang , Qianhui Wu , Börje F. Karlsson , Yi Guan

Recent work has demonstrated the vulnerability of modern text classifiers to universal adversarial attacks, which are input-agnostic sequences of words added to text processed by classifiers. Despite being successful, the word sequences…

Computation and Language · Computer Science 2021-04-09 Liwei Song , Xinwei Yu , Hsuan-Tung Peng , Karthik Narasimhan