中文
相关论文

相关论文: Attacking interpretable NLP systems

200 篇论文

State-of-art deep neural networks (DNN) are vulnerable to attacks by adversarial examples: a carefully designed small perturbation to the input, that is imperceptible to human, can mislead DNN. To understand the root cause of adversarial…

机器学习 · 统计学 2019-10-29 Xupeng Shi , A. Adam Ding

Adversarial attacks are often considered as threats to the robustness of Deep Neural Networks (DNNs). Various defending techniques have been developed to mitigate the potential negative impact of adversarial attacks against task…

机器学习 · 计算机科学 2022-04-12 Jianzhang Zheng , Fan Yang , Hao Shen , Xuan Tang , Mingsong Chen , Liang Song , Xian Wei

The automatic evaluation of natural language generation (NLG) systems presents a long-lasting challenge. Recent studies have highlighted various neural metrics that align well with human evaluations. Yet, the robustness of these evaluators…

计算与语言 · 计算机科学 2024-10-03 Yiming Chen , Chen Zhang , Danqing Luo , Luis Fernando D'Haro , Robby T. Tan , Haizhou Li

Neural text detectors are models trained to detect whether a given text was generated by a language model or written by a human. In this paper, we investigate three simple and resource-efficient strategies (parameter tweaking, prompt…

计算与语言 · 计算机科学 2023-11-06 Vitalii Fishchuk , Daniel Braun

Neural networks have changed the way machines interpret the world. At their core, they learn by following gradients, adjusting their parameters step by step until they identify the most discriminant patterns in the data. This process gives…

计算机视觉与模式识别 · 计算机科学 2025-11-03 Samarup Bhattacharya , Anubhab Bhattacharya , Abir Chakraborty

Production machine learning systems are consistently under attack by adversarial actors. Various deep learning models must be capable of accurately detecting fake or adversarial input while maintaining speed. In this work, we propose one…

机器学习 · 计算机科学 2021-06-15 Matthew Ciolino , Josh Kalin , David Noever

We propose a new adversarial attack to Deep Neural Networks for image classification. Different from most existing attacks that directly perturb input pixels, our attack focuses on perturbing abstract features, more specifically, features…

机器学习 · 计算机科学 2020-12-17 Qiuling Xu , Guanhong Tao , Siyuan Cheng , Xiangyu Zhang

Adversarial attacks in Natural Language Processing apply perturbations in the character or token levels. Token-level attacks, gaining prominence for their use of gradient-based methods, are susceptible to altering sentence semantics,…

机器学习 · 计算机科学 2024-09-05 Elias Abad Rocamora , Yongtao Wu , Fanghui Liu , Grigorios G. Chrysos , Volkan Cevher

Recent studies have shown that deep neural networks are vulnerable to intentionally crafted adversarial examples, and various methods have been proposed to defend against adversarial word-substitution attacks for neural NLP models. However,…

计算与语言 · 计算机科学 2021-10-07 Zongyi Li , Jianhan Xu , Jiehang Zeng , Linyang Li , Xiaoqing Zheng , Qi Zhang , Kai-Wei Chang , Cho-Jui Hsieh

Deep neural networks have been shown to be vulnerable to small perturbations of their inputs, known as adversarial attacks. In this paper, we investigate the vulnerability of Neural Machine Translation (NMT) models to adversarial attacks…

计算与语言 · 计算机科学 2023-06-19 Sahar Sadrizadeh , Ljiljana Dolamic , Pascal Frossard

Machine learning has been applied to a broad range of applications and some of them are available online as application programming interfaces (APIs) with either free (trial) or paid subscriptions. In this paper, we study adversarial…

机器学习 · 计算机科学 2018-11-06 Yi Shi , Yalin E. Sagduyu , Kemal Davaslioglu , Jason H. Li

The literature on adversarial attacks in computer vision typically focuses on pixel-level perturbations. These tend to be very difficult to interpret. Recent work that manipulates the latent representations of image generators to create…

机器学习 · 计算机科学 2023-09-12 Stephen Casper , Max Nadeau , Dylan Hadfield-Menell , Gabriel Kreiman

We present a Reinforcement Learning Platform for Adversarial Black-box untargeted and targeted attacks, RLAB, that allows users to select from various distortion filters to create adversarial examples. The platform uses a Reinforcement…

Deep neural networks (DNNs) have achieved remarkable success in various tasks (e.g., image classification, speech recognition, and natural language processing (NLP)). However, researchers have demonstrated that DNN-based models are…

计算与语言 · 计算机科学 2021-04-22 Wenqi Wang , Run Wang , Lina Wang , Zhibo Wang , Aoshuang Ye

The application of deep recurrent networks to audio transcription has led to impressive gains in automatic speech recognition (ASR) systems. Many have demonstrated that small adversarial perturbations can fool deep neural networks into…

机器学习 · 计算机科学 2019-08-21 Rohan Taori , Amog Kamsetty , Brenton Chu , Nikita Vemuri

Tool learning serves as a powerful auxiliary mechanism that extends the capabilities of large language models (LLMs), enabling them to tackle complex tasks requiring real-time relevance or high precision operations. Behind its powerful…

密码学与安全 · 计算机科学 2025-04-08 Liuji Chen , Hao Gao , Jinghao Zhang , Qiang Liu , Shu Wu , Liang Wang

Explainable AI is a strong strategy implemented to understand complex black-box model predictions in a human interpretable language. It provides the evidence required to execute the use of trustworthy and reliable AI systems. On the other…

计算与语言 · 计算机科学 2025-03-12 Esther Chiramal , Kelvin Soh Boon Kai

Arabic handwriting recognition (AHR) has made significant progress with deep learning models. AHR research has largely focused on performance, with security receiving little attention. This study provides what appears to be a new line of…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Mohsine EL Khayati , Abdelillah Semma , Abdelaziz Courr , Rachid Elouahbi

Neural methods have been shown to achieve high performance in Named Entity Recognition (NER), but rely on costly high-quality labeled data for training, which is not always available across languages. While previous works have shown that…

计算与语言 · 计算机科学 2021-06-08 Weile Chen , Huiqiang Jiang , Qianhui Wu , Börje F. Karlsson , Yi Guan

Recent work has demonstrated the vulnerability of modern text classifiers to universal adversarial attacks, which are input-agnostic sequences of words added to text processed by classifiers. Despite being successful, the word sequences…

计算与语言 · 计算机科学 2021-04-09 Liwei Song , Xinwei Yu , Hsuan-Tung Peng , Karthik Narasimhan