中文
相关论文

相关论文: Second-Order NLP Adversarial Examples

200 篇论文

Deep neural networks were significantly vulnerable to adversarial examples manipulated by malicious tiny perturbations. Although most conventional adversarial attacks ensured the visual imperceptibility between adversarial examples and…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Shuai Li , Xiaoyu Jiang , Xiaoguang Ma

As machine learning algorithms continue to improve, there is an increasing need for explaining why a model produces a certain prediction for a certain input. In recent years, several methods for model interpretability have been developed,…

机器学习 · 计算机科学 2018-11-22 Yoel Shoshan , Vadim Ratner

Adversarial examples are malicious inputs designed to fool machine learning models. They often transfer from one model to another, allowing attackers to mount black box attacks without knowledge of the target model's parameters. Adversarial…

计算机视觉与模式识别 · 计算机科学 2017-02-14 Alexey Kurakin , Ian Goodfellow , Samy Bengio

Textual adversarial attacks can discover models' weaknesses by adding semantic-preserved but misleading perturbations to the inputs. The long-lasting adversarial attack-and-defense arms race in Natural Language Processing (NLP) is…

计算与语言 · 计算机科学 2023-05-31 Yangyi Chen , Hongcheng Gao , Ganqu Cui , Lifan Yuan , Dehan Kong , Hanlu Wu , Ning Shi , Bo Yuan , Longtao Huang , Hui Xue , Zhiyuan Liu , Maosong Sun , Heng Ji

Deep-learning-based NLP models are found to be vulnerable to word substitution perturbations. Before they are widely adopted, the fundamental issues of robustness need to be addressed. Along this line, we propose a formal framework to…

计算与语言 · 计算机科学 2022-01-12 Yuting Yang , Pei Huang , FeiFei Ma , Juan Cao , Meishan Zhang , Jian Zhang , Jintao Li

Adversarial examples are inevitable on the road of pervasive applications of deep neural networks (DNN). Imperceptible perturbations applied on natural samples can lead DNN-based classifiers to output wrong prediction with fair confidence…

机器学习 · 计算机科学 2020-11-04 Tao Bai , Jinqi Luo , Jun Zhao

Deep learning based systems are susceptible to adversarial attacks, where a small, imperceptible change at the input alters the model prediction. However, to date the majority of the approaches to detect these attacks have been designed for…

计算与语言 · 计算机科学 2022-09-27 Vyas Raina , Mark Gales

Adversarial attacks and backdoor attacks are two common security threats that hang over deep learning. Both of them harness task-irrelevant features of data in their implementation. Text style is a feature that is naturally irrelevant to…

计算与语言 · 计算机科学 2021-10-15 Fanchao Qi , Yangyi Chen , Xurui Zhang , Mukai Li , Zhiyuan Liu , Maosong Sun

Recent studies have shown that deep neural networks are vulnerable to intentionally crafted adversarial examples, and various methods have been proposed to defend against adversarial word-substitution attacks for neural NLP models. However,…

计算与语言 · 计算机科学 2021-10-07 Zongyi Li , Jianhan Xu , Jiehang Zeng , Linyang Li , Xiaoqing Zheng , Qi Zhang , Kai-Wei Chang , Cho-Jui Hsieh

Insensitivity to semantically-preserving variations of prompts (paraphrases) is crucial for reliable behavior and real-world deployment of large language models. However, language models exhibit significant performance degradation when…

计算与语言 · 计算机科学 2025-03-04 Tingchen Fu , Fazl Barez

Modern text classification models are susceptible to adversarial examples, perturbed versions of the original text indiscernible by humans which get misclassified by the model. Recent works in NLP use rule-based synonym replacement…

计算与语言 · 计算机科学 2022-06-22 Siddhant Garg , Goutham Ramakrishnan

The burgeoning success of deep learning has raised the security and privacy concerns as more and more tasks are accompanied with sensitive data. Adversarial attacks in deep learning have emerged as one of the dominating security threat to a…

机器学习 · 计算机科学 2019-01-01 Wenqi Wei , Ling Liu , Margaret Loper , Stacey Truex , Lei Yu , Mehmet Emre Gursoy , Yanzhao Wu

Large language models have many beneficial applications, but can they also be used to attack content-filtering algorithms in social media platforms? We investigate the challenge of generating adversarial examples to test the robustness of…

计算与语言 · 计算机科学 2025-09-04 Piotr Przybyła , Euan McGill , Horacio Saggion

Over the past decade, there has been extensive research aimed at enhancing the robustness of neural networks, yet this problem remains vastly unsolved. Here, one major impediment has been the overestimation of the robustness of new defense…

人工智能 · 计算机科学 2023-10-31 Leo Schwinn , David Dobre , Stephan Günnemann , Gauthier Gidel

Contrastive learning has proven to be an effective method for pre-training models using weakly labeled data in the vision domain. Sentence transformers are the NLP counterparts to this architecture, and have been growing in popularity due…

计算与语言 · 计算机科学 2023-11-30 Tanmay Chavan , Shantanu Patankar , Aditya Kane , Omkar Gokhale , Geetanjali Kale , Raviraj Joshi

Adversarial attacks against natural language processing systems, which perform seemingly innocuous modifications to inputs, can induce arbitrary mistakes to the target models. Though raised great concerns, such adversarial attacks can be…

计算与语言 · 计算机科学 2020-10-07 Boxin Wang , Hengzhi Pei , Boyuan Pan , Qian Chen , Shuohang Wang , Bo Li

Recent studies have highlighted audio adversarial examples as a ubiquitous threat to state-of-the-art automatic speech recognition systems. Thorough studies on how to effectively generate adversarial examples are essential to prevent…

音频与语音处理 · 电气工程与系统科学 2024-03-13 Xiaolei Liu , Xiaosong Zhang , Kun Wan , Qingxin Zhu , Yufei Ding

It has been shown that adversaries can craft example inputs to neural networks which are similar to legitimate inputs but have been created to purposely cause the neural network to misclassify the input. These adversarial examples are…

机器学习 · 计算机科学 2018-10-25 Mohammad Hashemi , Greg Cusack , Eric Keller

The existence of adversarial attacks (or adversarial examples) brings huge concern about the machine learning (ML) model's safety issues. For many safety-critical ML tasks, such as financial forecasting, fraudulent detection, and anomaly…

机器学习 · 计算机科学 2022-10-19 Han Xu , Menghai Pan , Zhimeng Jiang , Huiyuan Chen , Xiaoting Li , Mahashweta Das , Hao Yang

Classical adversarial attacks are phrased as a constrained optimisation problem. Despite the efficacy of a constrained optimisation approach to adversarial attacks, one cannot trace how an adversarial point was generated. In this work, we…

机器学习 · 计算机科学 2025-03-18 Lachlan Simpson , Federico Costanza , Kyle Millar , Adriel Cheng , Cheng-Chew Lim , Hong Gunn Chew