中文
相关论文

相关论文: Second-Order NLP Adversarial Examples

200 篇论文

We analyze the adversarial examples problem in terms of a model's fault tolerance with respect to its input. Whereas previous work focuses on arbitrarily strict threat models, i.e., $\epsilon$-perturbations, we consider arbitrary valid…

机器学习 · 计算机科学 2018-12-03 Angus Galloway , Anna Golubeva , Graham W. Taylor

Neural machine translation systems tend to fail on less decent inputs despite its significant efficacy, which may significantly harm the credibility of this systems-fathoming how and when neural-based systems fail in such cases is critical…

计算与语言 · 计算机科学 2020-05-27 Wei Zou , Shujian Huang , Jun Xie , Xinyu Dai , Jiajun Chen

Although pre-trained language models (PrLMs) have achieved significant success, recent studies demonstrate that PrLMs are vulnerable to adversarial attacks. By generating adversarial examples with slight perturbations on different levels…

计算与语言 · 计算机科学 2022-08-23 Jiayi Wang , Rongzhou Bao , Zhuosheng Zhang , Hai Zhao

Adversarial examples --- perturbations to the input of a model that elicit large changes in the output --- have been shown to be an effective way of assessing the robustness of sequence-to-sequence (seq2seq) models. However, these…

计算与语言 · 计算机科学 2019-03-20 Paul Michel , Xian Li , Graham Neubig , Juan Miguel Pino

Over the last few years, convolutional neural networks (CNNs) have proved to reach super-human performance in visual recognition tasks. However, CNNs can easily be fooled by adversarial examples, i.e., maliciously-crafted images that force…

计算机视觉与模式识别 · 计算机科学 2021-08-17 Federico Nesti , Alessandro Biondi , Giorgio Buttazzo

In this paper, we study the problem of generating obstinate (over-stability) adversarial examples by word substitution in NLP, where input text is meaningfully changed but the model's prediction does not, even though it should. Previous…

计算与语言 · 计算机科学 2023-08-21 Yimu Wang , Peng Shi , Hongyang Zhang

In recent years, deep neural networks have demonstrated outstanding performance in many machine learning tasks. However, researchers have discovered that these state-of-the-art models are vulnerable to adversarial examples: legitimate…

机器学习 · 计算机科学 2018-10-10 Ting-Jui Chang , Yukun He , Peng Li

Achieving robustness against adversarial input perturbation is an important and intriguing problem in machine learning. In the area of semantic image segmentation, a number of adversarial training approaches have been proposed as a defense…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Levente Halmosi , Mark Jelasity

Over the last few years, the phenomenon of adversarial examples --- maliciously constructed inputs that fool trained machine learning models --- has captured the attention of the research community, especially when the adversary is…

机器学习 · 计算机科学 2019-01-31 Nic Ford , Justin Gilmer , Nicolas Carlini , Dogus Cubuk

Deep neural networks have been successfully applied in various machine learning tasks. However, studies show that neural networks are susceptible to adversarial attacks. This exposes a potential threat to neural network-based intelligent…

计算机视觉与模式识别 · 计算机科学 2024-01-30 Haimin Zhang , Min Xu

Deep learning-based Natural Language Processing (NLP) models are vulnerable to adversarial attacks, where small perturbations can cause a model to misclassify. Adversarial Training (AT) is often used to increase model robustness. However,…

计算与语言 · 计算机科学 2024-10-15 Vyas Raina , Samson Tan , Volkan Cevher , Aditya Rawal , Sheng Zha , George Karypis

Most machine learning models are vulnerable to adversarial examples, which poses security concerns on these models. Adversarial examples are crafted by applying subtle but intentionally worst-case modifications to examples from the dataset,…

机器学习 · 计算机科学 2025-10-23 Xingyang Nie , Guojie Xiao , Su Pan , Biao Wang , Huilin Ge , Tao Fang

Large language models (LLMs) have significantly transformed the educational landscape. As current plagiarism detection tools struggle to keep pace with LLMs' rapid advancements, the educational community faces the challenge of assessing…

计算与语言 · 计算机科学 2024-06-18 Roy Xie , Chengxuan Huang , Junlin Wang , Bhuwan Dhingra

State-of-the-art deep neural networks are known to be vulnerable to adversarial examples, formed by applying small but malicious perturbations to the original inputs. Moreover, the perturbations can \textit{transfer across models}:…

机器学习 · 统计学 2018-02-28 Lei Wu , Zhanxing Zhu , Cheng Tai , Weinan E

Real-world natural language processing systems need to be robust to human adversaries. Collecting examples of human adversaries for training is an effective but expensive solution. On the other hand, training on synthetic attacks with small…

机器学习 · 计算机科学 2024-02-16 Aradhana Sinha , Ananth Balashankar , Ahmad Beirami , Thi Avrahami , Jilin Chen , Alex Beutel

Adversarial attacks against Deep Neural Networks have been widely studied. One significant feature that makes such attacks particularly powerful is transferability, where the adversarial examples generated from one model can be effective…

密码学与安全 · 计算机科学 2020-09-29 Renzhi Wang , Tianwei Zhang , Xiaofei Xie , Lei Ma , Cong Tian , Felix Juefei-Xu , Yang Liu

Adversarial examples are inputs to a machine learning system that result in an incorrect output from that system. Attacks launched through this type of input can cause severe consequences: for example, in the field of image recognition, a…

机器学习 · 计算机科学 2021-11-24 Stefano Cresci , Marinella Petrocchi , Angelo Spognardi , Stefano Tognazzi

Machine learning models are frequently used to solve complex security problems, as well as to make decisions in sensitive situations like guiding autonomous vehicles or predicting financial market behaviors. Previous efforts have shown that…

密码学与安全 · 计算机科学 2016-04-29 Nicolas Papernot , Patrick McDaniel , Ananthram Swami , Richard Harang

Adversarial examples expose the vulnerabilities of natural language processing (NLP) models, and can be used to evaluate and improve their robustness. Existing techniques of generating such examples are typically driven by local heuristic…

计算与语言 · 计算机科学 2021-03-16 Dianqi Li , Yizhe Zhang , Hao Peng , Liqun Chen , Chris Brockett , Ming-Ting Sun , Bill Dolan

Adversarial examples are important to test and enhance the robustness of deep code models. As source code is discrete and has to strictly stick to complex grammar and semantics constraints, the adversarial example generation techniques in…

密码学与安全 · 计算机科学 2023-08-22 Zhao Tian , Junjie Chen , Zhi Jin