中文
相关论文

相关论文: Mischief: A Simple Black-Box Attack Against Transf…

200 篇论文

While a substantial body of prior work has explored adversarial example generation for natural language understanding tasks, these examples are often unrealistic and diverge from the real-world data distributions. In this work, we introduce…

计算与语言 · 计算机科学 2022-11-09 Saadia Gabriel , Hamid Palangi , Yejin Choi

Adversarial examples are one critical security threat to various visual applications, where injected human-imperceptible perturbations can confuse the output.Generating transferable adversarial examples in the black-box setting is crucial…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Junlin Liu , Xinchen Lyu

Adversarial attacks have threatened the application of deep neural networks in security-sensitive scenarios. Most existing black-box attacks fool the target model by interacting with it many times and producing global perturbations.…

计算机视觉与模式识别 · 计算机科学 2021-01-05 Tao Xiang , Hangcheng Liu , Shangwei Guo , Tianwei Zhang , Xiaofeng Liao

In this work we present a formal theoretical framework for assessing and analyzing two classes of malevolent action towards generic Artificial Intelligence (AI) systems. Our results apply to general multi-class classifiers that map from an…

机器学习 · 计算机科学 2021-01-01 Ivan Y. Tyukin , Desmond J. Higham , Alexander N. Gorban

Neural networks are vulnerable to adversarial examples, which are malicious inputs crafted to fool pre-trained models. Adversarial examples often exhibit black-box attacking transferability, which allows that adversarial examples crafted…

计算机视觉与模式识别 · 计算机科学 2020-03-04 ZhaoXin Huan , Yulong Wang , Xiaolu Zhang , Lin Shang , Chilin Fu , Jun Zhou

We propose a new ensemble method for detecting and classifying adversarial examples generated by state-of-the-art attacks, including DeepFool and C&W. Our method works by training the members of an ensemble to have low classification error…

机器学习 · 计算机科学 2017-12-13 Alexander Bagnall , Razvan Bunescu , Gordon Stewart

In spite of the enormous success of neural networks, adversarial examples remain a relatively weakly understood feature of deep learning systems. There is a considerable effort in both building more powerful adversarial attacks and…

机器学习 · 计算机科学 2022-08-16 Maciej Żelaszczyk , Jacek Mańdziuk

Adversarial examples are malicious inputs crafted to induce misclassification. Commonly studied sensitivity-based adversarial examples introduce semantically-small changes to an input that result in a different model prediction. This paper…

机器学习 · 计算机科学 2020-08-05 Florian Tramèr , Jens Behrmann , Nicholas Carlini , Nicolas Papernot , Jörn-Henrik Jacobsen

Real-world natural language processing systems need to be robust to human adversaries. Collecting examples of human adversaries for training is an effective but expensive solution. On the other hand, training on synthetic attacks with small…

机器学习 · 计算机科学 2024-02-16 Aradhana Sinha , Ananth Balashankar , Ahmad Beirami , Thi Avrahami , Jilin Chen , Alex Beutel

We propose the first character-level white-box adversarial attack method against transformer models. The intuition of our method comes from the observation that words are split into subtokens before being fed into the transformer models and…

计算与语言 · 计算机科学 2022-11-01 Aiwei Liu , Honghai Yu , Xuming Hu , Shu'ang Li , Li Lin , Fukun Ma , Yawen Yang , Lijie Wen

Adversarial attacking aims to fool deep neural networks with adversarial examples. In the field of natural language processing, various textual adversarial attack models have been proposed, varying in the accessibility to the victim model.…

计算与语言 · 计算机科学 2020-09-22 Yuan Zang , Bairu Hou , Fanchao Qi , Zhiyuan Liu , Xiaojun Meng , Maosong Sun

Whisper is a recent Automatic Speech Recognition (ASR) model displaying impressive robustness to both out-of-distribution inputs and random noise. In this work, we show that this robustness does not carry over to adversarial noise. We show…

音频与语音处理 · 电气工程与系统科学 2023-08-14 Raphael Olivier , Bhiksha Raj

Recent works have shown that deep neural networks are vulnerable to adversarial examples that find samples close to the original image but can make the model misclassify. Even with access only to the model's output, an attacker can employ…

机器学习 · 计算机科学 2023-10-03 Quang H. Nguyen , Yingjie Lao , Tung Pham , Kok-Seng Wong , Khoa D. Doan

Adversarial examples for neural network image classifiers are known to be transferable: examples optimized to be misclassified by a source classifier are often misclassified as well by classifiers with different architectures. However,…

机器学习 · 计算机科学 2021-10-27 Jacob M. Springer , Melanie Mitchell , Garrett T. Kenyon

Adversarial attacks against Deep Neural Networks have been widely studied. One significant feature that makes such attacks particularly powerful is transferability, where the adversarial examples generated from one model can be effective…

密码学与安全 · 计算机科学 2020-09-29 Renzhi Wang , Tianwei Zhang , Xiaofei Xie , Lei Ma , Cong Tian , Felix Juefei-Xu , Yang Liu

The existence of adversarial examples capable of fooling trained neural network classifiers calls for a much better understanding of possible attacks to guide the development of safeguards against them. This includes attack methods in the…

This paper describes a baseline for the second iteration of the Fact Extraction and VERification shared task (FEVER2.0) which explores the resilience of systems through adversarial evaluation. We present a collection of simple adversarial…

计算与语言 · 计算机科学 2019-03-14 James Thorne , Andreas Vlachos

Machine learning has been proven to be susceptible to carefully crafted samples, known as adversarial examples. The generation of these adversarial examples helps to make the models more robust and gives us an insight into the underlying…

计算与语言 · 计算机科学 2020-12-29 Sachin Saxena

This paper examines the robustness of deployed few-shot meta-learning systems when they are fed an imperceptibly perturbed few-shot dataset. We attack amortized meta-learners, which allows us to craft colluding sets of inputs that are…

机器学习 · 计算机科学 2022-11-24 Elre T. Oldewage , John Bronskill , Richard E. Turner

Enhancing our understanding of adversarial examples is crucial for the secure application of machine learning models in real-world scenarios. A prevalent method for analyzing adversarial examples is through a frequency-based approach.…

机器学习 · 计算机科学 2024-04-17 Zhun Zhang , Yi Zeng , Qihe Liu , Shijie Zhou