中文
相关论文

相关论文: Learning to Ignore Adversarial Attacks

200 篇论文

Recent adversarial attack developments have made reinforcement learning more vulnerable, and different approaches exist to deploy attacks against it, where the key is how to choose the right timing of the attack. Some work tries to design…

机器学习 · 计算机科学 2022-05-03 Yang Li , Quan Pan , Erik Cambria

Innovations in annotation methodology have been a catalyst for Reading Comprehension (RC) datasets and models. One recent trend to challenge current RC models is to involve a model in the annotation process: humans create questions…

计算与语言 · 计算机科学 2020-11-18 Max Bartolo , Alastair Roberts , Johannes Welbl , Sebastian Riedel , Pontus Stenetorp

Adversarial training (AT) has shown excellent high performance in defending against adversarial examples. Recent studies demonstrate that examples are not equally important to the final robustness of models during AT, that is, the so-called…

机器学习 · 计算机科学 2022-06-27 Mengting Xu , Tao Zhang , Zhongnian Li , Daoqiang Zhang

Deep neural networks are vulnerable to adversarial examples, i.e., carefully-perturbed inputs aimed to mislead classification. This work proposes a detection method based on combining non-linear dimensionality reduction and density…

机器学习 · 计算机科学 2019-05-02 Francesco Crecchi , Davide Bacciu , Battista Biggio

Recently it has been shown that state-of-the-art NLP models are vulnerable to adversarial attacks, where the predictions of a model can be drastically altered by slight modifications to the input (such as synonym substitutions). While…

计算与语言 · 计算机科学 2023-07-13 Yahan Yang , Soham Dan , Dan Roth , Insup Lee

Adversarial examples are inputs to machine learning models designed to cause the model to make a mistake. They are useful for understanding the shortcomings of machine learning models, interpreting their results, and for regularisation. In…

机器学习 · 计算机科学 2018-08-28 Pasquale Minervini , Sebastian Riedel

Adversarial training, which minimizes the maximal risk for label-preserving input perturbations, has proved to be effective for improving the generalization of language models. In this work, we propose a novel adversarial training…

计算与语言 · 计算机科学 2020-04-24 Chen Zhu , Yu Cheng , Zhe Gan , Siqi Sun , Tom Goldstein , Jingjing Liu

In various real-world applications such as machine translation, sentiment analysis, and question answering, a pivotal role is played by NLP models, facilitating efficient communication and decision-making processes in domains ranging from…

计算与语言 · 计算机科学 2024-04-09 Roopkatha Dey , Aivy Debnath , Sayak Kumar Dutta , Kaustav Ghosh , Arijit Mitra , Arghya Roy Chowdhury , Jaydip Sen

Many existing deep learning models are vulnerable to adversarial examples that are imperceptible to humans. To address this issue, various methods have been proposed to design network architectures that are robust to one particular type of…

机器学习 · 计算机科学 2021-01-19 Jia Liu , Yaochu Jin

Modern language models often rely on Reinforcement Learning from Human Feedback (RLHF) to encourage safe behaviors. However, they remain vulnerable to adversarial attacks due to three key limitations: (1) the inefficiency and high cost of…

In the past few years, it has become increasingly evident that deep neural networks are not resilient enough to withstand adversarial perturbations in input data, leaving them vulnerable to attack. Various authors have proposed strong…

计算与语言 · 计算机科学 2023-04-19 Shreya Goyal , Sumanth Doddapaneni , Mitesh M. Khapra , Balaraman Ravindran

Adversarial Training (AT) is one of the most effective methods to train robust Deep Neural Networks (DNNs). However, AT creates an inherent trade-off between clean accuracy and adversarial robustness, which is commonly attributed to the…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Yanyun Wang , Li Liu

Despite the impressive performances reported by deep neural networks in different application domains, they remain largely vulnerable to adversarial examples, i.e., input samples that are carefully perturbed to cause misclassification at…

计算机视觉与模式识别 · 计算机科学 2020-04-20 Angelo Sotgiu , Ambra Demontis , Marco Melis , Battista Biggio , Giorgio Fumera , Xiaoyi Feng , Fabio Roli

While recent works have been considerably improving the quality of the natural language explanations (NLEs) generated by a model to justify its predictions, there is very limited research in detecting and alleviating inconsistencies among…

Machine learning researchers have long noticed the phenomenon that the model training process will be more effective and efficient when the training samples are densely sampled around the underlying decision boundary. While this observation…

机器学习 · 计算机科学 2021-09-24 Honggang Yu , Shihfeng Zeng , Teng Zhang , Ing-Chao Lin , Yier Jin

It has been demonstrated that deep neural networks are prone to noisy examples particular adversarial samples during inference process. The gap between robust deep learning systems in real world applications and vulnerable neural networks…

机器学习 · 计算机科学 2018-07-03 Xinhan Di , Pengqian Yu , Meng Tian

We evaluate machine comprehension models' robustness to noise and adversarial attacks by performing novel perturbations at the character, word, and sentence level. We experiment with different amounts of perturbations to examine model…

计算与语言 · 计算机科学 2020-05-04 Winston Wu , Dustin Arendt , Svitlana Volkova

Speech is a common and effective way of communication between humans, and modern consumer devices such as smartphones and home hubs are equipped with deep learning based accurate automatic speech recognition to enable natural interaction…

计算与语言 · 计算机科学 2018-01-03 Moustafa Alzantot , Bharathan Balaji , Mani Srivastava

While the literature on security attacks and defense of Machine Learning (ML) systems mostly focuses on unrealistic adversarial examples, recent research has raised concern about the under-explored field of realistic adversarial attacks and…

机器学习 · 计算机科学 2023-05-23 Salijona Dyrmishi , Salah Ghamizi , Thibault Simonetto , Yves Le Traon , Maxime Cordy

Adversarial attacks have exposed a significant security vulnerability in state-of-the-art machine learning models. Among these models include deep reinforcement learning agents. The existing methods for attacking reinforcement learning…

机器学习 · 计算机科学 2020-01-17 Matthew Inkawhich , Yiran Chen , Hai Li