English
Related papers

Related papers: Phrase-level Textual Adversarial Attack with Label…

200 papers

Corruptions due to data perturbations and label noise are prevalent in the datasets from unreliable sources, which poses significant threats to model training. Despite existing efforts in developing robust models, current learning methods…

Machine Learning · Computer Science 2024-05-08 Peng-Fei Zhang , Zi Huang , Xin-Shun Xu , Guangdong Bai

Adversarial attacks expose important blind spots of deep learning systems. While word- and sentence-level attack scenarios mostly deal with finding semantic paraphrases of the input that fool NLP models, character-level attacks typically…

Computation and Language · Computer Science 2021-06-04 Yannik Keller , Jan Mackensen , Steffen Eger

Despite the remarkable performance and generalization levels of deep learning models in a wide range of artificial intelligence tasks, it has been demonstrated that these models can be easily fooled by the addition of imperceptible yet…

Machine Learning · Computer Science 2023-01-27 Jon Vadillo , Roberto Santana , Jose A. Lozano

As the deployment of NLP systems in critical applications grows, ensuring the robustness of large language models (LLMs) against adversarial attacks becomes increasingly important. Large language models excel in various NLP tasks but remain…

Computation and Language · Computer Science 2024-05-03 Zhenning Yang , Ryan Krawec , Liang-Yuan Wu

Although attention mechanisms have become fundamental components of deep learning models, they are vulnerable to perturbations, which may degrade the prediction performance and model interpretability. Adversarial training (AT) for attention…

Computation and Language · Computer Science 2022-12-27 Shunsuke Kitada , Hitoshi Iyatomi

The prompt-based learning paradigm, which bridges the gap between pre-training and fine-tuning, achieves state-of-the-art performance on several NLP tasks, particularly in few-shot settings. Despite being widely applied, prompt-based…

Computation and Language · Computer Science 2024-02-05 Shuai Zhao , Jinming Wen , Luu Anh Tuan , Junbo Zhao , Jie Fu

Neural Machine Translation (NMT) models have been shown to be vulnerable to adversarial attacks, wherein carefully crafted perturbations of the input can mislead the target model. In this paper, we introduce ACT, a novel adversarial attack…

Computation and Language · Computer Science 2024-02-23 Sahar Sadrizadeh , Ljiljana Dolamic , Pascal Frossard

Safety alignment of Large Language Models (LLMs) can be compromised with manual jailbreak attacks and (automatic) adversarial attacks. Recent studies suggest that defending against these attacks is possible: adversarial attacks generate…

Cryptography and Security · Computer Science 2023-12-15 Sicheng Zhu , Ruiyi Zhang , Bang An , Gang Wu , Joe Barrow , Zichao Wang , Furong Huang , Ani Nenkova , Tong Sun

Segmentation models have been found to be vulnerable to targeted and non-targeted adversarial attacks. However, the resulting segmentation outputs are often so damaged that it is easy to spot an attack. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Zhenhua Chen , Chuhua Wang , David J. Crandall

Deep Neural Networks are susceptible to adversarial perturbations. Adversarial training and adversarial purification are among the most widely recognized defense strategies. Although these methods have different underlying logic, both rely…

Machine Learning · Computer Science 2023-08-30 Hao Xuan , Peican Zhu , Xingyu Li

We propose a novel gradient-based attack against transformer-based language models that searches for an adversarial example in a continuous space of token probabilities. Our algorithm mitigates the gap between adversarial loss for…

Computation and Language · Computer Science 2023-02-13 Piotr Gaiński , Klaudia Bałazy

Deep neural networks (DNNs) have achieved remarkable success in various tasks (e.g., image classification, speech recognition, and natural language processing (NLP)). However, researchers have demonstrated that DNN-based models are…

Computation and Language · Computer Science 2021-04-22 Wenqi Wang , Run Wang , Lina Wang , Zhibo Wang , Aoshuang Ye

Recently, advanced NLP models have seen a surge in the usage of various applications. This raises the security threats of the released models. In addition to the clean models' unintentional weaknesses, {\em i.e.,} adversarial attacks, the…

Computation and Language · Computer Science 2021-01-18 Lichao Sun

This paper presents the experiments and results for the CheckThat! Lab at CLEF 2024 Task 6: Robustness of Credibility Assessment with Adversarial Examples (InCrediblAE). The primary objective of this task was to generate adversarial…

This work proposes a novel algorithm to generate natural language adversarial input for text classification models, in order to investigate the robustness of these models. It involves applying gradient-based perturbation on the sentence…

Information Retrieval · Computer Science 2019-09-11 Yu-Lun Hsieh , Minhao Cheng , Da-Cheng Juan , Wei Wei , Wen-Lian Hsu , Cho-Jui Hsieh

Intrinsic susceptibility of deep learning to adversarial examples has led to a plethora of attack techniques with a broad common objective of fooling deep models. However, we find slight compositional differences between the algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Rahul Ambati , Naveed Akhtar , Ajmal Mian , Yogesh Singh Rawat

Black-box adversarial attack on vision-language pre-trained models is a practical and challenging task, as text and image perturbations need to be considered simultaneously, and only the predicted results are accessible. Research on this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Han Liu , Jiaqi Li , Zhi Xu , Xiaotong Zhang , Xiaoming Xu , Fenglong Ma , Yuanman Li , Hong Yu

Adversarial training enhances neural network robustness but suffers from a tendency to overfit and increased generalization errors on clean data. This work introduces CLAT, an innovative approach that mitigates adversarial overfitting by…

Machine Learning · Computer Science 2024-12-25 Bhavna Gopal , Huanrui Yang , Jingyang Zhang , Mark Horton , Yiran Chen

Extensive research demonstrates that Deep Reinforcement Learning (DRL) models are susceptible to adversarially constructed inputs (i.e., adversarial examples), which can mislead the agent to take suboptimal or unsafe actions. Recent methods…

Machine Learning · Computer Science 2026-02-24 Shenghong He

Pre-trained transformer models such as BERT have shown massive gains across many text classification tasks. However, these models usually need enormous labeled data to achieve impressive performances. Obtaining labeled data is often…

Computation and Language · Computer Science 2025-01-15 Rohit Sharma , Shanu Kumar , Avinash Kumar