中文
相关论文

相关论文: Towards Improving Adversarial Training of NLP Mode…

200 篇论文

Adversarial examples in NLP are receiving increasing research attention. One line of investigation is the generation of word-level adversarial examples against fine-tuned Transformer models that preserve naturalness and grammaticality.…

计算与语言 · 计算机科学 2022-10-24 Maximilian Mozes , Bennett Kleinberg , Lewis D. Griffin

Adversarial examples have been shown to be the severe threat to deep neural networks (DNNs). One of the most effective adversarial defense methods is adversarial training (AT) through minimizing the adversarial risk $R_{adv}$, which…

机器学习 · 计算机科学 2020-06-17 Yiming Li , Baoyuan Wu , Yan Feng , Yanbo Fan , Yong Jiang , Zhifeng Li , Shutao Xia

Adversarial Training (AT) with Projected Gradient Descent (PGD) is an effective approach for improving the robustness of the deep neural networks. However, PGD AT has been shown to suffer from two main limitations: i) high computational…

计算机视觉与模式识别 · 计算机科学 2020-12-29 Ahmadreza Jeddi , Mohammad Javad Shafiee , Alexander Wong

Deep networks are vulnerable to adversarial examples. Adversarial Training (AT) has been a standard foundation of modern adversarial defense approaches due to its remarkable effectiveness. However, AT is extremely time-consuming, refraining…

机器学习 · 计算机科学 2024-05-28 Shao-Yuan Lo , Vishal M. Patel

Despite their impressive capabilities, Multimodal Large Language Models (MLLMs) exhibit perceptual fragility when confronted with visually complex scenes. This weakness stems from a reliance on finite training datasets, which are…

机器学习 · 计算机科学 2026-03-05 Yicheng Bao , Xuhong Wang , Qiaosheng Zhang , Chaochao Lu , Xia Hu , Xin Tan

Adversarial training (AT) as a regularization method has proved its effectiveness in various tasks, such as image classification and text classification. Though there are successful applications of AT in many tasks of natural language…

计算与语言 · 计算机科学 2019-11-12 Ziqing Yang , Yiming Cui , Wanxiang Che , Ting Liu , Shijin Wang , Guoping Hu

Textual adversarial attacks can discover models' weaknesses by adding semantic-preserved but misleading perturbations to the inputs. The long-lasting adversarial attack-and-defense arms race in Natural Language Processing (NLP) is…

计算与语言 · 计算机科学 2023-05-31 Yangyi Chen , Hongcheng Gao , Ganqu Cui , Lifan Yuan , Dehan Kong , Hanlu Wu , Ning Shi , Bo Yuan , Longtao Huang , Hui Xue , Zhiyuan Liu , Maosong Sun , Heng Ji

We now have a rich and growing set of modeling tools and algorithms for inducing linguistic structure from text that is less than fully annotated. In this paper, we discuss some of the weaknesses of our current methodology. We present a new…

计算与语言 · 计算机科学 2012-07-17 Noah A. Smith

Large pre-trained Vision-Language Models (VLMs) such as Contrastive Language-Image Pre-training (CLIP) have been shown to be susceptible to adversarial attacks, raising concerns about their deployment in safety-critical applications like…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Lin Luo , Xin Wang , Bojia Zi , Shihao Zhao , Xingjun Ma , Yu-Gang Jiang

Adversarial training has emerged as an effective approach to train robust neural network models that are resistant to adversarial attacks, even in low-label regimes where labeled data is scarce. In this paper, we introduce a novel…

机器学习 · 计算机科学 2024-11-28 Tian Ye , Rajgopal Kannan , Viktor Prasanna

Adversarial training (AT) is currently one of the most effective ways to obtain the robustness of deep neural networks against adversarial attacks. However, most AT methods suffer from robust overfitting, i.e., a significant generalization…

机器学习 · 计算机科学 2024-03-15 Daiwei Yu , Zhuorong Li , Lina Wei , Canghong Jin , Yun Zhang , Sixian Chan

Adversarial training has been proven to be an effective technique for improving the adversarial robustness of models. However, there seems to be an inherent trade-off between optimizing the model for accuracy and robustness. To this end, we…

计算机视觉与模式识别 · 计算机科学 2020-08-20 Elahe Arani , Fahad Sarfraz , Bahram Zonooz

An adversarial example is an input transformed by small perturbations that machine learning models consistently misclassify. While there are a number of methods proposed to generate adversarial examples for text data, it is not trivial to…

计算与语言 · 计算机科学 2020-06-02 Ying Xu , Xu Zhong , Antonio Jose Jimeno Yepes , Jey Han Lau

Despite the fact that adversarial training has become the de facto method for improving the robustness of deep neural networks, it is well-known that vanilla adversarial training suffers from daunting robust overfitting, resulting in…

机器学习 · 计算机科学 2024-02-06 Tianjin Huang , Shiwei Liu , Tianlong Chen , Meng Fang , Li Shen , Vlaod Menkovski , Lu Yin , Yulong Pei , Mykola Pechenizkiy

Current adversarial attack algorithms, where an adversary changes a text to fool a victim model, have been repeatedly shown to be effective against text classifiers. These attacks, however, generally assume that the victim model is…

计算与语言 · 计算机科学 2024-01-17 Tom Roth , Inigo Jauregi Unanue , Alsharif Abuadbba , Massimo Piccardi

In the past few years, it has become increasingly evident that deep neural networks are not resilient enough to withstand adversarial perturbations in input data, leaving them vulnerable to attack. Various authors have proposed strong…

计算与语言 · 计算机科学 2023-04-19 Shreya Goyal , Sumanth Doddapaneni , Mitesh M. Khapra , Balaraman Ravindran

Aspect-Based Sentiment Analysis (ABSA) deals with the extraction of sentiments and their targets. Collecting labeled data for this task in order to help neural networks generalize better can be laborious and time-consuming. As an…

机器学习 · 计算机科学 2020-10-26 Akbar Karimi , Leonardo Rossi , Andrea Prati

Adversarial training has become the primary method to defend against adversarial samples. However, it is hard to practically apply due to many shortcomings. One of the shortcomings of adversarial training is that it will reduce the…

机器学习 · 计算机科学 2021-08-31 Zhishen Nie , Ying Lin , Sp Ren , Lan Zhang

This position paper proposes a novel approach to advancing NLP security by leveraging Large Language Models (LLMs) as engines for generating diverse adversarial attacks. Building upon recent work demonstrating LLMs' effectiveness in…

人工智能 · 计算机科学 2024-10-25 Sudarshan Srinivasan , Maria Mahbub , Amir Sadovnik

We introduce a new large-scale NLI benchmark dataset, collected via an iterative, adversarial human-and-model-in-the-loop procedure. We show that training models on this new dataset leads to state-of-the-art performance on a variety of…

计算与语言 · 计算机科学 2020-05-07 Yixin Nie , Adina Williams , Emily Dinan , Mohit Bansal , Jason Weston , Douwe Kiela