中文
相关论文

相关论文: Robust Textual Embedding against Word-level Advers…

200 篇论文

Adversarial training provides a means of regularizing supervised learning algorithms while virtual adversarial training is able to extend supervised learning algorithms to the semi-supervised setting. However, both methods require making…

机器学习 · 统计学 2021-11-17 Takeru Miyato , Andrew M. Dai , Ian Goodfellow

Revealing the robustness issues of natural language processing models and improving their robustness is important to their performance under difficult situations. In this paper, we study the robustness of paraphrase identification models…

计算与语言 · 计算机科学 2020-10-06 Zhouxing Shi , Minlie Huang

End-to-End Speech Translation (E2E-ST) has seen significant advancements, yet current models are primarily benchmarked on curated, "clean" datasets. This overlooks critical real-world challenges, such as morphological robustness to…

计算与语言 · 计算机科学 2026-02-13 Abderrahmane Issam , Yusuf Can Semerci , Jan Scholtes , Gerasimos Spanakis

Language Models today provide a high accuracy across a large number of downstream tasks. However, they remain susceptible to adversarial attacks, particularly against those where the adversarial examples maintain considerable similarity to…

计算与语言 · 计算机科学 2023-07-25 Neel Bhandari , Pin-Yu Chen

In recent years, neural networks have demonstrated outstanding effectiveness in a large amount of applications.However, recent works have shown that neural networks are susceptible to adversarial examples, indicating possible flaws…

机器学习 · 计算机科学 2018-06-08 Fuxun Yu , Zirui Xu , Yanzhi Wang , Chenchen Liu , Xiang Chen

Neural machine translation (NMT) is notoriously sensitive to noises, but noises are almost inevitable in practice. One special kind of noise is the homophone noise, where words are replaced by other words with similar pronunciations. We…

计算与语言 · 计算机科学 2019-06-05 Hairong Liu , Mingbo Ma , Liang Huang , Hao Xiong , Zhongjun He

Following great success in the image processing field, the idea of adversarial training has been applied to tasks in the natural language processing (NLP) field. One promising approach directly applies adversarial training developed in the…

机器学习 · 计算机科学 2018-05-09 Motoki Sato , Jun Suzuki , Hiroyuki Shindo , Yuji Matsumoto

We present FireBERT, a set of three proof-of-concept NLP classifiers hardened against TextFooler-style word-perturbation by producing diverse alternatives to original samples. In one approach, we co-tune BERT against the training data and…

计算与语言 · 计算机科学 2020-08-11 Gunnar Mein , Kevin Hartman , Andrew Morris

For years, adversarial training has been extensively studied in natural language processing (NLP) settings. The main goal is to make models robust so that similar inputs derive in semantically similar outcomes, which is not a trivial…

计算与语言 · 计算机科学 2021-09-21 Daniela N. Rim , DongNyeong Heo , Heeyoul Choi

As Large Language Models make a breakthrough in natural language processing tasks (NLP), multimodal technique becomes extremely popular. However, it has been shown that multimodal NLP are vulnerable to adversarial attacks, where the outputs…

计算与语言 · 计算机科学 2026-03-16 Hao Wang , Jinzhe Jiang , Xin Zhang , Chen Li

Deep transformer neural network models have improved the predictive accuracy of intelligent text processing systems in the biomedical domain. They have obtained state-of-the-art performance scores on a wide variety of biomedical and…

计算与语言 · 计算机科学 2021-11-17 Milad Moradi , Matthias Samwald

Deep networks are well-known to be fragile to adversarial attacks. We conduct an empirical analysis of deep representations under the state-of-the-art attack method called PGD, and find that the attack causes the internal representation to…

机器学习 · 计算机科学 2019-10-29 Chengzhi Mao , Ziyuan Zhong , Junfeng Yang , Carl Vondrick , Baishakhi Ray

Embedding words in a vector space has gained a lot of attention in recent years. While state-of-the-art methods provide efficient computation of word similarities via a low-dimensional matrix embedding, their motivation is often left…

计算与语言 · 计算机科学 2016-09-29 Shihao Ji , Hyokun Yun , Pinar Yanardag , Shin Matsushima , S. V. N. Vishwanathan

Adversarial attacks against language models(LMs) are a significant concern. In particular, adversarial samples exploit the model's sensitivity to small input changes. While these changes appear insignificant on the semantics of the input…

计算与语言 · 计算机科学 2024-02-06 Aly M. Kassem , Sherif Saad

The field of textual adversarial defenses has gained considerable attention in recent years due to the increasing vulnerability of natural language processing (NLP) models to adversarial attacks, which exploit subtle perturbations in input…

计算与语言 · 计算机科学 2024-12-11 Wangli Yang , Jie Yang , Yi Guo , Johan Barthelemy

Fine-tuning pretrained language models (PLMs) on downstream tasks has become common practice in natural language processing. However, most of the PLMs are vulnerable, e.g., they are brittle under adversarial attacks or imbalanced data,…

计算与语言 · 计算机科学 2022-05-03 Shoujie Tong , Qingxiu Dong , Damai Dai , Yifan song , Tianyu Liu , Baobao Chang , Zhifang Sui

Deep Neural Networks have taken Natural Language Processing by storm. While this led to incredible improvements across many tasks, it also initiated a new research field, questioning the robustness of these neural networks by attacking…

计算与语言 · 计算机科学 2021-09-16 Jens Hauser , Zhao Meng , Damián Pascual , Roger Wattenhofer

Transformer-based models, such as BERT and GPT, have been widely adopted in natural language processing (NLP) due to their exceptional performance. However, recent studies show their vulnerability to textual adversarial attacks where the…

计算与语言 · 计算机科学 2023-12-01 Lujia Shen , Yuwen Pu , Shouling Ji , Changjiang Li , Xuhong Zhang , Chunpeng Ge , Ting Wang

Large-scale language models achieved state-of-the-art performance over a number of language tasks. However, they fail on adversarial language examples, which are sentences optimized to fool the language models but with similar semantic…

计算与语言 · 计算机科学 2023-10-31 Noah Thomas McDermott , Junfeng Yang , Chengzhi Mao

Existing works have shown that fine-tuned textual transformer models achieve state-of-the-art prediction performances but are also vulnerable to adversarial text perturbations. Traditional adversarial evaluation is often done \textit{only…

机器学习 · 计算机科学 2024-07-03 Cuong Dang , Dung D. Le , Thai Le