English
Related papers

Related papers: Combating Adversarial Misspellings with Robust Wor…

200 papers

While generalizing well over natural inputs, neural networks are vulnerable to adversarial inputs. Existing defenses against adversarial inputs have largely been detached from the real world. These defenses also come at a cost to accuracy.…

Machine Learning · Computer Science 2019-12-05 Varun Chandrasekaran , Brian Tang , Nicolas Papernot , Kassem Fawaz , Somesh Jha , Xi Wu

Pre-trained language models (PLMs) have driven substantial progress in natural language processing but remain vulnerable to adversarial attacks, raising concerns about their robustness in real-world applications. Previous studies have…

Computation and Language · Computer Science 2025-10-17 Yang Wang , Chenghao Xiao , Yizhi Li , Stuart E. Middleton , Noura Al Moubayed , Chenghua Lin

In this work, we examine the ability of NER models to use contextual information when predicting the type of an ambiguous entity. We introduce NRB, a new testbed carefully designed to diagnose Name Regularity Bias of NER models. Our results…

Computation and Language · Computer Science 2021-07-27 Abbas Ghaddar , Philippe Langlais , Ahmad Rashid , Mehdi Rezagholizadeh

Recent works have empirically shown that there exist adversarial examples that can be hidden from neural network interpretability (namely, making network interpretation maps visually similar), or interpretability is itself susceptible to…

Machine Learning · Computer Science 2020-10-23 Akhilan Boopathy , Sijia Liu , Gaoyuan Zhang , Cynthia Liu , Pin-Yu Chen , Shiyu Chang , Luca Daniel

This work tackles an intriguing and fundamental open challenge in representation learning: Given a well-trained deep learning model, can it be reprogrammed to enhance its robustness against adversarial or noisy input perturbations without…

Machine Learning · Computer Science 2024-10-08 Zhichao Hou , MohamadAli Torkamani , Hamid Krim , Xiaorui Liu

In various real-world applications such as machine translation, sentiment analysis, and question answering, a pivotal role is played by NLP models, facilitating efficient communication and decision-making processes in domains ranging from…

Computation and Language · Computer Science 2024-04-09 Roopkatha Dey , Aivy Debnath , Sayak Kumar Dutta , Kaustav Ghosh , Arijit Mitra , Arghya Roy Chowdhury , Jaydip Sen

Deep Neural Networks, despite their great success in diverse domains, are provably sensitive to small perturbations on correctly classified examples and lead to erroneous predictions. Recently, it was proposed that this behavior can be…

Machine Learning · Computer Science 2020-09-29 Nan Xu , Oluwaseyi Feyisetan , Abhinav Aggarwal , Zekun Xu , Nathanael Teissier

Adversarial Training (AT) is one of the most effective methods for developing robust deep neural networks (DNNs). However, AT faces a trade-off problem between clean accuracy and adversarial robustness. In this work, we reveal a surprising…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Yanyun Wang , Qingqing Ye , Li Liu , Zi Liang , Haibo Hu

A line of work has shown that natural text processing models are vulnerable to adversarial examples. Correspondingly, various defense methods are proposed to mitigate the threat of textual adversarial examples, eg, adversarial training,…

Computation and Language · Computer Science 2022-07-21 Xiaosen Wang , Yifeng Xiong , Kun He

DNA Language Models, such as GROVER, DNABERT2 and the Nucleotide Transformer, operate on DNA sequences that inherently contain sequencing errors, mutations, and laboratory-induced noise, which may significantly impact model performance.…

Computation and Language · Computer Science 2025-03-04 Hyunwoo Yoo , Haebin Shin , Kaidi Xu , Gail Rosen

Recent work has proposed several efficient approaches for generating gradient-based adversarial perturbations on embeddings and proved that the model's performance and robustness can be improved when they are trained with these contaminated…

Computation and Language · Computer Science 2021-09-15 Yao Qiu , Jinchao Zhang , Jie Zhou

Machine-learning models demand periodic updates to improve their average accuracy, exploiting novel architectures and additional data. However, a newly updated model may commit mistakes the previous model did not make. Such…

Machine Learning · Computer Science 2025-05-30 Daniele Angioni , Luca Demetrio , Maura Pintor , Luca Oneto , Davide Anguita , Battista Biggio , Fabio Roli

Adversarial training has been actively studied in recent computer vision research to improve the robustness of models. However, due to the huge computational cost of generating adversarial samples, adversarial training methods are often…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Yihan Wu , Xinda Li , Florian Kerschbaum , Heng Huang , Hongyang Zhang

Meta-learning has emerged as a trending technique to tackle few-shot text classification and achieved state-of-the-art performance. However, existing solutions heavily rely on the exploitation of lexical features and their distributional…

Computation and Language · Computer Science 2021-07-27 ChengCheng Han , Zeqiu Fan , Dongxiang Zhang , Minghui Qiu , Ming Gao , Aoying Zhou

Adversarial examples have been shown to be the severe threat to deep neural networks (DNNs). One of the most effective adversarial defense methods is adversarial training (AT) through minimizing the adversarial risk $R_{adv}$, which…

Machine Learning · Computer Science 2020-06-17 Yiming Li , Baoyuan Wu , Yan Feng , Yanbo Fan , Yong Jiang , Zhifeng Li , Shutao Xia

The Deep neural networks (DNNs) have achieved great success on a variety of computer vision tasks, however, they are highly vulnerable to adversarial attacks. To address this problem, we propose to improve the local smoothness of the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Yaoyao Zhong , Weihong Deng

While state-of-the-art Deep Neural Network (DNN) models are considered to be robust to random perturbations, it was shown that these architectures are highly vulnerable to deliberately crafted perturbations, albeit being…

Machine Learning · Computer Science 2021-06-03 Omer Faruk Tuna , Ferhat Ozgur Catak , M. Taner Eskil

Recently, prefix-tuning has gained increasing attention as a parameter-efficient finetuning method for large-scale pretrained language models. The method keeps the pretrained models fixed and only updates the prefix token parameters for…

Computation and Language · Computer Science 2022-03-22 Zonghan Yang , Yang Liu

In recent years, Deep Neural Networks (DNNs) have had a dramatic impact on a variety of problems that were long considered very difficult, e. g., image classification and automatic language translation to name just a few. The accuracy of…

Machine Learning · Computer Science 2019-09-13 Yannik Potdevin , Dirk Nowotka , Vijay Ganesh

In communication systems, there are many tasks, like modulation recognition, which rely on Deep Neural Networks (DNNs) models. However, these models have been shown to be susceptible to adversarial perturbations, namely imperceptible…

Signal Processing · Electrical Eng. & Systems 2021-05-31 Javier Maroto , Gérôme Bovet , Pascal Frossard