English
Related papers

Related papers: Improving Robustness by Augmenting Training Senten…

200 papers

Increasing model size has unlocked a dazzling array of capabilities in modern language models. At the same time, even frontier models remain vulnerable to jailbreaks and prompt injections, despite concerted efforts to make them robust. As…

Machine Learning · Computer Science 2025-06-06 Nikolaus Howe , Ian McKenzie , Oskar Hollinsworth , Michał Zajac , Tom Tseng , Aaron Tucker , Pierre-Luc Bacon , Adam Gleave

The development of LLMs has greatly enhanced the intelligence and fluency of question answering, while the emergence of retrieval enhancement has enabled models to better utilize external information. However, the presence of noise and…

Computation and Language · Computer Science 2024-09-19 Xingyun Hong , Yan Shao , Zhilin Wang , Manni Duan , Jin Xiongnan

In many cases of machine learning, research suggests that the development of training data might have a higher relevance than the choice and modelling of classifiers themselves. Thus, data augmentation methods have been developed to improve…

Computation and Language · Computer Science 2022-07-25 Markus Bayer , Marc-André Kaufhold , Björn Buchhold , Marcel Keller , Jörg Dallmeyer , Christian Reuter

Various natural language processing tasks are structured prediction problems where outputs are constructed with multiple interdependent decisions. Past work has shown that domain knowledge, framed as constraints over the output space, can…

Computation and Language · Computer Science 2020-06-03 Xingyuan Pan , Maitrey Mehta , Vivek Srikumar

For both human readers and pre-trained language models (PrLMs), lexical diversity may lead to confusion and inaccuracy when understanding the underlying semantic meanings of given sentences. By substituting complex words with simple…

Computation and Language · Computer Science 2021-01-01 Rongzhou Bao , Jiayi Wang , Zhuosheng Zhang , Hai Zhao

Large pre-trained Vision-Language Models (VLMs) like CLIP, despite having remarkable generalization ability, are highly vulnerable to adversarial examples. This work studies the adversarial robustness of VLMs from the novel perspective of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Lin Li , Haoyan Guan , Jianing Qiu , Michael Spratling

Recently it has been shown that state-of-the-art NLP models are vulnerable to adversarial attacks, where the predictions of a model can be drastically altered by slight modifications to the input (such as synonym substitutions). While…

Computation and Language · Computer Science 2023-07-13 Yahan Yang , Soham Dan , Dan Roth , Insup Lee

Large language models (LLMs) are known to exhibit brittle behavior under adversarial prompts and jailbreak attacks, even after extensive alignment and fine-tuning. This fragility reflects a broader challenge of modern neural language…

Computation and Language · Computer Science 2026-02-04 Patrick Cooper , Alireza Nadali , Ashutosh Trivedi , Alvaro Velasquez

In various natural language processing (NLP) tasks, fine-tuning Pre-trained Language Models (PLMs) often leads to the issue of spurious correlations, which negatively impacts performance, particularly when dealing with out-of-distribution…

Computation and Language · Computer Science 2025-04-17 Suyoung Bae , Hyojun Kim , YunSeok Choi , Jee-Hyong Lee

Pre-trained language models (PLMs) are trained on data that inherently contains gender biases, leading to undesirable impacts. Traditional debiasing methods often rely on external corpora, which may lack quality, diversity, or demographic…

Computation and Language · Computer Science 2025-03-13 Liu Yu , Ludie Guo , Ping Kuang , Fan Zhou

The pruning objective has recently extended beyond accuracy and sparsity to robustness in language models. Despite this, existing methods struggle to enhance robustness against adversarial attacks when continually increasing model sparsity…

Computation and Language · Computer Science 2024-01-12 Jianwei Li , Qi Lei , Wei Cheng , Dongkuan Xu

Neural network models have been very successful at achieving high accuracy on natural language inference (NLI) tasks. However, as demonstrated in recent literature, when tested on some simple adversarial examples, most of the models suffer…

Computation and Language · Computer Science 2019-09-04 Alexander Hanbo Li , Abhinav Sethy

Standard NLP benchmarks often fail to capture vulnerabilities stemming from dataset artifacts and spurious correlations. Contrast sets address this gap by challenging models near decision boundaries but are traditionally labor-intensive to…

Computation and Language · Computer Science 2025-03-11 Hender Lin

Large-scale language models such as BERT have achieved state-of-the-art performance across a wide range of NLP tasks. Recent studies, however, show that such BERT-based models are vulnerable facing the threats of textual adversarial…

Computation and Language · Computer Science 2021-03-23 Boxin Wang , Shuohang Wang , Yu Cheng , Zhe Gan , Ruoxi Jia , Bo Li , Jingjing Liu

Deep neural networks are highly vulnerable to adversarial examples, i.e.,small perturbations that can significantly degrade model performance. While adversarial training has become the primary defense strategy, most studies focus on…

Machine Learning · Computer Science 2026-05-14 Lilin Zhang , Yimo Guo , Yue Li , Jiancheng Shi , Xianggen Liu

This paper introduces a simple and scalable approach to improve the data efficiency of large language model (LLM) training by augmenting existing text data with thinking trajectories. The compute for pre-training LLMs has been growing at an…

Computation and Language · Computer Science 2025-10-20 Liang Wang , Nan Yang , Shaohan Huang , Li Dong , Furu Wei

Modern Natural Language Processing (NLP) models are known to be sensitive to input perturbations and their performance can decrease when applied to real-world, noisy data. However, it is still unclear why models are less robust to some…

Computation and Language · Computer Science 2022-03-21 Yunxiang Zhang , Liangming Pan , Samson Tan , Min-Yen Kan

The training of spoken language understanding (SLU) models often faces the problem of data scarcity. In this paper, we put forward a data augmentation method using pretrained language models to boost the variability and accuracy of…

Computation and Language · Computer Science 2021-03-12 Baolin Peng , Chenguang Zhu , Michael Zeng , Jianfeng Gao

Large Language Models (LLMs) are highly vulnerable to input perturbations, as even a small prompt change may result in a substantially different output. Existing methods to enhance LLM robustness are primarily focused on perturbed data…

Computation and Language · Computer Science 2025-04-04 Aryan Agrawal , Lisa Alazraki , Shahin Honarvar , Marek Rei

While deep learning has led to remarkable results on a number of challenging problems, researchers have discovered a vulnerability of neural networks in adversarial settings, where small but carefully chosen perturbations to the input can…

Neural and Evolutionary Computing · Computer Science 2018-11-26 Edward Grefenstette , Robert Stanforth , Brendan O'Donoghue , Jonathan Uesato , Grzegorz Swirszcz , Pushmeet Kohli