English
Related papers

Related papers: Quantifying Robustness to Adversarial Word Substit…

200 papers

Modern Natural Language Processing (NLP) models are known to be sensitive to input perturbations and their performance can decrease when applied to real-world, noisy data. However, it is still unclear why models are less robust to some…

Computation and Language · Computer Science 2022-03-21 Yunxiang Zhang , Liangming Pan , Samson Tan , Min-Yen Kan

Adversarial robustness corresponds to the susceptibility of deep neural networks to imperceptible perturbations made at test time. In the context of image tasks, many algorithms have been proposed to make neural networks robust to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Pranjal Awasthi , George Yu , Chun-Sung Ferng , Andrew Tomkins , Da-Cheng Juan

Deep Neural Networks have taken Natural Language Processing by storm. While this led to incredible improvements across many tasks, it also initiated a new research field, questioning the robustness of these neural networks by attacking…

Computation and Language · Computer Science 2021-09-16 Jens Hauser , Zhao Meng , Damián Pascual , Roger Wattenhofer

Quantization has emerged as an essential technique for deploying deep neural networks (DNNs) on devices with limited resources. However, quantized models exhibit vulnerabilities when exposed to various noises in real-world applications.…

Machine Learning · Computer Science 2023-08-07 Yisong Xiao , Aishan Liu , Tianyuan Zhang , Haotong Qin , Jinyang Guo , Xianglong Liu

Given the widespread use of deep learning models in safety-critical applications, ensuring that the decisions of such models are robust against adversarial exploitation is of fundamental importance. In this thesis, we discuss recent…

Machine Learning · Computer Science 2025-09-24 Alexander Robey

Neural Machine Translation (NMT) models are sensitive to small perturbations in the input. Robustness to such perturbations is typically measured using translation quality metrics such as BLEU on the noisy input. This paper proposes…

Computation and Language · Computer Science 2020-05-05 Xing Niu , Prashant Mathur , Georgiana Dinu , Yaser Al-Onaizan

Cyber-Physical Systems (CPS) in domains such as manufacturing and energy distribution generate complex time series data crucial for Prognostics and Health Management (PHM). While Deep Learning (DL) methods have demonstrated strong…

Machine Learning · Computer Science 2025-12-16 Alexander Windmann , Henrik Steude , Daniel Boschmann , Oliver Niggemann

Policy robustness in Reinforcement Learning may not be desirable at any cost: the alterations caused by robustness requirements from otherwise optimal policies should be explainable, quantifiable and formally verifiable. In this work we…

Machine Learning · Computer Science 2023-12-12 Daniel Jarne Ornia , Licio Romao , Lewis Hammond , Manuel Mazo , Alessandro Abate

The vulnerability to adversarial attacks has been a critical issue for deep neural networks. Addressing this issue requires a reliable way to evaluate the robustness of a network. Recently, several methods have been developed to compute…

Machine Learning · Computer Science 2019-05-20 Ching-Yun Ko , Zhaoyang Lyu , Tsui-Wei Weng , Luca Daniel , Ngai Wong , Dahua Lin

The increasing deployment of Large Language Models (LLMs) in various applications necessitates a rigorous evaluation of their robustness against adversarial attacks. In this paper, we present a comprehensive study on the robustness of GPT…

Computation and Language · Computer Science 2024-12-24 Yiyi Tao , Yixian Shen , Hang Zhang , Yanxin Shen , Lun Wang , Chuanqi Shi , Shaoshuai Du

Large Language Models (LLMs) have emerged as a promising cornerstone for the development of natural language processing (NLP) and artificial intelligence (AI). However, ensuring the robustness of LLMs remains a critical challenge. To…

Computation and Language · Computer Science 2025-11-07 Pankaj Kumar , Subhankar Mishra

Recent strides in pretrained transformer-based language models have propelled state-of-the-art performance in numerous NLP tasks. Yet, as these models grow in size and deployment, their robustness under input perturbations becomes an…

Machine Learning · Computer Science 2025-08-27 Wuxinlin Cheng , Yupeng Cao , Jinwen Wu , Koduvayur Subbalakshmi , Tian Han , Zhuo Feng

This paper investigates the robustness of NLP against perturbed word forms. While neural approaches can achieve (almost) human-like accuracy for certain tasks and conditions, they often are sensitive to small changes in the input such as…

Computation and Language · Computer Science 2017-04-17 Georg Heigold , Günter Neumann , Josef van Genabith

The fine-tuning of pre-trained language models has a great success in many NLP fields. Yet, it is strikingly vulnerable to adversarial examples, e.g., word substitution attacks using only synonyms can easily fool a BERT-based sentiment…

Computation and Language · Computer Science 2021-12-23 Xinhsuai Dong , Luu Anh Tuan , Min Lin , Shuicheng Yan , Hanwang Zhang

The increasing use of machine learning in safety-critical domains amplifies the risk of adversarial threats, especially data poisoning attacks that corrupt training data to degrade performance or induce unsafe behavior. Most existing…

Machine Learning · Computer Science 2026-05-13 Sara Taheri , Mahalakshmi Sabanayagam , Debarghya Ghoshdastidar , Majid Zamani

Modern machine learning systems have been applied successfully to a variety of tasks in recent years but making such systems robust against adversarially chosen modifications of input instances seems to be a much harder problem. It is…

Quantum Physics · Physics 2021-12-20 Khashayar Barooti , Grzegorz Głuch , Ruediger Urbanke

Do larger and more performant models resolve NLP's longstanding robustness issues? We investigate this question using over 20 models of different sizes spanning different architectural choices and pretraining objectives. We conduct…

Computation and Language · Computer Science 2024-04-04 Ashim Gupta , Rishanth Rajendhran , Nathan Stringham , Vivek Srikumar , Ana Marasović

Data poisoning is a training-time attack that undermines the trustworthiness of learned models. In a targeted data poisoning attack, an adversary manipulates the training dataset to alter the classification of a targeted test point. Given…

Machine Learning · Computer Science 2025-11-18 Nakshatra Gupta , Sumanth Prabhu , Supratik Chakraborty , R Venkatesh

Understanding robustness is essential for building reliable NLP systems. Unfortunately, in the context of machine translation, previous work mainly focused on documenting robustness failures or improving robustness. In contrast, we study…

Computation and Language · Computer Science 2025-05-28 Abderrahmane Issam , Yusuf Can Semerci , Jan Scholtes , Gerasimos Spanakis

The study of adversarial robustness has so far largely focused on perturbations bound in p-norms. However, state-of-the-art models turn out to be also vulnerable to other, more natural classes of perturbations such as translations and…

Machine Learning · Computer Science 2019-09-17 Logan Engstrom , Brandon Tran , Dimitris Tsipras , Ludwig Schmidt , Aleksander Madry