English
Related papers

Related papers: Undersensitivity in Neural Reading Comprehension

200 papers

Adversarial attacks dramatically change the output of an otherwise accurate learning system using a seemingly inconsequential modification to a piece of input data. Paradoxically, empirical evidence indicates that even systems which are…

Machine Learning · Computer Science 2024-09-13 Oliver J. Sutton , Qinghua Zhou , Ivan Y. Tyukin , Alexander N. Gorban , Alexander Bastounis , Desmond J. Higham

Deep learning-based image denoising models demonstrate remarkable performance, but their lack of robustness analysis remains a significant concern. A major issue is that these models are susceptible to adversarial attacks, where small,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Jie Ning , Jiebao Sun , Shengzhu Shi , Zhichang Guo , Yao Li , Hongwei Li , Boying Wu

Several machine learning models, including neural networks, consistently misclassify adversarial examples---inputs formed by applying small but intentionally worst-case perturbations to examples from the dataset, such that the perturbed…

Machine Learning · Statistics 2015-03-24 Ian J. Goodfellow , Jonathon Shlens , Christian Szegedy

Neural networks have a number of shortcomings. Amongst the severest ones is the sensitivity to distribution shifts which allows models to be easily fooled into wrong predictions by small perturbations to inputs that are often imperceivable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Paul Gavrikov , Janis Keuper , Margret Keuper

Adversarial examples --- perturbations to the input of a model that elicit large changes in the output --- have been shown to be an effective way of assessing the robustness of sequence-to-sequence (seq2seq) models. However, these…

Computation and Language · Computer Science 2019-03-20 Paul Michel , Xian Li , Graham Neubig , Juan Miguel Pino

Machine learning approaches for speech enhancement are becoming increasingly expressive, enabling ever more powerful modifications of input signals. In this paper, we demonstrate that this expressiveness introduces a vulnerability: advanced…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-01 Rostislav Makarov , Lea Schönherr , Timo Gerkmann

Machine learning and deep learning in particular has advanced tremendously on perceptual tasks in recent years. However, it remains vulnerable against adversarial perturbations of the input that have been crafted specifically to fool the…

Machine Learning · Statistics 2017-02-22 Jan Hendrik Metzen , Tim Genewein , Volker Fischer , Bastian Bischoff

Deep neural networks are at the forefront of machine learning research. However, despite achieving impressive performance on complex tasks, they can be very sensitive: Small perturbations of inputs can be sufficient to induce incorrect…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Alex Serban , Erik Poll , Joost Visser

Deep Learning models are vulnerable to adversarial examples, i.e.\ images obtained via deliberate imperceptible perturbations, such that the model misclassifies them with high confidence. However, class confidence by itself is an incomplete…

Machine Learning · Statistics 2017-11-23 Ambrish Rawat , Martin Wistuba , Maria-Irina Nicolae

Deep neural networks are vulnerable to adversarial examples -- minor perturbations added to a model's input which cause the model to output an incorrect prediction. We introduce a new method for improving the efficacy of adversarial attacks…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Chris Miller , Soroush Vosoughi

Despite the recent advances in a wide spectrum of applications, machine learning models, especially deep neural networks, have been shown to be vulnerable to adversarial attacks. Attackers add carefully-crafted perturbations to input, where…

Machine Learning · Computer Science 2020-10-08 Ninghao Liu , Mengnan Du , Ruocheng Guo , Huan Liu , Xia Hu

When humans learn to perform a difficult task (say, reading comprehension (RC) over longer passages), it is typically the case that their performance improves significantly on an easier version of this task (say, RC over shorter passages).…

Computation and Language · Computer Science 2019-04-05 Soham Parikh , Ananya B. Sai , Preksha Nema , Mitesh M. Khapra

Neural machine translation systems tend to fail on less decent inputs despite its significant efficacy, which may significantly harm the credibility of this systems-fathoming how and when neural-based systems fail in such cases is critical…

Computation and Language · Computer Science 2020-05-27 Wei Zou , Shujian Huang , Jun Xie , Xinyu Dai , Jiajun Chen

With the advent of deep learning methods, Neural Machine Translation (NMT) systems have become increasingly powerful. However, deep learning based systems are susceptible to adversarial attacks, where imperceptible changes to the input can…

Computation and Language · Computer Science 2023-06-27 Vyas Raina , Mark Gales

Recent works have empirically shown that there exist adversarial examples that can be hidden from neural network interpretability (namely, making network interpretation maps visually similar), or interpretability is itself susceptible to…

Machine Learning · Computer Science 2020-10-23 Akhilan Boopathy , Sijia Liu , Gaoyuan Zhang , Cynthia Liu , Pin-Yu Chen , Shiyu Chang , Luca Daniel

Sparse attacks are to optimize the magnitude of adversarial perturbations for fooling deep neural networks (DNNs) involving only a few perturbed pixels (i.e., under the l0 constraint), suitable for interpreting the vulnerability of DNNs.…

Machine Learning · Computer Science 2025-06-24 Fudong Lin , Jiadong Lou , Hao Wang , Brian Jalaian , Xu Yuan

Deep neural networks (DNNs) are highly susceptible to adversarial examples--subtle perturbations applied to inputs that are often imperceptible to humans yet lead to incorrect model predictions. In black-box scenarios, however, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Qing Wan , Shilong Deng , Xun Wang

An intriguing property of deep neural networks is their inherent vulnerability to adversarial inputs, which significantly hinders their application in security-critical domains. Most existing detection methods attempt to use carefully…

Machine Learning · Computer Science 2017-12-05 Chanh Nguyen , Georgi Georgiev , Yujie Ji , Ting Wang

In learning problems, the noise inherent to the task at hand hinders the possibility to infer without a certain degree of uncertainty. Quantifying this uncertainty, regardless of its wide use, assumes high relevance for security-sensitive…

In spite of great advancements of machine reading comprehension (RC), existing RC models are still vulnerable and not robust to different types of adversarial examples. Neural models over-confidently predict wrong answers to semantic…

Computation and Language · Computer Science 2019-11-19 Mantong Zhou , Minlie Huang , Xiaoyan Zhu