English
Related papers

Related papers: Undersensitivity in Neural Reading Comprehension

200 papers

Neural networks are known to be vulnerable to adversarial examples, inputs that have been intentionally perturbed to remain visually similar to the source input, but cause a misclassification. It was recently shown that given a dataset and…

Cryptography and Security · Computer Science 2018-01-08 Jamie Hayes , George Danezis

What fundamentally distinguishes an adversarial attack from a misclassification due to limited model expressivity or finite data? In this work, we investigate this question in the setting of high-dimensional binary classification, where…

Machine Learning · Statistics 2025-06-17 Matteo Vilucchio , Lenka Zdeborová , Bruno Loureiro

Intentionally crafted adversarial samples have effectively exploited weaknesses in deep neural networks. A standard method in adversarial robustness assumes a framework to defend against samples crafted by minimally perturbing a sample such…

Machine Learning · Computer Science 2022-11-07 Anaelia Ovalle , Evan Czyzycki , Cho-Jui Hsieh

Neural machine translation (NMT) often suffers from the vulnerability to noisy perturbations in the input. We propose an approach to improving the robustness of NMT models, which consists of two parts: (1) attack the translation model with…

Computation and Language · Computer Science 2019-06-07 Yong Cheng , Lu Jiang , Wolfgang Macherey

Although attention mechanisms have been applied to a variety of deep learning models and have been shown to improve the prediction performance, it has been reported to be vulnerable to perturbations to the mechanism. To overcome the…

Computation and Language · Computer Science 2022-11-23 Shunsuke Kitada , Hitoshi Iyatomi

Contextual question-answering models are susceptible to adversarial perturbations to input context, commonly observed in real-world scenarios. These adversarial noises are designed to degrade the performance of the model by distorting the…

Computation and Language · Computer Science 2025-11-18 Asir Saadat , Nahian Ibn Asad

Deep learning methods have gained increased attention in various applications due to their outstanding performance. For exploring how this high performance relates to the proper use of data artifacts and the accurate problem formulation of…

Cryptography and Security · Computer Science 2022-11-30 Eldor Abdukhamidov , Mohammed Abuhamad , Simon S. Woo , Eric Chan-Tin , Tamer Abuhmed

We present two categories of model-agnostic adversarial strategies that reveal the weaknesses of several generative, task-oriented dialogue models: Should-Not-Change strategies that evaluate over-sensitivity to small and…

Computation and Language · Computer Science 2018-09-07 Tong Niu , Mohit Bansal

Pretrained language models have achieved super-human performances on many Machine Reading Comprehension (MRC) benchmarks. Nevertheless, their relative inability to defend against adversarial attacks has spurred skepticism about their…

Artificial Intelligence · Computer Science 2023-02-02 Son Quoc Tran , Phong Nguyen-Thuan Do , Uyen Le , Matt Kretchmar

It is well known that adversarial attacks can fool deep neural networks with imperceptible perturbations. Although adversarial training significantly improves model robustness, failure cases of defense still broadly exist. In this work, we…

Machine Learning · Computer Science 2021-06-10 Boxi Wu , Heng Pan , Li Shen , Jindong Gu , Shuai Zhao , Zhifeng Li , Deng Cai , Xiaofei He , Wei Liu

Although existing machine reading comprehension models are making rapid progress on many datasets, they are far from robust. In this paper, we propose an understanding-oriented machine reading comprehension model to address three kinds of…

Computation and Language · Computer Science 2022-07-04 Feiliang Ren , Yongkang Liu , Bochao Li , Shilei Liu , Bingchao Wang , Jiaqi Wang , Chunchao Liu , Qi Ma

Machine learning models are vulnerable to Adversarial Examples: minor perturbations to input samples intended to deliberately cause misclassification. Current defenses against adversarial examples, especially for Deep Neural Networks (DNN),…

Cryptography and Security · Computer Science 2019-01-04 Kathrin Grosse , David Pfaff , Michael Thomas Smith , Michael Backes

Deep neural networks have proven remarkably effective at solving many classification problems, but have been criticized recently for two major weaknesses: the reasons behind their predictions are uninterpretable, and the predictions…

Machine Learning · Computer Science 2017-11-28 Andrew Slavin Ross , Finale Doshi-Velez

Unsupervised word translation from non-parallel inter-lingual corpora has attracted much research interest. Very recently, neural network methods trained with adversarial loss functions achieved high accuracy on this task. Despite the…

Machine Learning · Computer Science 2018-08-15 Yedid Hoshen , Lior Wolf

Deep Neural Networks (DNNs) have shown remarkable performance in a diverse range of machine learning applications. However, it is widely known that DNNs are vulnerable to simple adversarial perturbations, which causes the model to…

Machine Learning · Computer Science 2021-07-23 Gihyuk Ko , Gyumin Lim

Deep neural models (e.g. Transformer) naturally learn spurious features, which create a ``shortcut'' between the labels and inputs, thus impairing the generalization and robustness. This paper advances the self-attention mechanism to its…

Computation and Language · Computer Science 2023-02-09 Hongqiu Wu , Ruixue Ding , Hai Zhao , Pengjun Xie , Fei Huang , Min Zhang

Deep Neural Networks (DNNs) are known to be vulnerable to adversarial attacks. Currently, there is no clear insight into how slight perturbations cause such a large difference in classification results and how we can design a more robust…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Haizhong Zheng , Ziqi Zhang , Honglak Lee , Atul Prakash

Given the great success of Deep Neural Networks(DNNs) and the black-box nature of it,the interpretability of these models becomes an important issue.The majority of previous research works on the post-hoc interpretation of a trained…

Machine Learning · Computer Science 2021-03-22 Haoyang Li , Xinggang Wang

Deep Neural Networks (DNNs) are highly sensitive to imperceptible malicious perturbations, known as adversarial attacks. Following the discovery of this vulnerability in real-world imaging and vision applications, the associated safety…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Tsachi Blau , Roy Ganz , Bahjat Kawar , Alex Bronstein , Michael Elad

Machine learning methods in general and Deep Neural Networks in particular have shown to be vulnerable to adversarial perturbations. So far this phenomenon has mainly been studied in the context of whole-image classification. In this…

Machine Learning · Statistics 2017-03-06 Volker Fischer , Mummadi Chaithanya Kumar , Jan Hendrik Metzen , Thomas Brox