English
Related papers

Related papers: Adversarial Examples for Evaluating Reading Compre…

200 papers

Current Machine Translation (MT) systems achieve very good results on a growing variety of language pairs and datasets. However, they are known to produce fluent translation outputs that can contain important meaning errors, thus…

Computation and Language · Computer Science 2021-09-23 Diptesh Kanojia , Marina Fomicheva , Tharindu Ranasinghe , Frédéric Blain , Constantin Orăsan , Lucia Specia

A human does not have to see all elephants to recognize an animal as an elephant. On contrast, current state-of-the-art deep learning approaches heavily depend on the variety of training samples and the capacity of the network. In practice,…

Machine Learning · Computer Science 2019-05-30 Shaokai Ye , Sia Huat Tan , Kaidi Xu , Yanzhi Wang , Chenglong Bao , Kaisheng Ma

We explore rigorous, systematic, and controlled experimental evaluation of adversarial examples in the real world and propose a testing regimen for evaluation of real world adversarial objects. We show that for small scene/ environmental…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Brett Jefferson , Carlos Ortiz Marrero

A keyword spotting (KWS) engine that is continuously running on device is exposed to various speech signals that are usually unseen before. It is a challenging problem to build a small-footprint and high-performing KWS model with robustness…

Sound · Computer Science 2024-08-27 Zhenyu Wang , Li Wan , Biqiao Zhang , Yiteng Huang , Shang-Wen Li , Ming Sun , Xin Lei , Zhaojun Yang

Large language models (LLMs) have significantly transformed the educational landscape. As current plagiarism detection tools struggle to keep pace with LLMs' rapid advancements, the educational community faces the challenge of assessing…

Computation and Language · Computer Science 2024-06-18 Roy Xie , Chengxuan Huang , Junlin Wang , Bhuwan Dhingra

Adversarial attack is commonly regarded as a huge threat to neural networks because of misleading behavior. This paper presents an opposite perspective: adversarial attacks can be harnessed to improve neural models if amended correctly.…

Artificial Intelligence · Computer Science 2023-05-19 Chong Yu , Tao Chen , Zhongxue Gan

Machine reading comprehension is an essential natural language processing task, which takes into a pair of context and query and predicts the corresponding answer to query. In this project, we developed an end-to-end question answering…

Computation and Language · Computer Science 2024-04-05 Jiawei Li , Yue Zhang

Machine Reading Comprehension (MRC) is an important testbed for evaluating models' natural language understanding (NLU) ability. There has been rapid progress in this area, with new models achieving impressive performance on various…

Computation and Language · Computer Science 2021-05-27 Chenglei Si , Ziqing Yang , Yiming Cui , Wentao Ma , Ting Liu , Shijin Wang

Deep neural networks are vulnerable to adversarial attacks, where a small perturbation to an input alters the model prediction. In many cases, malicious inputs intentionally crafted for one model can fool another model. In this paper, we…

Machine Learning · Computer Science 2021-09-23 Liping Yuan , Xiaoqing Zheng , Yi Zhou , Cho-Jui Hsieh , Kai-wei Chang

Learning semantically meaningful sentence embeddings is an open problem in natural language processing. In this work, we propose a sentence embedding learning approach that exploits both visual and textual information via a multimodal…

Computation and Language · Computer Science 2022-04-26 Miaoran Zhang , Marius Mosbach , David Ifeoluwa Adelani , Michael A. Hedderich , Dietrich Klakow

Machine Learning models face increased concerns regarding the storage of personal user data and adverse impacts of corrupted data like backdoors or systematic bias. Machine Unlearning can address these by allowing post-hoc deletion of…

Machine Learning · Computer Science 2023-02-23 Shashwat Goel , Ameya Prabhu , Amartya Sanyal , Ser-Nam Lim , Philip Torr , Ponnurangam Kumaraguru

Can transformers learn to perform algorithmic tasks reliably across previously unseen input/output domains? While pre-trained language models show solid accuracy on benchmarks incorporating algorithmic reasoning, assessing the reliability…

Machine Learning · Computer Science 2025-07-22 Michal Spiegel , Michal Štefánik , Marek Kadlčík , Josef Kuchař

Recent works have empirically shown that there exist adversarial examples that can be hidden from neural network interpretability (namely, making network interpretation maps visually similar), or interpretability is itself susceptible to…

Machine Learning · Computer Science 2020-10-23 Akhilan Boopathy , Sijia Liu , Gaoyuan Zhang , Cynthia Liu , Pin-Yu Chen , Shiyu Chang , Luca Daniel

Deep neural networks (DNNs) are vulnerable to adversarial examples, perturbations to correctly classified examples which can cause the model to misclassify. In the image domain, these perturbations are often virtually indistinguishable to…

Computation and Language · Computer Science 2018-09-26 Moustafa Alzantot , Yash Sharma , Ahmed Elgohary , Bo-Jhang Ho , Mani Srivastava , Kai-Wei Chang

Adversarial attacks on machine learning algorithms have been a key deterrent to the adoption of AI in many real-world use cases. They significantly undermine the ability of high-performance neural networks by forcing misclassifications.…

Machine Learning · Computer Science 2024-04-04 Nandish Chattopadhyay , Atreya Goswami , Anupam Chattopadhyay

Machine Learning (ML) models are applied in a variety of tasks such as network intrusion detection or Malware classification. Yet, these models are vulnerable to a class of malicious inputs known as adversarial examples. These are slightly…

Cryptography and Security · Computer Science 2017-10-18 Kathrin Grosse , Praveen Manoharan , Nicolas Papernot , Michael Backes , Patrick McDaniel

Previous works have shown that automatic speaker verification (ASV) is seriously vulnerable to malicious spoofing attacks, such as replay, synthetic speech, and recently emerged adversarial attacks. Great efforts have been dedicated to…

Sound · Computer Science 2024-06-06 Haibin Wu , Xu Li , Andy T. Liu , Zhiyong Wu , Helen Meng , Hung-yi Lee

Machine learning approaches for speech enhancement are becoming increasingly expressive, enabling ever more powerful modifications of input signals. In this paper, we demonstrate that this expressiveness introduces a vulnerability: advanced…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-01 Rostislav Makarov , Lea Schönherr , Timo Gerkmann

Training a robust system, e.g.,Speech to Text (STT), requires large datasets. Variability present in the dataset such as unwanted nuisances and biases are the reason for the need of large datasets to learn general representations. In this…

Sound · Computer Science 2021-10-19 Hemant Yadav , Atul Anshuman Singh , Rachit Mittal , Sunayana Sitaram , Yi Yu , Rajiv Ratn Shah

We are surprised to find that BERT's peak performance of 77% on the Argument Reasoning Comprehension Task reaches just three points below the average untrained human baseline. However, we show that this result is entirely accounted for by…

Computation and Language · Computer Science 2019-09-17 Timothy Niven , Hung-Yu Kao