English
Related papers

Related papers: Are Multilingual BERT models robust? A Case Study …

200 papers

Deep learning based question answering (QA) on English documents has achieved success because there is a large amount of English training examples. However, for most languages, training examples for high-quality QA models are not available.…

Computation and Language · Computer Science 2019-07-16 Chia-Hsuan Lee , Hung-Yi Lee

Integrating adversarial machine learning with Question Answering (QA) systems has emerged as a critical area for understanding the vulnerabilities and robustness of these systems. This article aims to comprehensively review adversarial…

Computation and Language · Computer Science 2024-08-13 Gulsum Yigit , Mehmet Fatih Amasyali

We propose a multilingual adversarial training model for determining whether a sentence contains an idiomatic expression. Given that a key challenge with this task is the limited size of annotated data, our model relies on pre-trained…

Computation and Language · Computer Science 2022-06-08 Lis Kanashiro Pereira , Ichiro Kobayashi

Pre-trained language models (PLMs) have been widely used to underpin various downstream tasks. However, the adversarial attack task has found that PLMs are vulnerable to small perturbations. Mainstream methods adopt a detached two-stage…

Computation and Language · Computer Science 2023-05-30 Xuanjie Fang , Sijie Cheng , Yang Liu , Wei Wang

Existing literature on Question Answering (QA) mostly focuses on algorithmic novelty, data augmentation, or increasingly large pre-trained language models like XLNet and RoBERTa. Additionally, a lot of systems on the QA leaderboards do not…

Computation and Language · Computer Science 2019-09-13 Lin Pan , Rishav Chakravarti , Anthony Ferritto , Michael Glass , Alfio Gliozzo , Salim Roukos , Radu Florian , Avirup Sil

Adversarial attacking aims to fool deep neural networks with adversarial examples. In the field of natural language processing, various textual adversarial attack models have been proposed, varying in the accessibility to the victim model.…

Computation and Language · Computer Science 2020-09-22 Yuan Zang , Bairu Hou , Fanchao Qi , Zhiyuan Liu , Xiaojun Meng , Maosong Sun

As one promising way to inquire about any particular information through a dialog with the bot, question answering dialog systems have gained increasing research interests recently. Designing interactive QA systems has always been a…

Computation and Language · Computer Science 2021-04-26 Munazza Zaib , Dai Hoang Tran , Subhash Sagar , Adnan Mahmood , Wei E. Zhang , Quan Z. Sheng

Recent developments in adversarial attacks on deep learning leave many mission-critical natural language processing (NLP) systems at risk of exploitation. To address the lack of computationally efficient adversarial defense methods, this…

Computation and Language · Computer Science 2024-10-17 Hao-Yuan Chang , Kang L. Wang

Nowadays, offensive content in social media has become a serious problem, and automatically detecting offensive language is an essential task. In this paper, we build an offensive language detection system, which combines multi-task…

Computation and Language · Computer Science 2020-07-21 Wenliang Dai , Tiezheng Yu , Zihan Liu , Pascale Fung

Adversarial evaluations of language models typically focus on English alone. In this paper, we performed a multilingual evaluation of Named Entity Recognition (NER) in terms of its robustness to small perturbations in the input. Our results…

Computation and Language · Computer Science 2023-05-31 Akshay Srinivasan , Sowmya Vajjala

With the boom of Large Language Models (LLMs), the research of solving Math Word Problem (MWP) has recently made great progress. However, there are few studies to examine the security of LLMs in math solving ability. Instead of attacking…

Computation and Language · Computer Science 2023-09-06 Zihao Zhou , Qiufeng Wang , Mingyu Jin , Jie Yao , Jianan Ye , Wei Liu , Wei Wang , Xiaowei Huang , Kaizhu Huang

Large-scale language models achieved state-of-the-art performance over a number of language tasks. However, they fail on adversarial language examples, which are sentences optimized to fool the language models but with similar semantic…

Computation and Language · Computer Science 2023-10-31 Noah Thomas McDermott , Junfeng Yang , Chengzhi Mao

Multilingual pretrained language models (such as multilingual BERT) have achieved impressive results for cross-lingual transfer. However, due to the constant model capacity, multilingual pre-training usually lags behind the monolingual…

Computation and Language · Computer Science 2019-11-12 Zewen Chi , Li Dong , Furu Wei , Xian-Ling Mao , Heyan Huang

Adversarial attacks against deep learning models represent a major threat to the security and reliability of natural language processing (NLP) systems. In this paper, we propose a modification to the BERT-Attack framework, integrating…

Machine Learning · Computer Science 2024-08-01 Hetvi Waghela , Jaydip Sen , Sneha Rakshit

Increasing model size when pretraining natural language representations often results in improved performance on downstream tasks. However, at some point further model increases become harder due to GPU/TPU memory limitations and longer…

Computation and Language · Computer Science 2020-02-11 Zhenzhong Lan , Mingda Chen , Sebastian Goodman , Kevin Gimpel , Piyush Sharma , Radu Soricut

While numerous methods have been proposed as defenses against adversarial examples in question answering (QA), these techniques are often model specific, require retraining of the model, and give only marginal improvements in performance…

Computation and Language · Computer Science 2021-02-08 Sagnik Majumder , Chinmoy Samant , Greg Durrett

Adversarial training, which minimizes the maximal risk for label-preserving input perturbations, has proved to be effective for improving the generalization of language models. In this work, we propose a novel adversarial training…

Computation and Language · Computer Science 2020-04-24 Chen Zhu , Yu Cheng , Zhe Gan , Siqi Sun , Tom Goldstein , Jingjing Liu

The research of adversarial attacks in the text domain attracts many interests in the last few years, and many methods with a high attack success rate have been proposed. However, these attack methods are inefficient as they require lots of…

Computation and Language · Computer Science 2021-10-18 Tengfei Zhao , Zhaocheng Ge , Hanping Hu , Dingmeng Shi

To combat adversarial spelling mistakes, we propose placing a word recognition model in front of the downstream classifier. Our word recognition models build upon the RNN semi-character architecture, introducing several new backoff…

Computation and Language · Computer Science 2019-08-30 Danish Pruthi , Bhuwan Dhingra , Zachary C. Lipton

Multilingual large language models (MLLMs) have demonstrated significant cross-lingual capabilities through in-context learning. Existing approaches typically construct monolingual in-context examples, either in the source or target…

Computation and Language · Computer Science 2024-07-17 Sunkyoung Kim , Dayeon Ki , Yireun Kim , Jinsik Lee