English
Related papers

Related papers: MockingBERT: A Method for Retroactively Adding Res…

200 papers

This paper presents a novel reconstruction method that leverages Diffusion Models to protect machine learning classifiers against adversarial attacks, all without requiring any modifications to the classifiers themselves. The susceptibility…

Machine Learning · Computer Science 2023-09-08 Hondamunige Prasanna Silva , Lorenzo Seidenari , Alberto Del Bimbo

Recent advances in large-scale language representation models such as BERT have improved the state-of-the-art performances in many NLP tasks. Meanwhile, character-level Chinese NLP models, including BERT for Chinese, have also demonstrated…

Computation and Language · Computer Science 2020-04-09 Boxin Wang , Boyuan Pan , Xin Li , Bo Li

Deep learning-based natural language processing (NLP) models, particularly pre-trained language models (PLMs), have been revealed to be vulnerable to adversarial attacks. However, the adversarial examples generated by many mainstream…

Computation and Language · Computer Science 2023-11-21 Zimu Wang , Wei Wang , Qi Chen , Qiufeng Wang , Anh Nguyen

It has been demonstrated that very simple attacks can fool highly-sophisticated neural network architectures. In particular, so-called adversarial examples, constructed from perturbations of input data that are small or imperceptible to…

Cryptography and Security · Computer Science 2019-04-09 N. Benjamin Erichson , Zhewei Yao , Michael W. Mahoney

Despite rapid adoption of autoregressive large language models, smaller text encoders still play an important role in text understanding tasks that require rich contextualized representations. Negation is an important semantic function that…

Computation and Language · Computer Science 2025-07-18 Thinh Hung Truong , Karin Verspoor , Trevor Cohn , Timothy Baldwin

Backdoor attack is a severe threat to the trustworthiness of DNN-based language models. In this paper, we first extend the definition of memorization of language models from sample-wise to more fine-grained sentence element-wise (e.g.,…

Computation and Language · Computer Science 2024-09-24 Zhenting Wang , Zhizhi Wang , Mingyu Jin , Mengnan Du , Juan Zhai , Shiqing Ma

Sensitivity to adversarial noise hinders deployment of machine learning algorithms in security-critical applications. Although many adversarial defenses have been proposed, robustness to adversarial noise remains an open problem. The most…

Machine Learning · Computer Science 2020-08-13 Alex Serban , Erik Poll , Joost Visser

NLP models are shown to suffer from robustness issues, i.e., a model's prediction can be easily changed under small perturbations to the input. In this work, we present a Controlled Adversarial Text Generation (CAT-Gen) model that, given an…

Computation and Language · Computer Science 2020-10-07 Tianlu Wang , Xuezhi Wang , Yao Qin , Ben Packer , Kang Li , Jilin Chen , Alex Beutel , Ed Chi

Deep Neural Networks, despite their great success in diverse domains, are provably sensitive to small perturbations on correctly classified examples and lead to erroneous predictions. Recently, it was proposed that this behavior can be…

Machine Learning · Computer Science 2020-09-29 Nan Xu , Oluwaseyi Feyisetan , Abhinav Aggarwal , Zekun Xu , Nathanael Teissier

State-of-the-art attacks on NLP models lack a shared definition of a what constitutes a successful attack. We distill ideas from past work into a unified framework: a successful natural language adversarial example is a perturbation that…

Computation and Language · Computer Science 2021-12-23 John X. Morris , Eli Lifland , Jack Lanchantin , Yangfeng Ji , Yanjun Qi

Recent approaches have exploited weaknesses in monolingual question answering (QA) models by adding adversarial statements to the passage. These attacks caused a reduction in state-of-the-art performance by almost 50%. In this paper, we are…

Computation and Language · Computer Science 2021-04-16 Sara Rosenthal , Mihaela Bornea , Avirup Sil

Transfer learning from pretrained language models recently became the dominant approach for solving many NLP tasks. A common approach to transfer learning for multiple tasks that maximize parameter sharing trains one or more task-specific…

Computation and Language · Computer Science 2021-06-03 Karen Hambardzumyan , Hrant Khachatrian , Jonathan May

Large language models (LLMs) are susceptible to social-engineered attacks that are human-interpretable but require a high level of comprehension for LLMs to counteract. Existing defensive measures can only mitigate less than half of these…

Computation and Language · Computer Science 2025-05-01 Canaan Yung , Hadi Mohaghegh Dolatabadi , Sarah Erfani , Christopher Leckie

Masked language modeling (MLM) pre-training models such as BERT corrupt the input by replacing some tokens with [MASK] and then train a model to reconstruct the original tokens. This is an effective technique which has led to good results…

Computation and Language · Computer Science 2020-06-11 Andy Wagner , Tiyasa Mitra , Mrinal Iyer , Godfrey Da Costa , Marc Tremblay

While recent works have been considerably improving the quality of the natural language explanations (NLEs) generated by a model to justify its predictions, there is very limited research in detecting and alleviating inconsistencies among…

Computation and Language · Computer Science 2023-06-06 Myeongjun Jang , Bodhisattwa Prasad Majumder , Julian McAuley , Thomas Lukasiewicz , Oana-Maria Camburu

Standard NLP benchmarks often fail to capture vulnerabilities stemming from dataset artifacts and spurious correlations. Contrast sets address this gap by challenging models near decision boundaries but are traditionally labor-intensive to…

Computation and Language · Computer Science 2025-03-11 Hender Lin

Pre-trained general-purpose language models have been a dominating component in enabling real-world natural language processing (NLP) applications. However, a pre-trained model with backdoor can be a severe threat to the applications. Most…

Computation and Language · Computer Science 2021-11-02 Lujia Shen , Shouling Ji , Xuhong Zhang , Jinfeng Li , Jing Chen , Jie Shi , Chengfang Fang , Jianwei Yin , Ting Wang

Language models like BERT excel at sentence classification tasks due to extensive pre-training on general data, but their robustness to parameter corruption is unexplored. To understand this better, we look at what happens if a language…

Computation and Language · Computer Science 2025-07-09 Shijie Han , Zhenyu Zhang , Andrei Arsene Simion

Standard accuracy metrics have shown that Math Word Problem (MWP) solvers have achieved high performance on benchmark datasets. However, the extent to which existing MWP solvers truly understand language and its relation with numbers is…

Computation and Language · Computer Science 2021-09-14 Vivek Kumar , Rishabh Maheshwary , Vikram Pudi

It is well known that adversarial attacks can fool deep neural networks with imperceptible perturbations. Although adversarial training significantly improves model robustness, failure cases of defense still broadly exist. In this work, we…

Machine Learning · Computer Science 2021-06-10 Boxi Wu , Heng Pan , Li Shen , Jindong Gu , Shuai Zhao , Zhifeng Li , Deng Cai , Xiaofei He , Wei Liu