English
Related papers

Related papers: Toward Stronger Textual Attack Detectors

200 papers

The adversarial attacks against deep neural networks on computer vision tasks have spawned many new technologies that help protect models from avoiding false predictions. Recently, word-level adversarial attacks on deep models of Natural…

Computation and Language · Computer Science 2020-06-15 Zhaoyang Wang , Hongtao Wang

Natural language processing (NLP) models are known to be vulnerable to backdoor attacks, which poses a newly arisen threat to NLP models. Prior online backdoor defense methods for NLP models only focus on the anomalies at either the input…

Computation and Language · Computer Science 2022-10-17 Sishuo Chen , Wenkai Yang , Zhiyuan Zhang , Xiaohan Bi , Xu Sun

In response to adversarial text attacks, attack detection models have been proposed and shown to successfully identify text modified by adversaries. Attack detection models can be leveraged to provide an additional check for NLP models and…

Computation and Language · Computer Science 2025-09-26 Jonathan Rusert

Over the past few years, various word-level textual attack approaches have been proposed to reveal the vulnerability of deep neural networks used in natural language processing. Typically, these approaches involve an important optimization…

Computation and Language · Computer Science 2021-11-23 Shengcai Liu , Ning Lu , Cheng Chen , Ke Tang

Even though the large-scale language models have achieved excellent performances, they suffer from various adversarial attacks. A large body of defense methods has been proposed. However, they are still limited due to redundant attack…

Computation and Language · Computer Science 2022-10-19 Lan Jiang , Hao Zhou , Yankai Lin , Peng Li , Jie Zhou , Rui Jiang

While Graph Neural Networks (GNNs) and Large Language Models (LLMs) are powerful approaches for learning on Text-Attributed Graphs (TAGs), a comprehensive understanding of their robustness remains elusive. Current evaluations are…

Machine Learning · Computer Science 2025-10-21 Runlin Lei , Lu Yi , Mingguo He , Pengyu Qiu , Zhewei Wei , Yongchao Liu , Chuntao Hong

Although deep neural networks have achieved state-of-the-art performance in various machine learning tasks, adversarial examples, constructed by adding small non-random perturbations to correctly classified inputs, successfully fool highly…

Computation and Language · Computer Science 2022-05-02 Na Liu , Mark Dras , Wei Emma Zhang

Recent natural language processing (NLP) techniques have accomplished high performance on benchmark datasets, primarily due to the significant improvement in the performance of deep learning. The advances in the research community have led…

Computation and Language · Computer Science 2022-10-24 Marwan Omar , Soohyeon Choi , DaeHun Nyang , David Mohaisen

Adversarial attacking aims to fool deep neural networks with adversarial examples. In the field of natural language processing, various textual adversarial attack models have been proposed, varying in the accessibility to the victim model.…

Computation and Language · Computer Science 2020-09-22 Yuan Zang , Bairu Hou , Fanchao Qi , Zhiyuan Liu , Xiaojun Meng , Maosong Sun

Inspired by the success of large language models (LLMs), there is a significant research shift from traditional graph learning methods to LLM-based graph frameworks, formally known as GraphLLMs. GraphLLMs leverage the reasoning power of…

Machine Learning · Computer Science 2025-06-16 Qihai Zhang , Xinyue Sheng , Yuanfu Sun , Qiaoyu Tan

Throughout the past five years, the susceptibility of neural networks to minimal adversarial perturbations has moved from a peculiar phenomenon to a core issue in Deep Learning. Despite much attention, however, progress towards more robust…

Machine Learning · Statistics 2019-12-13 Wieland Brendel , Jonas Rauber , Matthias Kümmerer , Ivan Ustyuzhaninov , Matthias Bethge

Recently, few certified defense methods have been developed to provably guarantee the robustness of a text classifier to adversarial synonym substitutions. However, all existing certified defense methods assume that the defenders are…

Computation and Language · Computer Science 2021-07-27 Jiehang Zeng , Xiaoqing Zheng , Jianhan Xu , Linyang Li , Liping Yuan , Xuanjing Huang

Despite the impressive adaptability of large language models (LLMs), challenges remain in ensuring their security, transparency, and interpretability. Given their susceptibility to adversarial attacks, LLMs need to be defended with an…

Artificial Intelligence · Computer Science 2024-10-11 Tomas Bueno Momcilovic , Beat Buesser , Giulio Zizzo , Mark Purcell , Dian Balta

Semantic parsing maps natural language (NL) utterances into logical forms (LFs), which underpins many advanced NLP problems. Semantic parsers gain performance boosts with deep neural networks, but inherit vulnerabilities against adversarial…

Computation and Language · Computer Science 2021-02-04 Shuo Huang , Zhuang Li , Lizhen Qu , Lei Pan

While adversarial robustness in computer vision is a mature research field, fewer researchers have tackled the evasion attacks against tabular deep learning, and even fewer investigated robustification mechanisms and reliable defenses. We…

Machine Learning · Computer Science 2024-08-15 Thibault Simonetto , Salah Ghamizi , Maxime Cordy

Large Language Models (LLMs) have achieved human-level fluency in text generation, making it difficult to distinguish between human-written and LLM-generated texts. This poses a growing risk of misuse of LLMs and demands the development of…

Computation and Language · Computer Science 2024-02-20 Ryuto Koike , Masahiro Kaneko , Naoaki Okazaki

Large language models (LLMs) are increasingly deployed as educational agents for automatic short answer grading (ASAG) in real-world educational environments, significantly boosting assessment efficiency and scalability. However, when these…

Cryptography and Security · Computer Science 2026-05-25 Xueyi Li , Zhuoneng Zhou , Zitao Liu , Yongdong Wu

Adversarial attacks against machine learning models have threatened various real-world applications such as spam filtering and sentiment analysis. In this paper, we propose a novel framework, learning to DIScriminate Perturbations (DISP),…

Computation and Language · Computer Science 2019-09-10 Yichao Zhou , Jyun-Yu Jiang , Kai-Wei Chang , Wei Wang

As large language models (LLMs) and generative AI become increasingly integrated into customer service and moderation applications, adversarial threats emerge from both external manipulations and internal label corruption. In this work, we…

Cryptography and Security · Computer Science 2025-08-11 Ko-Wei Chuang , Hen-Hsen Huang , Tsai-Yen Li

Despite excellent performance on many tasks, NLP systems are easily fooled by small adversarial perturbations of inputs. Existing procedures to defend against such perturbations are either (i) heuristic in nature and susceptible to stronger…

Computation and Language · Computer Science 2020-05-05 Erik Jones , Robin Jia , Aditi Raghunathan , Percy Liang