English
Related papers

Related papers: TextShield: Beyond Successfully Detecting Adversar…

200 papers

Autonomous agents deployed in the real world need to be robust against adversarial attacks on sensory inputs. Robustifying agent policies requires anticipating the strongest attacks possible. We demonstrate that existing observation-space…

We propose algorithms to create adversarial attacks to assess model robustness in text classification problems. They can be used to create white box attacks and black box attacks while at the same time preserving the semantics and syntax of…

Computation and Language · Computer Science 2020-08-17 Rahul Singh , Tarun Joshi , Vijayan N. Nair , Agus Sudjianto

The widespread adoption of code language models in software engineering tasks has exposed vulnerabilities to adversarial attacks, especially the identifier substitution attacks. Although existing identifier substitution attackers…

Software Engineering · Computer Science 2025-04-29 Wenhan Mu , Ling Xu , Shuren Pei , Le Mi , Huichi Zhou

In recent years, Large Language Models (LLM) have emerged as pivotal tools in various applications. However, these models are susceptible to adversarial prompt attacks, where attackers can carefully curate input strings that mislead LLMs…

Computation and Language · Computer Science 2024-02-20 Zhengmian Hu , Gang Wu , Saayan Mitra , Ruiyi Zhang , Tong Sun , Heng Huang , Viswanathan Swaminathan

Research on adversarial robustness in language models is currently fragmented across applications and attacks, obscuring shared vulnerabilities. In this work, we propose unifying the study of adversarial robustness in text scoring models…

Computation and Language · Computer Science 2026-02-03 Manveer Singh Tamber , Hosna Oyarhoseini , Jimmy Lin

Adversarial vulnerability remains a major obstacle to constructing reliable NLP systems. When imperceptible perturbations are added to raw input text, the performance of a deep learning model may drop dramatically under attacks. Recent work…

Computation and Language · Computer Science 2022-10-28 Jiahao Zhao , Wenji Mao

Adversarial attacks are a type of attack on machine learning models where an attacker deliberately modifies the inputs to cause the model to make incorrect predictions. Adversarial attacks can have serious consequences, particularly in…

Machine Learning · Computer Science 2025-09-15 Prathyusha Devabhakthini , Sasmita Parida , Raj Mani Shukla , Suvendu Chandan Nayak , Tapadhir Das

Large language models (LLMs) have shown the capability to generate fluent and logical content, presenting significant challenges to machine-generated text detection, particularly text polished by adversarial perturbations such as…

Computation and Language · Computer Science 2025-09-24 Alva West , Luodan Zhang , Liuliu Zhang , Minjun Zhu , Yixuan Weng , Yue Zhang

As cyberattacks become increasingly sophisticated, advanced Network Intrusion Detection Systems (NIDS) are critical for modern network security. Traditional signature-based NIDS are inadequate against zero-day and evolving attacks. In…

Cryptography and Security · Computer Science 2025-02-24 Benyamin Tafreshian , Shengzhi Zhang

To combat adversarial spelling mistakes, we propose placing a word recognition model in front of the downstream classifier. Our word recognition models build upon the RNN semi-character architecture, introducing several new backoff…

Computation and Language · Computer Science 2019-08-30 Danish Pruthi , Bhuwan Dhingra , Zachary C. Lipton

Machine Learning systems are vulnerable to adversarial attacks and will highly likely produce incorrect outputs under these attacks. There are white-box and black-box attacks regarding to adversary's access level to the victim learning…

Machine Learning · Computer Science 2019-10-23 Saeid Samizade , Zheng-Hua Tan , Chao Shen , Xiaohong Guan

Despite their promising performance across various natural language processing (NLP) tasks, current NLP systems are vulnerable to textual adversarial attacks. To defend against these attacks, most existing methods apply adversarial training…

Computation and Language · Computer Science 2023-07-06 Junjie Wu , Dit-Yan Yeung

Large Language Models (LLMs) have achieved human-level fluency in text generation, making it difficult to distinguish between human-written and LLM-generated texts. This poses a growing risk of misuse of LLMs and demands the development of…

Computation and Language · Computer Science 2024-02-20 Ryuto Koike , Masahiro Kaneko , Naoaki Okazaki

In text classification, creating an adversarial example means subtly perturbing a few words in a sentence without changing its meaning, causing it to be misclassified by a classifier. A concerning observation is that a significant portion…

Computation and Language · Computer Science 2025-07-15 Lei Xu , Sarah Alnegheimish , Laure Berti-Equille , Alfredo Cuesta-Infante , Kalyan Veeramachaneni

Making classifiers robust to adversarial examples is hard. Thus, many defenses tackle the seemingly easier task of detecting perturbed inputs. We show a barrier towards this goal. We prove a general hardness reduction between detection and…

Machine Learning · Computer Science 2022-06-17 Florian Tramèr

While having achieved great success in rich real-life applications, deep neural network (DNN) models have long been criticized for their vulnerability to adversarial attacks. Tremendous research efforts have been dedicated to mitigating the…

Machine Learning · Computer Science 2023-04-17 Jingyuan Wang , Yufan Wu , Mingxuan Li , Xin Lin , Junjie Wu , Chao Li

Adversarial attacks pose a severe security threat to the state-of-the-art speaker identification systems, thereby making it vital to propose countermeasures against them. Building on our previous work that used representation learning to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-11 Sonal Joshi , Saurabh Kataria , Jesus Villalba , Najim Dehak

Machine learning has been successfully applied to complex network analysis in various areas, and graph neural networks (GNNs) based methods outperform others. Recently, adversarial attack on networks has attracted special attention since…

Social and Information Networks · Computer Science 2019-03-15 Jinyin Chen , Yangyang Wu , Xiang Lin , Qi Xuan

Recent years have witnessed unprecedented success achieved by deep learning models in the field of computer vision. However, their vulnerability towards carefully crafted adversarial examples has also attracted the increasing attention of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Jinyin Chen , Ruoxi Chen , Haibin Zheng , Zhaoyan Ming , Wenrong Jiang , Chen Cui

The new wave of adversarial attacks that utilize gradient-related vulnerabilities in neural network-based classifiers makes Network Intrusion Detection Systems more open to such threats. Although state-of-the-art adversarial training…

Cryptography and Security · Computer Science 2026-05-12 Hira Nasir , Eiman Javed , Balawal Shabir , Zunera Jalil , Ahmad Mohsin