English
Related papers

Related papers: TextBugger: Generating Adversarial Text Against Re…

200 papers

Nowadays, powerful large language models (LLMs) such as ChatGPT have demonstrated revolutionary power in a variety of tasks. Consequently, the detection of machine-generated texts (MGTs) is becoming increasingly crucial as LLMs become more…

Cryptography and Security · Computer Science 2024-01-17 Xinlei He , Xinyue Shen , Zeyuan Chen , Michael Backes , Yang Zhang

Backdoor attacks have become a major security threat for deploying machine learning models in security-critical applications. Existing research endeavors have proposed many defenses against backdoor attacks. Despite demonstrating certain…

Machine Learning · Computer Science 2023-11-28 Hengzhi Pei , Jinyuan Jia , Wenbo Guo , Bo Li , Dawn Song

As the AI systems become deeply embedded in social media platforms, we've uncovered a concerning security vulnerability that goes beyond traditional adversarial attacks. It becomes important to assess the risks of LLMs before the general…

Computation and Language · Computer Science 2025-05-30 Nilanjana Das , Edward Raff , Aman Chadha , Manas Gaur

Many word-level adversarial attack approaches for textual data have been proposed in recent studies. However, due to the massive search space consisting of combinations of candidate words, the existing approaches face the problem of…

Computation and Language · Computer Science 2022-11-15 Xingyi Zhao , Lu Zhang , Depeng Xu , Shuhan Yuan

Social media has drastically reshaped the world that allows billions of people to engage in such interactive environments to conveniently create and share content with the public. Among them, text data (e.g., tweets, blogs) maintains the…

Artificial Intelligence · Computer Science 2023-10-04 Xiaoting Li , Lingwei Chen , Dinghao Wu

Adversarial samples are strategically modified samples, which are crafted with the purpose of fooling a classifier at hand. An attacker introduces specially crafted adversarial samples to a deployed classifier, which are being…

Machine Learning · Computer Science 2017-07-11 Suranjana Samanta , Sameep Mehta

In this paper, we present an effective method to craft text adversarial samples, revealing one important yet underestimated fact that DNN-based text classifiers are also prone to adversarial sample attack. Specifically, confronted with…

Cryptography and Security · Computer Science 2019-01-08 Bin Liang , Hongcheng Li , Miaoqiang Su , Pan Bian , Xirong Li , Wenchang Shi

Textual adversarial attacks pose a serious security threat to Natural Language Processing (NLP) systems by introducing imperceptible perturbations that mislead deep learning models. While adversarial example detection offers a lightweight…

Computation and Language · Computer Science 2026-03-16 He Zhu , Yanshu Li , Wen Liu , Haitian Yang

It is known that neural networks are subject to attacks through adversarial perturbations, i.e., inputs which are maliciously crafted through perturbations to induce wrong predictions. Furthermore, such attacks are impossible to eliminate,…

Computation and Language · Computer Science 2022-01-10 Guoliang Dong , Jingyi Wang , Jun Sun , Sudipta Chattopadhyay , Xinyu Wang , Ting Dai , Jie Shi , Jin Song Dong

Large Language Models (LLMs) are increasingly vulnerable to adversarial attacks that can subtly manipulate their outputs. While various defense mechanisms have been proposed, many operate as black boxes, lacking transparency in their…

Cryptography and Security · Computer Science 2025-11-19 Shaowei Guan , Yu Zhai , Zhengyu Zhang , Yanze Wang , Hin Chi Kwok

In this paper, we present a novel algorithm, FastWordBug, to efficiently generate small text perturbations in a black-box setting that forces a sentiment analysis or text classification mode to make an incorrect prediction. By combining the…

Computation and Language · Computer Science 2020-02-04 Dou Goodman , Lv Zhonghou , Wang minghua

Adversarial attacks on machine learning algorithms have been a key deterrent to the adoption of AI in many real-world use cases. They significantly undermine the ability of high-performance neural networks by forcing misclassifications.…

Machine Learning · Computer Science 2024-04-04 Nandish Chattopadhyay , Atreya Goswami , Anupam Chattopadhyay

Natural Language Processing (NLP) models based on Machine Learning (ML) are susceptible to adversarial attacks -- malicious algorithms that imperceptibly modify input text to force models into making incorrect predictions. However,…

Computation and Language · Computer Science 2023-05-26 Salijona Dyrmishi , Salah Ghamizi , Maxime Cordy

Training robust deep learning models for down-stream tasks is a critical challenge. Research has shown that down-stream models can be easily fooled with adversarial inputs that look like the training data, but slightly perturbed, in a way…

Machine Learning · Computer Science 2021-01-19 Mahmoud Hossam , Trung Le , He Zhao , Dinh Phung

With the widespread use of deep learning system in many applications, the adversary has strong incentive to explore vulnerabilities of deep neural networks and manipulate them. Backdoor attacks against deep neural networks have been…

Cryptography and Security · Computer Science 2019-06-05 Jiazhu Dai , Chuanshuai Chen

Safety classifiers are critical in mitigating toxicity on online forums such as social media and in chatbots. Still, they continue to be vulnerable to emergent, and often innumerable, adversarial attacks. Traditional automated adversarial…

Computation and Language · Computer Science 2024-06-26 Yash Kumar Lal , Preethi Lahoti , Aradhana Sinha , Yao Qin , Ananth Balashankar

The increasing capabilities of Large Language Models (LLMs) have raised concerns about their misuse in AI-generated plagiarism and social engineering. While various AI-generated text detectors have been proposed to mitigate these risks,…

Computation and Language · Computer Science 2025-10-31 Yize Cheng , Vinu Sankar Sadasivan , Mehrdad Saberi , Shoumik Saha , Soheil Feizi

Adversarial attacks on Natural Language Processing (NLP) models expose vulnerabilities by introducing subtle perturbations to input text, often leading to misclassification while maintaining human readability. Existing methods typically…

Cryptography and Security · Computer Science 2025-06-12 Hetvi Waghela , Jaydip Sen , Sneha Rakshit , Subhasis Dasgupta

Cyber Threat Intelligence (CTI) has emerged as a vital complementary approach that operates in the early phases of the cyber threat lifecycle. CTI involves collecting, processing, and analyzing threat data to provide a more accurate and…

Cryptography and Security · Computer Science 2026-05-25 Samaneh Shafee , Alysson Bessani , Pedro M. Ferreira

Adversarial example generation has been a hot spot in recent years because it can cause deep neural networks (DNNs) to misclassify the generated adversarial examples, which reveals the vulnerability of DNNs, motivating us to find good…

Cryptography and Security · Computer Science 2023-03-06 Mingjie Li , Hanzhou Wu , Xinpeng Zhang