English
Related papers

Related papers: ONION: A Simple and Effective Defense Against Text…

200 papers

Adversarial purification is a successful defense mechanism against adversarial attacks without requiring knowledge of the form of the incoming attack. Generally, adversarial purification aims to remove the adversarial perturbations…

Computation and Language · Computer Science 2023-05-04 Linyang Li , Demin Song , Xipeng Qiu

Large Language Models (LLMs), despite their impressive capabilities across domains, have been shown to be vulnerable to backdoor attacks. Prior backdoor strategies predominantly operate at the token level, where an injected trigger causes…

Cryptography and Security · Computer Science 2026-04-17 Vu Tuan Truong , Long Bao Le

Backdoor attacks embed hidden malicious behaviors into deep learning models, which only activate and cause misclassifications on model inputs containing a specific trigger. Existing works on backdoor attacks and defenses, however, mostly…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Emily Wenger , Josephine Passananti , Arjun Bhagoji , Yuanshun Yao , Haitao Zheng , Ben Y. Zhao

Multimodal contrastive learning uses various data modalities to create high-quality features, but its reliance on extensive data sources on the Internet makes it vulnerable to backdoor attacks. These attacks insert malicious behaviors…

Cryptography and Security · Computer Science 2024-10-01 Kuanrong Liu , Siyuan Liang , Jiawei Liang , Pengwen Dai , Xiaochun Cao

Backdoor attack introduces artificial vulnerabilities into the model by poisoning a subset of the training data via injecting triggers and modifying labels. Various trigger design strategies have been explored to attack text classifiers,…

Computation and Language · Computer Science 2021-09-23 Zichao Li , Dheeraj Mekala , Chengyu Dong , Jingbo Shang

Text-to-visualization (text-to-vis) models for tabular data have become essential tools in the era of big data, enabling users to generate visualizations and make data-driven decisions through natural language queries (NLQs). Despite their…

Cryptography and Security · Computer Science 2026-03-11 Shuaimin Li , Chen Jason Zhang , Xuanang Chen , Anni Peng , Zhuoyue Wan , Yuanfeng Song , Shiwen Ni , Min Yang , Fei Hao , Raymond Chi-Wing Wong

Adversarial attacks pose significant challenges to deep neural networks (DNNs) such as Transformer models in natural language processing (NLP). This paper introduces a novel defense strategy, called GenFighter, which enhances adversarial…

Machine Learning · Computer Science 2024-04-18 Md Athikul Islam , Edoardo Serra , Sushil Jajodia

Trojan attack on deep neural networks, also known as backdoor attack, is a typical threat to artificial intelligence. A trojaned neural network behaves normally with clean inputs. However, if the input contains a particular trigger, the…

Cryptography and Security · Computer Science 2023-03-01 Chong Fu , Xuhong Zhang , Shouling Ji , Ting Wang , Peng Lin , Yanghe Feng , Jianwei Yin

Deep neural networks (DNNs) are known to be vulnerable to both backdoor attacks as well as adversarial attacks. In the literature, these two types of attacks are commonly treated as distinct problems and solved separately, since they belong…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Bingxu Mu , Zhenxing Niu , Le Wang , Xue Wang , Rong Jin , Gang Hua

Adversarial attacking aims to fool deep neural networks with adversarial examples. In the field of natural language processing, various textual adversarial attack models have been proposed, varying in the accessibility to the victim model.…

Computation and Language · Computer Science 2020-09-22 Yuan Zang , Bairu Hou , Fanchao Qi , Zhiyuan Liu , Xiaojun Meng , Maosong Sun

Deep neural networks (DNN) are known to be vulnerable to adversarial attacks. Numerous efforts either try to patch weaknesses in trained models, or try to make it difficult or costly to compute adversarial examples that exploit them. In our…

Machine Learning · Computer Science 2020-12-01 Shawn Shan , Emily Wenger , Bolun Wang , Bo Li , Haitao Zheng , Ben Y. Zhao

Deep Neural Networks (DNNs) have become a powerful toolfor a wide range of problems. Yet recent work has found an increasing variety of adversarial samplesthat can fool them. Most existing detection mechanisms against adversarial…

Machine Learning · Computer Science 2019-11-22 Ilia Shumailov , Yiren Zhao , Robert Mullins , Ross Anderson

A security threat to deep neural networks (DNN) is backdoor contamination, in which an adversary poisons the training data of a target model to inject a Trojan so that images carrying a specific trigger will always be classified into a…

Cryptography and Security · Computer Science 2020-12-11 Di Tang , XiaoFeng Wang , Haixu Tang , Kehuan Zhang

Transfer learning provides an effective solution for feasibly and fast customize accurate \textit{Student} models, by transferring the learned knowledge of pre-trained \textit{Teacher} models over large datasets via fine-tuning. Many…

Machine Learning · Computer Science 2020-08-11 Shuo Wang , Surya Nepal , Carsten Rudolph , Marthie Grobler , Shangyu Chen , Tianle Chen

In recent years, there has been an explosive growth in multimodal learning. Image captioning, a classical multimodal task, has demonstrated promising applications and attracted extensive research attention. However, recent studies have…

Cryptography and Security · Computer Science 2024-06-11 Wenshu Fan , Hongwei Li , Wenbo Jiang , Meng Hao , Shui Yu , Xiao Zhang

With the burgeoning advancements in the field of natural language processing (NLP), the demand for training data has increased significantly. To save costs, it has become common for users and businesses to outsource the labor-intensive task…

Computation and Language · Computer Science 2024-08-22 Ziqiang Li , Yueqi Zeng , Pengfei Xia , Lei Liu , Zhangjie Fu , Bin Li

Recent studies have widely investigated backdoor attacks on Large Language Models (LLMs) by inserting harmful question-answer (QA) pairs into their training data. However, we revisit existing attacks and identify two critical limitations:…

Computation and Language · Computer Science 2025-10-07 Jiawei Kong , Hao Fang , Xiaochen Yang , Kuofeng Gao , Bin Chen , Shu-Tao Xia , Ke Xu , Han Qiu

Recently backdoor attack has become an emerging threat to the security of deep neural network (DNN) models. To date, most of the existing studies focus on backdoor attack against the uncompressed model; while the vulnerability of compressed…

Cryptography and Security · Computer Science 2022-08-24 Huy Phan , Cong Shi , Yi Xie , Tianfang Zhang , Zhuohang Li , Tianming Zhao , Jian Liu , Yan Wang , Yingying Chen , Bo Yuan

Deep neural networks (DNN), despite their remarkable performance, are highly vulnerable to backdoor attacks. Existing defenses mainly rely on activation anomaly analysis or trigger reverse engineering and often require clean samples or…

Cryptography and Security · Computer Science 2026-05-20 Yinbo Yu , Jing Fang , Xuewen Zhang , Chunwei Tian , Qi Zhu , Daoqiang Zhang , Jiajia Liu

Machine learning algorithms are often vulnerable to adversarial examples that have imperceptible alterations from the original counterparts but can fool the state-of-the-art models. It is helpful to evaluate or even improve the robustness…

Computation and Language · Computer Science 2020-04-10 Di Jin , Zhijing Jin , Joey Tianyi Zhou , Peter Szolovits