English
Related papers

Related papers: Detecting Backdoors During the Inference Stage Bas…

200 papers

In recent years, neural backdoor attack has been considered to be a potential security threat to deep learning systems. Such systems, while achieving the state-of-the-art performance on clean data, perform abnormally on inputs with…

Cryptography and Security · Computer Science 2020-10-19 Anh Nguyen , Anh Tran

Process attestation systems verify that a continuous physical process, such as human authorship, actually occurred, rather than merely checking system state. These systems face a fundamental dependability challenge: the evidence collection…

Cryptography and Security · Computer Science 2026-05-26 David Condrey

Recently, adversarial deception becomes one of the most considerable threats to deep neural networks. However, compared to extensive research in new designs of various adversarial attacks and defenses, the neural networks' intrinsic…

Machine Learning · Computer Science 2019-05-13 Fuxun Yu , Zhuwei Qin , Chenchen Liu , Liang Zhao , Yanzhi Wang , Xiang Chen

Backdoor attack introduces artificial vulnerabilities into the model by poisoning a subset of the training data via injecting triggers and modifying labels. Various trigger design strategies have been explored to attack text classifiers,…

Computation and Language · Computer Science 2021-09-23 Zichao Li , Dheeraj Mekala , Chengyu Dong , Jingbo Shang

Recently backdoor attack has become an emerging threat to the security of deep neural network (DNN) models. To date, most of the existing studies focus on backdoor attack against the uncompressed model; while the vulnerability of compressed…

Cryptography and Security · Computer Science 2022-08-24 Huy Phan , Cong Shi , Yi Xie , Tianfang Zhang , Zhuohang Li , Tianming Zhao , Jian Liu , Yan Wang , Yingying Chen , Bo Yuan

Pervasive backdoors are triggered by dynamic and pervasive input perturbations. They can be intentionally injected by attackers or naturally exist in normally trained models. They have a different nature from the traditional static and…

Cryptography and Security · Computer Science 2022-06-22 Guanhong Tao , Yingqi Liu , Siyuan Cheng , Shengwei An , Zhuo Zhang , Qiuling Xu , Guangyu Shen , Xiangyu Zhang

Deep neural networks (DNNs) are vulnerable to backdoor attack, which does not affect the network's performance on clean data but would manipulate the network behavior once a trigger pattern is added. Existing defense methods have greatly…

Machine Learning · Computer Science 2025-04-08 Min Liu , Alberto Sangiovanni-Vincentelli , Xiangyu Yue

Deep neural network (DNN) classifiers are vulnerable to backdoor attacks. An adversary poisons some of the training data in such attacks by installing a trigger. The goal is to make the trained DNN output the attacker's desired class…

Machine Learning · Computer Science 2022-10-14 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Trojan attack on deep neural networks, also known as backdoor attack, is a typical threat to artificial intelligence. A trojaned neural network behaves normally with clean inputs. However, if the input contains a particular trigger, the…

Cryptography and Security · Computer Science 2023-03-01 Chong Fu , Xuhong Zhang , Shouling Ji , Ting Wang , Peng Lin , Yanghe Feng , Jianwei Yin

In recent years, there has been significant attention given to the robustness assessment of neural networks. Robustness plays a critical role in ensuring reliable operation of artificial intelligence (AI) systems in complex and uncertain…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Jie Wang , Jun Ai , Minyan Lu , Haoran Su , Dan Yu , Yutao Zhang , Junda Zhu , Jingyu Liu

Toxic content detection aims to identify content that can offend or harm its recipients. Automated classifiers of toxic content need to be robust against adversaries who deliberately try to bypass filters. We propose a method of generating…

Computation and Language · Computer Science 2019-12-17 Keita Kurita , Anna Belova , Antonios Anastasopoulos

Deep anomaly detection on sequential data has garnered significant attention due to the wide application scenarios. However, deep learning-based models face a critical security threat - their vulnerability to backdoor attacks. In this…

Machine Learning · Computer Science 2024-02-19 He Cheng , Shuhan Yuan

Deep neural networks are vulnerable to backdoor attacks. Among the existing backdoor defense methods, trigger reverse engineering based approaches, which reconstruct the backdoor triggers via optimizations, are the most versatile and…

Cryptography and Security · Computer Science 2024-04-22 Beichen Li , Yuanfang Guo , Heqi Peng , Yangxi Li , Yunhong Wang

Stealthy data poisoning during fine-tuning can backdoor large language models (LLMs), threatening downstream safety. Existing detectors either use classifier-style probability signals--ill-suited to generation--or rely on rewriting, which…

Computation and Language · Computer Science 2025-11-13 Jinwen Chen , Hainan Zhang , Fei Sun , Qinnan Zhang , Sijia Wen , Ziwei Wang , Zhiming Zheng

The growing cybersecurity threats make it essential to use high-quality data to train Machine Learning (ML) models for network traffic analysis, without noisy or missing data. By selecting the most relevant features for cyber-attack…

Cryptography and Security · Computer Science 2024-07-09 João Vitorino , Miguel Silva , Eva Maia , Isabel Praça

Despite excellent performance on many tasks, NLP systems are easily fooled by small adversarial perturbations of inputs. Existing procedures to defend against such perturbations are either (i) heuristic in nature and susceptible to stronger…

Computation and Language · Computer Science 2020-05-05 Erik Jones , Robin Jia , Aditi Raghunathan , Percy Liang

Extensive evidence has demonstrated that deep neural networks (DNNs) are vulnerable to backdoor attacks, which motivates the development of backdoor attacks detection. Most detection methods are designed to verify whether a model is…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Yuhang Wang , Huafeng Shi , Rui Min , Ruijia Wu , Siyuan Liang , Yichao Wu , Ding Liang , Aishan Liu

In this work, we investigate the concept of biometric backdoors: a template poisoning attack on biometric systems that allows adversaries to stealthily and effortlessly impersonate users in the long-term by exploiting the template update…

Cryptography and Security · Computer Science 2020-11-06 Giulio Lovisotto , Simon Eberz , Ivan Martinovic

Deep neural networks (DNNs) have shown unprecedented success in object detection tasks. However, it was also discovered that DNNs are vulnerable to multiple kinds of attacks, including Backdoor Attacks. Through the attack, the attacker…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Yize Cheng , Wenbin Hu , Minhao Cheng

Neural networks can conceal malicious Trojan backdoors that allow a trigger to covertly change the model behavior. Detecting signs of these backdoors, particularly without access to any triggered data, is the subject of ongoing research and…

Machine Learning · Computer Science 2024-11-07 Todd Huster , Peter Lin , Razvan Stefanescu , Emmanuel Ekwedike , Ritu Chadha