English
Related papers

Related papers: DISTIL: Data-Free Inversion of Suspicious Trojan I…

200 papers

While effective backdoor detection and inversion schemes have been developed for AIs used e.g. for images, there are challenges in "porting" these methods to LLMs. First, the LLM input space is discrete, which precludes gradient-based…

Machine Learning · Computer Science 2025-09-22 Zhengxing Li , Guangmingmei Yang , Jayaram Raghuram , David J. Miller , George Kesidis

Backdoor attacks have been shown to be a serious security threat against deep learning models, and detecting whether a given model has been backdoored becomes a crucial task. Existing defenses are mainly built upon the observation that the…

Cryptography and Security · Computer Science 2022-08-16 Tong Wang , Yuan Yao , Feng Xu , Miao Xu , Shengwei An , Ting Wang

Deep neural networks (DNNs) have been proven vulnerable to backdoor attacks, where hidden features (patterns) trained to a normal model, which is only activated by some specific input (called triggers), trick the model into producing…

Cryptography and Security · Computer Science 2020-09-01 Shaofeng Li , Minhui Xue , Benjamin Zi Hao Zhao , Haojin Zhu , Xinpeng Zhang

Backdoor attacks embed hidden functionalities in deep neural networks (DNN), triggering malicious behavior with specific inputs. Advanced defenses monitor anomalous DNN inferences to detect such attacks. However, concealed backdoors evade…

Cryptography and Security · Computer Science 2025-02-18 Manaar Alam , Hithem Lamri , Michail Maniatakos

Deep neural networks (DNNs) have achieved tremendous success in various applications including video action recognition, yet remain vulnerable to backdoor attacks (Trojans). The backdoor-compromised model will mis-classify to the target…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Xi Li , Songhe Wang , Ruiquan Huang , Mahanth Gowda , George Kesidis

Deep learning models have consistently outperformed traditional machine learning models in various classification tasks, including image classification. As such, they have become increasingly prevalent in many real world applications…

Cryptography and Security · Computer Science 2018-08-31 Cong Liao , Haoti Zhong , Anna Squicciarini , Sencun Zhu , David Miller

Diffusion models have emerged as state-of-the-art generative frameworks, excelling in producing high-quality multi-modal samples. However, recent studies have revealed their vulnerability to backdoor attacks, where backdoored models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Vu Tuan Truong , Long Bao Le

Deep neural networks (DNNs) are vulnerable to backdoor attack, which does not affect the network's performance on clean data but would manipulate the network behavior once a trigger pattern is added. Existing defense methods have greatly…

Machine Learning · Computer Science 2025-04-08 Min Liu , Alberto Sangiovanni-Vincentelli , Xiangyu Yue

Although text-to-image diffusion models exhibit remarkable generative power, concept erasure techniques are essential for their safe deployment to prevent the creation of harmful content. This has fostered a dynamic interplay between the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Qianlong Xiang , Miao Zhang , Haoyu Zhang , Kun Wang , Junhui Hou , Liqiang Nie

We propose CLEANN, the first end-to-end framework that enables online mitigation of Trojans for embedded Deep Neural Network (DNN) applications. A Trojan attack works by injecting a backdoor in the DNN while training; during inference, the…

Machine Learning · Computer Science 2020-09-08 Mojan Javaheripi , Mohammad Samragh , Gregory Fields , Tara Javidi , Farinaz Koushanfar

Diffusion models (DM) have become state-of-the-art generative models because of their capability to generate high-quality images from noises without adversarial training. However, they are vulnerable to backdoor attacks as reported by…

Cryptography and Security · Computer Science 2024-02-06 Shengwei An , Sheng-Yen Chou , Kaiyuan Zhang , Qiuling Xu , Guanhong Tao , Guangyu Shen , Siyuan Cheng , Shiqing Ma , Pin-Yu Chen , Tsung-Yi Ho , Xiangyu Zhang

Backdoor attacks on deep learning represent a recent threat that has gained significant attention in the research community. Backdoor defenses are mainly based on backdoor inversion, which has been shown to be generic, model-agnostic, and…

Machine Learning · Computer Science 2024-11-11 Xiaoyun Xu , Zhuoran Liu , Stefanos Koffas , Shujian Yu , Stjepan Picek

Deep neural network (DNN) classifiers are vulnerable to backdoor attacks. An adversary poisons some of the training data in such attacks by installing a trigger. The goal is to make the trained DNN output the attacker's desired class…

Machine Learning · Computer Science 2022-10-14 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Machine learning models are increasingly present in our everyday lives; as a result, they become targets of adversarial attackers seeking to manipulate the systems we interact with. A well-known vulnerability is a backdoor introduced into a…

Machine Learning · Computer Science 2026-02-12 Enrico Ahlers , Daniel Passon , Yannic Noller , Lars Grunske

Many backdoor removal techniques in machine learning models require clean in-distribution data, which may not always be available due to proprietary datasets. Model inversion techniques, often considered privacy threats, can reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Si Chen , Yi Zeng , Jiachen T. Wang , Won Park , Xun Chen , Lingjuan Lyu , Zhuoqing Mao , Ruoxi Jia

Scanning for trojan (backdoor) in deep neural networks is crucial due to their significant real-world applications. There has been an increasing focus on developing effective general trojan scanning methods across various trojan attacks.…

Deep neural networks (DNNs) are known vulnerable to backdoor attacks, a training time attack that injects a trigger pattern into a small proportion of training data so as to control the model's prediction at the test time. Backdoor attacks…

Machine Learning · Computer Science 2021-01-28 Yige Li , Xixiang Lyu , Nodens Koren , Lingjuan Lyu , Bo Li , Xingjun Ma

Recent researches show that deep learning model is susceptible to backdoor attacks. Many defenses against backdoor attacks have been proposed. However, existing defense works require high computational overhead or backdoor attack…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Mingfu Xue , Yinghao Wu , Zhiyu Wu , Yushu Zhang , Jian Wang , Weiqiang Liu

Machine learning (ML) models that use deep neural networks are vulnerable to backdoor attacks. Such attacks involve the insertion of a (hidden) trigger by an adversary. As a consequence, any input that contains the trigger will cause the…

Cryptography and Security · Computer Science 2022-03-30 Arezoo Rajabi , Bhaskar Ramasubramanian , Radha Poovendran

Backdoor data poisoning is an emerging form of adversarial attack usually against deep neural network image classifiers. The attacker poisons the training set with a relatively small set of images from one (or several) source class(es),…

Machine Learning · Computer Science 2020-10-16 Zhen Xiang , David J. Miller , George Kesidis