English
Related papers

Related papers: TrojanDec: Data-free Detection of Trojan Inputs in…

200 papers

Trojan backdoors can be injected into large language models at various stages, including pretraining, fine-tuning, and in-context learning, posing a significant threat to the model's alignment. Due to the nature of causal language modeling,…

Computation and Language · Computer Science 2025-01-22 Vedant Bhasin , Matthew Yudin , Razvan Stefanescu , Rauf Izmailov

Cyber-physical systems rely on sensors, communication, and computing, all powered by integrated circuits (ICs). ICs are largely susceptible to various hardware attacks with malicious intents. One of the stealthiest threats is the insertion…

Cryptography and Security · Computer Science 2024-11-20 Sefatun-Noor Puspa , Abyad Enan , Reek Majumdar , M Sabbir Salek , Gurcan Comert , Mashrur Chowdhury

Machine learning (ML) models that use deep neural networks are vulnerable to backdoor attacks. Such attacks involve the insertion of a (hidden) trigger by an adversary. As a consequence, any input that contains the trigger will cause the…

Cryptography and Security · Computer Science 2022-03-30 Arezoo Rajabi , Bhaskar Ramasubramanian , Radha Poovendran

Backdoor attack introduces artificial vulnerabilities into the model by poisoning a subset of the training data via injecting triggers and modifying labels. Various trigger design strategies have been explored to attack text classifiers,…

Computation and Language · Computer Science 2021-09-23 Zichao Li , Dheeraj Mekala , Chengyu Dong , Jingbo Shang

Along with the success of deep neural network (DNN) models, rise the threats to the integrity of these models. A recent threat is the Trojan attack where an attacker interferes with the training pipeline by inserting triggers into some of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Marzieh Edraki , Nazmul Karim , Nazanin Rahnavard , Ajmal Mian , Mubarak Shah

Contrastive learning pre-trains an image encoder using a large amount of unlabeled data such that the image encoder can be used as a general-purpose feature extractor for various downstream tasks. In this work, we propose PoisonedEncoder, a…

Cryptography and Security · Computer Science 2023-01-04 Hongbin Liu , Jinyuan Jia , Neil Zhenqiang Gong

Hardware Trojans (HTs) threaten the trust and reliability of integrated circuits (ICs), particularly when triggered HTs remain dormant during standard testing and activate only under rare conditions. Existing electromagnetic (EM)…

Cryptography and Security · Computer Science 2026-02-04 Mahsa Tahghigh , Hassan Salmani

Trojan attacks threaten deep neural networks (DNNs) by poisoning them to behave normally on most samples, yet to produce manipulated results for inputs attached with a particular trigger. Several works attempt to detect whether a given DNN…

Machine Learning · Computer Science 2022-05-25 Tianlong Chen , Zhenyu Zhang , Yihua Zhang , Shiyu Chang , Sijia Liu , Zhangyang Wang

Classifiers in supervised learning have various security and privacy issues, e.g., 1) data poisoning attacks, backdoor attacks, and adversarial examples on the security side as well as 2) inference attacks and the right to be forgotten for…

Cryptography and Security · Computer Science 2022-12-08 Hongbin Liu , Wenjie Qu , Jinyuan Jia , Neil Zhenqiang Gong

In this work, we show how to jointly exploit adversarial perturbation and model poisoning vulnerabilities to practically launch a new stealthy attack, dubbed AdvTrojan. AdvTrojan is stealthy because it can be activated only when: 1) a…

Cryptography and Security · Computer Science 2021-09-06 Guanxiong Liu , Issa Khalil , Abdallah Khreishah , NhatHai Phan

Current Hardware Trojan (HT) detection techniques are mostly developed based on a limited set of HT benchmarks. Existing HT benchmark circuits are generated with multiple shortcomings, i.e., i) they are heavily biased by the designers'…

Cryptography and Security · Computer Science 2024-03-22 Amin Sarihi , Ahmad Patooghy , Peter Jamieson , Abdel-Hameed A. Badawy

In Natural Language Processing (NLP), intelligent neuron models can be susceptible to textual Trojan attacks. Such attacks occur when Trojan models behave normally for standard inputs but generate malicious output for inputs that contain a…

Computation and Language · Computer Science 2023-08-23 Qian Lou , Yepeng Liu , Bo Feng

In machine learning Trojan attacks, an adversary trains a corrupted model that obtains good performance on normal data but behaves maliciously on data samples with certain trigger patterns. Several approaches have been proposed to detect…

Artificial Intelligence · Computer Science 2020-10-02 Xiaojun Xu , Qi Wang , Huichen Li , Nikita Borisov , Carl A. Gunter , Bo Li

Hardware Trojans (HTs) have drawn more and more attention in both academia and industry because of its significant potential threat. In this paper, we proposed a novel HT detection method using information entropy based clustering, named…

Information Theory · Computer Science 2019-06-18 Renjie Lu , Haihua Shen , Feng Zhang , Huawei Li , Wei Zhao , Xiaowei Li

To gather a significant quantity of annotated training data for high-performance image classification models, numerous companies opt to enlist third-party providers to label their unlabeled data. This practice is widely regarded as secure,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Dazhong Rong , Guoyao Yu , Shuheng Shen , Xinyi Fu , Peng Qian , Jianhai Chen , Qinming He , Xing Fu , Weiqiang Wang

Deep Neural Networks (DNNs) have been shown to be susceptible to Trojan attacks. Neural Trojan is a type of targeted poisoning attack that embeds the backdoor into the victim and is activated by the trigger in the input space. The…

Machine Learning · Computer Science 2022-08-11 Diego Garcia-soto , Huili Chen , Farinaz Koushanfar

Backdoors pose a serious threat to machine learning, as they can compromise the integrity of security-critical systems, such as self-driving cars. While different defenses have been proposed to address this threat, they all rely on the…

Cryptography and Security · Computer Science 2025-02-04 Alexander Warnecke , Julian Speith , Jan-Niklas Möller , Konrad Rieck , Christof Paar

Wild images on the web are vulnerable to backdoor (also called trojan) poisoning, causing machine learning models learned on these images to be injected with backdoors. Most previous attacks assumed that the wild images are labeled. In…

Computers and Society · Computer Science 2023-01-03 Le Feng , Zhenxing Qian , Sheng Li , Xinpeng Zhang

Backdoor attacks are an important type of adversarial threat against deep neural network classifiers, wherein test samples from one or more source classes will be (mis)classified to the attacker's target class when a backdoor pattern is…

Machine Learning · Computer Science 2023-08-08 Hang Wang , Zhen Xiang , David J. Miller , George Kesidis

Large language models (LLMs) are becoming an integrated part of software development. These models are trained on large datasets for code, where it is hard to verify each data point. Therefore, a potential attack surface can be to inject…

Software Engineering · Computer Science 2023-12-12 Aftab Hussain , Md Rafiqul Islam Rabin , Toufique Ahmed , Mohammad Amin Alipour , Bowen Xu