中文
相关论文

相关论文: Trojan Detection Through Pattern Recognition for L…

200 篇论文

Mainstream backdoor attacks on large language models (LLMs) typically set a fixed trigger in the input instance and specific responses for triggered queries. However, the fixed trigger setting (e.g., unusual words) may be easily detected by…

计算与语言 · 计算机科学 2025-01-09 Jiaming He , Wenbo Jiang , Guanyu Hou , Wenshu Fan , Rui Zhang , Hongwei Li

Backdoor attacks creating 'sleeper agents' in large language models (LLMs) pose significant safety risks. This study employs mechanistic interpretability to explore resulting internal structural differences. Comparing clean Qwen2.5-3B…

计算与语言 · 计算机科学 2025-08-25 Mohammed Abu Baker , Lakshmi Babu-Saheer

Time Series Classification (TSC) is highly vulnerable to backdoor attacks, posing significant security threats. Existing methods primarily focus on data poisoning during the training phase, designing sophisticated triggers to improve…

密码学与安全 · 计算机科学 2025-02-04 Chang Dong , Zechao Sun , Guangdong Bai , Shuying Piao , Weitong Chen , Wei Emma Zhang

Backdoor attacks embed malicious behaviors into Large Language Models (LLMs), enabling adversaries to trigger harmful outputs or bypass safety controls. However, the persistence of the implanted backdoors under user-driven post-deployment…

密码学与安全 · 计算机科学 2025-12-18 Jing Cui , Yufei Han , Jianbin Jiao , Junge Zhang

An emerging amount of intelligent applications have been developed with the surge of Machine Learning (ML). Deep Neural Networks (DNNs) have demonstrated unprecedented performance across various fields such as medical diagnosis and…

密码学与安全 · 计算机科学 2021-04-22 Xinqiao Zhang , Huili Chen , Farinaz Koushanfar

Trojan attack on deep neural networks, also known as backdoor attack, is a typical threat to artificial intelligence. A trojaned neural network behaves normally with clean inputs. However, if the input contains a particular trigger, the…

密码学与安全 · 计算机科学 2023-03-01 Chong Fu , Xuhong Zhang , Shouling Ji , Ting Wang , Peng Lin , Yanghe Feng , Jianwei Yin

Recent years have witnessed the emergence of a new paradigm of building natural language processing (NLP) systems: general-purpose, pre-trained language models (LMs) are composed with simple downstream models and fine-tuned for a variety of…

密码学与安全 · 计算机科学 2021-03-12 Xinyang Zhang , Zheng Zhang , Shouling Ji , Ting Wang

Backdoor attacks pose severe security threats to large language models (LLMs), where a model behaves normally under benign inputs but produces malicious outputs when a hidden trigger appears. Existing backdoor removal methods typically…

密码学与安全 · 计算机科学 2026-03-17 Jianwei Li , Jung-Eun Kim

Deep learning has come a long way and has enjoyed an unprecedented success. Despite high accuracy, however, deep models are brittle and are easily fooled by imperceptible adversarial perturbations. In contrast to common inference-time…

计算机视觉与模式识别 · 计算机科学 2020-05-14 Ali Borji

Deep neural networks are known to have security issues. One particular threat is the Trojan attack. It occurs when the attackers stealthily manipulate the model's behavior through Trojaned training samples, which can later be exploited.…

机器学习 · 计算机科学 2021-06-14 Songzhu Zheng , Yikai Zhang , Hubert Wagner , Mayank Goswami , Chao Chen

Large language models (LLMs) are increasingly deployed in settings where inducing a bias toward a certain topic can have significant consequences, and backdoor attacks can be used to produce such models. Prior work on backdoor attacks has…

密码学与安全 · 计算机科学 2026-02-17 Anudeep Das , Prach Chantasantitam , Gurjot Singh , Lipeng He , Mariia Ponomarenko , Florian Kerschbaum

This paper proposes MergeGuard, a novel methodology for mitigation of AI Trojan attacks. Trojan attacks on AI models cause inputs embedded with triggers to be misclassified to an adversary's target class, posing a significant threat to…

密码学与安全 · 计算机科学 2025-05-08 Soheil Zibakhsh Shabgahi , Yaman Jandali , Farinaz Koushanfar

Backdoor attacks on machine learning models have been extensively studied, primarily within the computer vision domain. Originally, these attacks manipulated classifiers to generate incorrect outputs in the presence of specific, often…

机器学习 · 计算机科学 2025-03-25 Sharon Lin , Krishnamurthy , Dvijotham , Jamie Hayes , Chongyang Shi , Ilia Shumailov , Shuang Song

Deep Learning (DL) has become a key technology that assists radio frequency (RF) signal classification applications, such as modulation classification. However, the DL models are vulnerable to adversarial machine learning threats, such as…

密码学与安全 · 计算机科学 2026-03-27 Younes Salmi , Hanna Bogucka

Deep neural networks have been shown to be vulnerable to backdoor, or trojan, attacks where an adversary has embedded a trigger in the network at training time such that the model correctly classifies all standard inputs, but generates a…

机器学习 · 计算机科学 2021-09-08 Greg Fields , Mohammad Samragh , Mojan Javaheripi , Farinaz Koushanfar , Tara Javidi

Large language models play a crucial role in modern natural language processing technologies. However, their extensive use also introduces potential security risks, such as the possibility of black-box attacks. These attacks can embed…

计算与语言 · 计算机科学 2025-02-25 Daniil Khomsky , Narek Maloyan , Bulat Nutfullin

In Natural Language Processing (NLP), intelligent neuron models can be susceptible to textual Trojan attacks. Such attacks occur when Trojan models behave normally for standard inputs but generate malicious output for inputs that contain a…

计算与语言 · 计算机科学 2023-08-23 Qian Lou , Yepeng Liu , Bo Feng

Recent work has identified that classification models implemented as neural networks are vulnerable to data-poisoning and Trojan attacks at training time. In this work, we show that these training-time vulnerabilities extend to deep…

密码学与安全 · 计算机科学 2019-03-18 Panagiota Kiourti , Kacper Wardega , Susmit Jha , Wenchao Li

Existing Hardware Trojans (HT) detection methods face several critical limitations: logic testing struggles with scalability and coverage for large designs, side-channel analysis requires golden reference chips, and formal verification…

密码学与安全 · 计算机科学 2024-12-11 Md Omar Faruque , Peter Jamieson , Ahmad Patooghy , Abdel-Hameed A. Badawy