中文
相关论文

相关论文: Attack On Prompt: Backdoor Attack in Prompt-Based …

200 篇论文

Neural networks are often trained on proprietary datasets, making them attractive attack targets. We present a novel dataset extraction method leveraging an innovative training time backdoor attack, allowing a malicious federated learning…

密码学与安全 · 计算机科学 2025-12-19 Eden Luzon , Guy Amit , Roy Weiss , Torsten Kraub , Alexandra Dmitrienko , Yisroel Mirsky

Recent studies have pointed out that natural language processing (NLP) models are vulnerable to backdoor attacks. A backdoored model produces normal outputs on the clean samples while performing improperly on the texts with triggers that…

计算与语言 · 计算机科学 2023-12-27 Xuan Sheng , Zhicheng Li , Zhaoyang Han , Xiangmao Chang , Piji Li

Medical foundation models are gaining prominence in the medical community for their ability to derive general representations from extensive collections of medical image-text pairs. Recent research indicates that these models are…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Asif Hanif , Fahad Shamshad , Muhammad Awais , Muzammal Naseer , Fahad Shahbaz Khan , Karthik Nandakumar , Salman Khan , Rao Muhammad Anwer

Malicious agents in collaborative learning and outsourced data collection threaten the training of clean models. Backdoor attacks, where an attacker poisons a model during training to successfully achieve targeted misclassification, are a…

机器学习 · 计算机科学 2022-01-31 Siddhartha Datta , Nigel Shadbolt

In the era of increasing concerns over cybersecurity threats, defending against backdoor attacks is paramount in ensuring the integrity and reliability of machine learning models. However, many existing approaches require substantial…

机器学习 · 计算机科学 2024-05-08 Kealan Dunnett , Reza Arablouei , Dimity Miller , Volkan Dedeoglu , Raja Jurdak

3D deep learning has been increasingly more popular for a variety of tasks including many safety-critical applications. However, recently several works raise the security issues of 3D deep models. Although most of them consider adversarial…

机器学习 · 计算机科学 2025-05-09 Xinke Li , Zhirui Chen , Yue Zhao , Zekun Tong , Yabang Zhao , Andrew Lim , Joey Tianyi Zhou

The increasing demand for customized Large Language Models (LLMs) has led to the development of solutions like GPTs. These solutions facilitate tailored LLM creation via natural language prompts without coding. However, the trustworthiness…

密码学与安全 · 计算机科学 2024-05-29 Rui Zhang , Hongwei Li , Rui Wen , Wenbo Jiang , Yuan Zhang , Michael Backes , Yun Shen , Yang Zhang

Contrastive Vision-Language Pre-training, known as CLIP, has shown promising effectiveness in addressing downstream image recognition tasks. However, recent works revealed that the CLIP model can be implanted with a downstream-oriented…

计算机视觉与模式识别 · 计算机科学 2024-03-25 Jiawang Bai , Kuofeng Gao , Shaobo Min , Shu-Tao Xia , Zhifeng Li , Wei Liu

While pre-trained Vision-Language Models (VLMs) such as CLIP exhibit impressive representational capabilities for multimodal data, recent studies have revealed their vulnerability to backdoor attacks. To alleviate the threat, existing…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Jiawei Kong , Hao Fang , Sihang Guo , Chenxi Qing , Kuofeng Gao , Bin Chen , Shu-Tao Xia , Ke Xu

Over the past few years, the emergence of backdoor attacks has presented significant challenges to deep learning systems, allowing attackers to insert backdoors into neural networks. When data with a trigger is processed by a backdoor…

密码学与安全 · 计算机科学 2025-03-07 Haiyang Yu , Tian Xie , Jiaping Gui , Pengyang Wang , Ping Yi , Yue Wu

Federated Prompt Learning has emerged as a communication-efficient and privacy-preserving paradigm for adapting large vision-language models like CLIP across decentralized clients. However, the security implications of this setup remain…

密码学与安全 · 计算机科学 2026-01-28 Momin Ahmad Khan , Yasra Chandio , Fatima Muhammad Anwar

Federated learning has seen increased adoption in recent years in response to the growing regulatory demand for data privacy. However, the opaque local training process of federated learning also sparks rising concerns about model…

人工智能 · 计算机科学 2023-08-24 Yuxi Mi , Yiheng Sun , Jihong Guan , Shuigeng Zhou

We investigate security concerns of the emergent instruction tuning paradigm, that models are trained on crowdsourced datasets with task instructions to achieve superior performance. Our studies demonstrate that an attacker can inject…

计算与语言 · 计算机科学 2024-04-04 Jiashu Xu , Mingyu Derek Ma , Fei Wang , Chaowei Xiao , Muhao Chen

Backdoor attacks embed hidden malicious behaviors into deep learning models, which only activate and cause misclassifications on model inputs containing a specific trigger. Existing works on backdoor attacks and defenses, however, mostly…

计算机视觉与模式识别 · 计算机科学 2021-09-08 Emily Wenger , Josephine Passananti , Arjun Bhagoji , Yuanshun Yao , Haitao Zheng , Ben Y. Zhao

Recent research highlights concerns about the trustworthiness of third-party Pre-Trained Language Models (PTLMs) due to potential backdoor attacks. These backdoored PTLMs, however, are effective only for specific pre-defined downstream…

密码学与安全 · 计算机科学 2025-05-20 Rui Zhang , Yun Shen , Hongwei Li , Wenbo Jiang , Hanxiao Chen , Yuan Zhang , Guowen Xu , Yang Zhang

DNNs' demand for massive data forces practitioners to collect data from the Internet without careful check due to the unacceptable cost, which brings potential risks of backdoor attacks. A backdoored model always predicts a target class in…

机器学习 · 计算机科学 2022-02-23 Yinghua Gao , Dongxian Wu , Jingfeng Zhang , Guanhao Gan , Shu-Tao Xia , Gang Niu , Masashi Sugiyama

Backdoor attacks have become an emerging threat to NLP systems. By providing poisoned training data, the adversary can embed a "backdoor" into the victim model, which allows input instances satisfying certain textual patterns (e.g.,…

计算与语言 · 计算机科学 2023-05-30 Jun Yan , Vansh Gupta , Xiang Ren

Recent deep neural networks (DNNs) have came to rely on vast amounts of training data, providing an opportunity for malicious attackers to exploit and contaminate the data to carry out backdoor attacks. However, existing backdoor attack…

密码学与安全 · 计算机科学 2024-04-22 Ziqiang Li , Hong Sun , Pengfei Xia , Heng Li , Beihao Xia , Yi Wu , Bin Li

Recent studies have shown that cooperative multi-agent deep reinforcement learning (c-MADRL) is under the threat of backdoor attacks. Once a backdoor trigger is observed, it will perform abnormal actions leading to failures or malicious…

人工智能 · 计算机科学 2024-09-13 Yinbo Yu , Saihao Yan , Jiajia Liu

Backdoor attacks pose a significant threat to the integrity and reliability of Artificial Intelligence (AI) models, enabling adversaries to manipulate model behavior by injecting poisoned data with hidden triggers. These attacks can lead to…

机器学习 · 计算机科学 2026-03-31 Osama Wehbi , Sarhad Arisdakessian , Omar Abdel Wahab , Azzam Mourad , Hadi Otrok , Jamal Bentahar