中文
相关论文

相关论文: Poison Once, Control Anywhere: Clean-Text Visual B…

200 篇论文

Fine-tuned Large Language Models (LLMs) are vulnerable to backdoor attacks through data poisoning, yet the internal mechanisms governing these attacks remain a black box. Previous research on interpretability for LLM safety tends to focus…

密码学与安全 · 计算机科学 2025-10-01 Miao Yu , Zhenhong Zhou , Moayad Aloqaily , Kun Wang , Biwei Huang , Stephen Wang , Yueming Jin , Qingsong Wen

Vision-Language Models (VLMs) excel in generating textual responses from visual inputs, but their versatility raises security concerns. This study takes the first step in exposing VLMs' susceptibility to data poisoning attacks that can…

密码学与安全 · 计算机科学 2024-10-15 Yuancheng Xu , Jiarui Yao , Manli Shu , Yanchao Sun , Zichu Wu , Ning Yu , Tom Goldstein , Furong Huang

Multi-modal large language models (MLLMs) extend large language models (LLMs) to process multi-modal information, enabling them to generate responses to image-text inputs. MLLMs have been incorporated into diverse multi-modal applications,…

密码学与安全 · 计算机科学 2025-03-21 Zenghui Yuan , Jiawen Shi , Pan Zhou , Neil Zhenqiang Gong , Lichao Sun

Large language models (LLMs) are often fine-tuned on uncurated text datasets that adversaries can poison. Existing poisoning attacks primarily rely on fixed trigger phrases that defenses such as outlier detection, clean-data regularization,…

密码学与安全 · 计算机科学 2026-05-27 Zedian Shao , Charles Fleming , Teodora Baluta

Deep speech classification tasks, including keyword spotting and speaker verification, are vital in speech-based human-computer interaction. Recently, the security of these technologies has been revealed to be susceptible to backdoor…

声音 · 计算机科学 2025-06-11 Wenhan Yao , Fen Xiao , Xiarun Chen , Jia Liu , YongQiang He , Weiping Wen

The rapid adoption of mobile graphical user interface (GUI) agents, which autonomously control applications and operating systems (OS), exposes new system-level attack surfaces. Existing backdoors against web GUI agents and general GenAI…

密码学与安全 · 计算机科学 2026-03-25 Yutao Luo , Haotian Zhu , Shuchao Pang , Zhigang Lu , Tian Dong , Yongbin Zhou , Minhui Xue

Deep neural networks are vulnerable to backdoor attacks, a type of adversarial attack that poisons the training data to manipulate the behavior of models trained on such data. Clean-label attacks are a more stealthy form of backdoor attacks…

The growing deployment of large language model (LLM) based agents that interact with external environments has created new attack surfaces for adversarial manipulation. One major threat is indirect prompt injection, where attackers embed…

计算与语言 · 计算机科学 2026-04-14 Hwan Chang , Yonghyun Jun , Hwanhee Lee

Backdoor attacks embed malicious behaviors into Large Language Models (LLMs), enabling adversaries to trigger harmful outputs or bypass safety controls. However, the persistence of the implanted backdoors under user-driven post-deployment…

密码学与安全 · 计算机科学 2025-12-18 Jing Cui , Yufei Han , Jianbin Jiao , Junge Zhang

During fine-tuning, large language models (LLMs) are increasingly vulnerable to data-poisoning backdoor attacks, which compromise their reliability and trustworthiness. However, existing defense strategies suffer from limited…

密码学与安全 · 计算机科学 2025-10-13 Shuai Zhao , Xinyi Wu , Shiqian Zhao , Xiaobao Wu , Zhongliang Guo , Yanhao Jia , Anh Tuan Luu

Federated embodied agent learning protects the data privacy of individual visual environments by keeping data locally at each client (the individual environment) during training. However, since the local data is inaccessible to the server…

人工智能 · 计算机科学 2024-03-19 Yunchao Zhang , Zonglin Di , Kaiwen Zhou , Cihang Xie , Xin Eric Wang

Code LLMs are increasingly employed in software development. However, studies have shown that they are vulnerable to backdoor attacks: when a trigger (a specific input pattern) appears in the input, the backdoor will be activated and cause…

密码学与安全 · 计算机科学 2025-10-07 Chenyu Wang , Zhou Yang , Yaniv Harel , David Lo

The remarkable performance of large language models (LLMs) in generation tasks has enabled practitioners to leverage publicly available models to power custom applications, such as chatbots and virtual assistants. However, the data used to…

Backdoor attacks pose a serious security threat for training neural networks as they surreptitiously introduce hidden functionalities into a model. Such backdoors remain silent during inference on clean inputs, evading detection due to…

密码学与安全 · 计算机科学 2023-12-15 Lukas Struppek , Martin B. Hentschel , Clifton Poth , Dominik Hintersdorf , Kristian Kersting

Developers increasingly construct multimodal large language models (MLLMs) by assembling pretrained components,introducing supply-chain attack surfaces.Existing security research primarily focuses on poisoning backbones such as encoders or…

密码学与安全 · 计算机科学 2026-05-11 Runhe Wang , Li Bai , Haibo Hu , Songze Li

In-context learning, a paradigm bridging the gap between pre-training and fine-tuning, has demonstrated high efficacy in several NLP tasks, especially in few-shot settings. Despite being widely applied, in-context learning is vulnerable to…

计算与语言 · 计算机科学 2024-10-10 Shuai Zhao , Meihuizi Jia , Luu Anh Tuan , Fengjun Pan , Jinming Wen

Large language model (LLM) agents execute tasks through multi-step workflows that combine planning, memory, and tool use. While this design enables autonomy, it also expands the attack surface for backdoor threats. Backdoor triggers…

人工智能 · 计算机科学 2026-01-13 Yunhao Feng , Yige Li , Yutao Wu , Yingshui Tan , Yanming Guo , Yifan Ding , Kun Zhai , Xingjun Ma , Yu-Gang Jiang

The deployment of multimodal large language models (MLLMs) has brought forth a unique vulnerability: susceptibility to malicious attacks through visual inputs. This paper investigates the novel challenge of defending MLLMs against such…

密码学与安全 · 计算机科学 2024-06-18 Renjie Pi , Tianyang Han , Jianshu Zhang , Yueqi Xie , Rui Pan , Qing Lian , Hanze Dong , Jipeng Zhang , Tong Zhang

Previous insertion-based and paraphrase-based backdoors have achieved great success in attack efficacy, but they ignore the text quality and semantic consistency between poisoned and clean texts. Although recent studies introduce LLMs to…

计算与语言 · 计算机科学 2025-04-22 Zhengxian Wu , Juan Wen , Wanli Peng , Ziwei Zhang , Yinghan Zhou , Yiming Xue

Robotic manipulation policies are increasingly empowered by \textit{large language models} (LLMs) and \textit{vision-language models} (VLMs), leveraging their understanding and perception capabilities. Recently, inference-time attacks…