中文
相关论文

相关论文: Backdoor Attack on Vision Language Models with Ste…

200 篇论文

Large language models (LLMs) are increasingly deployed in settings where inducing a bias toward a certain topic can have significant consequences, and backdoor attacks can be used to produce such models. Prior work on backdoor attacks has…

密码学与安全 · 计算机科学 2026-02-17 Anudeep Das , Prach Chantasantitam , Gurjot Singh , Lipeng He , Mariia Ponomarenko , Florian Kerschbaum

Large language models (LLMs) have transformed the development of embodied intelligence. By providing a few contextual demonstrations, developers can utilize the extensive internal knowledge of LLMs to effortlessly translate complex tasks…

Vision-Language Models (VLMs) have been integrated into autonomous driving systems to enhance reasoning capabilities through tasks such as Visual Question Answering (VQA). However, the robustness of these systems against backdoor attacks…

计算机视觉与模式识别 · 计算机科学 2025-05-13 Ming Liu , Siyuan Liang , Koushik Howlader , Liwen Wang , Dacheng Tao , Wensheng Zhang

Vision-Language-Action (VLA) models are widely deployed in safety-critical embodied AI applications such as robotics. However, their complex multimodal interactions also expose new security vulnerabilities. In this paper, we investigate a…

密码学与安全 · 计算机科学 2026-01-09 Ji Guo , Wenbo Jiang , Yansong Lin , Yijing Liu , Ruichen Zhang , Guomin Lu , Aiguo Chen , Xinshuo Han , Hongwei Li , Dusit Niyato

The newly introduced Visual State Space Model (VMamba), which employs \textit{State Space Mechanisms} (SSM) to interpret images as sequences of patches, has shown exceptional performance compared to Vision Transformers (ViT) across various…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Om Suhas Deshmukh , Sankalp Nagaonkar , Achyut Mani Tripathi , Ashish Mishra

Mainstream backdoor attack methods typically demand substantial tuning data for poisoning, limiting their practicality and potentially degrading the overall performance when applied to Large Language Models (LLMs). To address these issues,…

密码学与安全 · 计算机科学 2024-03-21 Yanzhou Li , Tianlin Li , Kangjie Chen , Jian Zhang , Shangqing Liu , Wenhan Wang , Tianwei Zhang , Yang Liu

Large Language Models (LLMs) have shown significant promise in real-world decision-making tasks for embodied artificial intelligence, especially when fine-tuned to leverage their inherent common sense and reasoning abilities while being…

密码学与安全 · 计算机科学 2025-05-01 Ruochen Jiao , Shaoyuan Xie , Justin Yue , Takami Sato , Lixu Wang , Yixuan Wang , Qi Alfred Chen , Qi Zhu

Recent advances in Vision-Language Models (VLMs) have greatly enhanced the integration of visual perception and linguistic reasoning, driving rapid progress in multimodal understanding. Despite these achievements, the security of VLMs,…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Nam Duong Tran , Phi Le Nguyen

The advent of Large Language Models (LLMs) has marked significant achievements in language processing and reasoning capabilities. Despite their advancements, LLMs face vulnerabilities to data poisoning attacks, where the adversary inserts…

Recent studies have revealed a security threat to natural language processing (NLP) models, called the Backdoor Attack. Victim models can maintain competitive performance on clean samples while behaving abnormally on samples with a specific…

计算与语言 · 计算机科学 2021-03-30 Wenkai Yang , Lei Li , Zhiyuan Zhang , Xuancheng Ren , Xu Sun , Bin He

Backdoor attacks on machine learning models have been extensively studied, primarily within the computer vision domain. Originally, these attacks manipulated classifiers to generate incorrect outputs in the presence of specific, often…

机器学习 · 计算机科学 2025-03-25 Sharon Lin , Krishnamurthy , Dvijotham , Jamie Hayes , Chongyang Shi , Ilia Shumailov , Shuang Song

Large language models (LLMs) have demonstrated superior performance compared to previous methods on various tasks, and often serve as the foundation models for many researches and services. However, the untrustworthy third-party LLMs may…

密码学与安全 · 计算机科学 2024-04-02 Hai Huang , Zhengyu Zhao , Michael Backes , Yun Shen , Yang Zhang

With the widespread use of deep learning system in many applications, the adversary has strong incentive to explore vulnerabilities of deep neural networks and manipulate them. Backdoor attacks against deep neural networks have been…

密码学与安全 · 计算机科学 2019-06-05 Jiazhu Dai , Chuanshuai Chen

Recent advances in Large Visual Language Models (LVLMs) have demonstrated impressive performance across various vision-language tasks by leveraging large-scale image-text pretraining and instruction tuning. However, the security…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Zihan Wang , Guansong Pang , Wenjun Miao , Jin Zheng , Xiao Bai

Vision-language models (VLMs) have significantly advanced autonomous driving (AD) by enhancing reasoning capabilities. However, these models remain highly vulnerable to adversarial attacks. While existing research has primarily focused on…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Tianyuan Zhang , Lu Wang , Xinwei Zhang , Yitong Zhang , Boyi Jia , Siyuan Liang , Shengshan Hu , Qiang Fu , Aishan Liu , Xianglong Liu

Semantic segmentation models are widely deployed in safety-critical applications such as autonomous driving, yet their vulnerability to backdoor attacks remains largely underexplored. Prior segmentation backdoor studies transfer threat…

密码学与安全 · 计算机科学 2026-03-18 Guangsheng Zhang , Huan Tian , Leo Zhang , Tianqing Zhu , Ming Ding , Wanlei Zhou , Bo Liu

Large Vision-Language Models (LVLMs) demonstrate exceptional performance across multimodal tasks, yet remain vulnerable to jailbreak attacks that bypass built-in safety mechanisms to elicit restricted content generation. Existing black-box…

计算与语言 · 计算机科学 2025-06-23 Lei Jiang , Zixun Zhang , Zizhou Wang , Xiaobing Sun , Zhen Li , Liangli Zhen , Xiaohua Xu

Generative large language models (LLMs) have achieved state-of-the-art results on a wide range of tasks, yet they remain susceptible to backdoor attacks: carefully crafted triggers in the input can manipulate the model to produce…

人工智能 · 计算机科学 2025-05-20 Yige Li , Hanxun Huang , Yunhan Zhao , Xingjun Ma , Jun Sun

Vision-language models (VLMs) have revolutionized multimodal AI applications but introduce novel security vulnerabilities that remain largely unexplored. We present the first comprehensive study of steganographic prompt injection attacks…

密码学与安全 · 计算机科学 2025-07-31 Chetan Pathade

The rapid adoption of Large Language Model (LLM) agents and multi-agent systems enables remarkable capabilities in natural language processing and generation. However, these systems introduce security vulnerabilities that extend beyond…

密码学与安全 · 计算机科学 2026-05-12 Matteo Lupinacci , Francesco Aurelio Pironti , Francesco Blefari , Francesco Romeo , Luigi Arena , Angelo Furfaro