English
Related papers

Related papers: Backdoor Attack on Vision Language Models with Ste…

200 papers

Despite significant advancements in computer vision, semantic segmentation models may be susceptible to backdoor attacks. These attacks, involving hidden triggers, aim to cause the models to misclassify instances of the victim class as the…

Cryptography and Security · Computer Science 2025-07-29 Bilal Hussain Abbasi , Zirui Gong , Yanjun Zhang , Shang Gao , Antonio Robles-Kelly , Leo Zhang

Large language models have become increasingly prominent, also signaling a shift towards multimodality as the next frontier in artificial intelligence, where their embeddings are harnessed as prompts to generate textual content.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiachen Sun , Changsheng Wang , Jiongxiao Wang , Yiwei Zhang , Chaowei Xiao

Vision-Language Models (VLMs) have shown remarkable performance, yet their security remains insufficiently understood. Existing adversarial studies focus almost exclusively on the digital setting, leaving physical-world threats largely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Yingying Zhao , Chengyin Hu , Qike Zhang , Xin Li , Xin Wang , Yiwei Wei , Jiujiang Guo , Jiahuan Long , Tingsong Jiang , Wen Yao

Textual backdoor attacks present a substantial security risk to Large Language Models (LLM). It embeds carefully chosen triggers into a victim model at the training stage, and makes the model erroneously predict inputs containing the same…

Computation and Language · Computer Science 2024-07-08 Xinglin Li , Xianwen He , Yao Li , Minhao Cheng

Large reasoning models (LRMs) have emerged as a significant advancement in artificial intelligence, representing a specialized class of large language models (LLMs) designed to tackle complex reasoning tasks. The defining characteristic of…

Computation and Language · Computer Science 2025-07-25 Biao Yi , Zekun Fei , Jianing Geng , Tong Li , Lihai Nie , Zheli Liu , Yiming Li

Masked diffusion language models (MDLMs) are emerging as a compelling new paradigm for text generation, but their training-time security remains largely unexplored. Existing backdoor attacks on Gaussian diffusion models or autoregressive…

Machine Learning · Computer Science 2026-05-20 Daniel Yiming Cao , Chengzhong Wang , Sheng-Yen Chou , Chengyu Huang , Pin-Yu Chen , Shengwei An

Instruction-tuned Large Language Models designed for coding tasks are increasingly employed as AI coding assistants. However, the cybersecurity vulnerabilities and implications arising from the widespread integration of these models are not…

Cryptography and Security · Computer Science 2025-03-10 Md Imran Hossen , Sai Venkatesh Chilukoti , Liqun Shan , Sheng Chen , Yinzhi Cao , Xiali Hei

Large Vision-Language Models (LVLMs) have shown remarkable capabilities across a wide range of multimodal tasks. However, their integration of visual inputs introduces expanded attack surfaces, thereby exposing them to novel security…

Computation and Language · Computer Science 2025-05-29 Juan Ren , Mark Dras , Usman Naseem

Large language models (LLMs) have exhibited remarkable versatility and adaptability, while their widespread adoption across various applications also raises critical safety concerns. This paper focuses on the impact of backdoored LLMs.…

Computation and Language · Computer Science 2025-09-03 Jiyang Qiu , Xinbei Ma , Zhuosheng Zhang , Hai Zhao , Yun Li , Qianren Wang

Embodied Large Language Models (LLMs) enable AI agents to interact with the physical world through natural language instructions and actions. However, beyond the language-level risks inherent to LLMs themselves, embodied LLMs with…

Robotics · Computer Science 2026-03-03 Xinyu Huang , Qiang Yang , Leming Shen , Zijing Ma , Yuanqing Zheng

Deep neural networks (DNNs) are vulnerable to the \emph{backdoor attack}, which intends to embed hidden backdoors in DNNs by poisoning training data. The attacked model behaves normally on benign samples, whereas its prediction will be…

Cryptography and Security · Computer Science 2021-04-06 Yiming Li , Yanjie Li , Yalei Lv , Yong Jiang , Shu-Tao Xia

Vision-language models (VLMs) demonstrate strong multimodal capabilities but have been found to be more susceptible to generating harmful content compared to their backbone large language models (LLMs). Our investigation reveals that the…

Machine Learning · Computer Science 2025-01-29 Qing Li , Jiahui Geng , Zongxiong Chen , Kun Song , Lei Ma , Fakhri Karray

Large language models (LLMs) have revolutionized software development practices, yet concerns about their safety have arisen, particularly regarding hidden backdoors, aka trojans. Backdoor attacks involve the insertion of triggers into…

Software Engineering · Computer Science 2024-03-06 Aftab Hussain , Md Rafiqul Islam Rabin , Navid Ayoobi , Mohammad Amin Alipour

Large-scale unlabeled data has spurred recent progress in self-supervised learning methods that learn rich visual representations. State-of-the-art self-supervised methods for learning representations from images (e.g., MoCo, BYOL, MSF) use…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Aniruddha Saha , Ajinkya Tejankar , Soroush Abbasi Koohpayegani , Hamed Pirsiavash

Recent advances in vision-language-action (VLA) models have greatly improved embodied AI, enabling robots to follow natural language instructions and perform diverse tasks. However, their reliance on uncurated training datasets raises…

Cryptography and Security · Computer Science 2025-10-13 Zirun Zhou , Zhengyang Xiao , Haochuan Xu , Jing Sun , Di Wang , Jingfeng Zhang

We introduce new jailbreak attacks on vision language models (VLMs), which use aligned LLMs and are resilient to text-only jailbreak attacks. Specifically, we develop cross-modality attacks on alignment where we pair adversarial images…

Cryptography and Security · Computer Science 2023-10-12 Erfan Shayegani , Yue Dong , Nael Abu-Ghazaleh

Pre-trained vision models (PVMs) have become a dominant component due to their exceptional performance when fine-tuned for downstream tasks. However, the presence of backdoors within PVMs poses significant threats. Unfortunately, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Aishan Liu , Xinwei Zhang , Yisong Xiao , Yuguang Zhou , Siyuan Liang , Jiakai Wang , Xianglong Liu , Xiaochun Cao , Dacheng Tao

In the field of natural language processing, the prevalent approach involves fine-tuning pretrained language models (PLMs) using local samples. Recent research has exposed the susceptibility of PLMs to backdoor attacks, wherein the…

Machine Learning · Computer Science 2023-10-31 Ruixiang Tang , Jiayi Yuan , Yiming Li , Zirui Liu , Rui Chen , Xia Hu

The rapid growth of natural language processing (NLP) and pre-trained language models have enabled accurate text classification in a variety of settings. However, text classification models are susceptible to backdoor attacks, where an…

Cryptography and Security · Computer Science 2024-12-30 A. Dilara Yavuz , M. Emre Gursoy

The proliferation of open-weight Large Language Models (LLMs) has democratized agentic AI, yet fine-tuned weights are frequently shared and adopted with limited scrutiny beyond leaderboard performance. This creates a risk where third-party…

Cryptography and Security · Computer Science 2026-03-05 Bhanu Pallakonda , Mikkel Hindsbo , Sina Ehsani , Prag Mishra