English
Related papers

Related papers: Concept-Guided Backdoor Attack on Vision Language …

200 papers

Visual State Space Models (VSSM) have shown remarkable performance in various computer vision tasks. However, backdoor attacks pose significant security challenges, causing compromised models to predict target labels when specific triggers…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Cheng-Yi Lee , Yu-Hsuan Chiang , Zhong-You Wu , Chia-Mu Yu , Chun-Shien Lu

Backdoors implanted in pre-trained language models (PLMs) can be transferred to various downstream tasks, which exposes a severe security threat. However, most existing backdoor attacks against PLMs are un-targeted and task-specific. Few…

Computation and Language · Computer Science 2024-12-20 Wei Du , Peixuan Li , Boqun Li , Haodong Zhao , Gongshen Liu

With the advent and widespread deployment of Multimodal Large Language Models (MLLMs), ensuring their safety has become increasingly critical. To achieve this objective, it requires us to proactively discover the vulnerability of MLLMs by…

Cryptography and Security · Computer Science 2024-06-13 Siyuan Ma , Weidi Luo , Yu Wang , Xiaogeng Liu

Multi-Modal Language Models (MLLMs) have transformed artificial intelligence by combining visual and text data, making applications like image captioning, visual question answering, and multi-modal content creation possible. This ability to…

Cryptography and Security · Computer Science 2024-11-11 Pete Janowczyk , Linda Laurier , Ave Giulietta , Arlo Octavia , Meade Cleti

Vision-language artificial intelligence models (VLMs) possess medical knowledge and can be employed in healthcare in numerous ways, including as image interpreters, virtual scribes, and general decision support systems. However, here, we…

Cryptography and Security · Computer Science 2025-03-20 Jan Clusmann , Dyke Ferber , Isabella C. Wiest , Carolin V. Schneider , Titus J. Brinker , Sebastian Foersch , Daniel Truhn , Jakob N. Kather

The implications of backdoor attacks on English-centric large language models (LLMs) have been widely examined - such attacks can be achieved by embedding malicious behaviors during training and activated under specific conditions that…

Computation and Language · Computer Science 2025-03-18 Xuanli He , Jun Wang , Qiongkai Xu , Pasquale Minervini , Pontus Stenetorp , Benjamin I. P. Rubinstein , Trevor Cohn

Deep neural networks are vulnerable to backdoor attacks, a type of adversarial attack that poisons the training data to manipulate the behavior of models trained on such data. Clean-label attacks are a more stealthy form of backdoor attacks…

Machine Learning · Computer Science 2024-07-17 Quang H. Nguyen , Nguyen Ngoc-Hieu , The-Anh Ta , Thanh Nguyen-Tang , Kok-Seng Wong , Hoang Thanh-Tung , Khoa D. Doan

With the development of technology, large language models (LLMs) have dominated the downstream natural language processing (NLP) tasks. However, because of the LLMs' instruction-following abilities and inability to distinguish the…

Cryptography and Security · Computer Science 2025-10-07 Yulin Chen , Haoran Li , Yuan Sui , Yangqiu Song , Bryan Hooi

Visual language models (VLMs) have made significant progress in image captioning tasks, yet recent studies have found they are vulnerable to backdoor attacks. Attackers can inject undetectable perturbations into the data during inference,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Shuhan Xu , Siyuan Liang , Hongling Zheng , Aishan Liu , Xinbiao Wang , Yong Luo , Fu Lin , Leszek Rutkowski , Dacheng Tao

Large visual language models (LVLMs) have demonstrated excellent instruction-following capabilities, yet remain vulnerable to stealthy backdoor attacks when finetuned using contaminated data. Existing backdoor defense techniques are usually…

Cryptography and Security · Computer Science 2025-06-09 Yuan Xun , Siyuan Liang , Xiaojun Jia , Xinwei Liu , Xiaochun Cao

The growing application of large language models (LLMs) in safety-critical domains has raised urgent concerns about their security. Many recent studies have demonstrated the feasibility of backdoor attacks against LLMs. However, existing…

Cryptography and Security · Computer Science 2026-04-24 Jiali Wei , Ming Fan , Guoheng Sun , Xicheng Zhang , Haijun Wang , Ting Liu

Large Language Models (LLMs), despite their impressive capabilities across domains, have been shown to be vulnerable to backdoor attacks. Prior backdoor strategies predominantly operate at the token level, where an injected trigger causes…

Cryptography and Security · Computer Science 2026-04-17 Vu Tuan Truong , Long Bao Le

Deep neural networks (DNNs) have long been recognized as vulnerable to backdoor attacks. By providing poisoned training data in the fine-tuning process, the attacker can implant a backdoor into the victim model. This enables input samples…

Cryptography and Security · Computer Science 2024-09-10 Abdullah Arafat Miah , Yu Bi

Backdoor attacks threaten Deep Neural Networks (DNNs). Towards stealthiness, researchers propose clean-label backdoor attacks, which require the adversaries not to alter the labels of the poisoned training datasets. Clean-label settings…

Cryptography and Security · Computer Science 2022-06-13 Nan Luo , Yuanzhang Li , Yajie Wang , Shangbo Wu , Yu-an Tan , Quanxin Zhang

Vision-Language Models (VLMs) exhibit impressive performance, yet the integration of powerful vision encoders has significantly broadened their attack surface, rendering them increasingly susceptible to jailbreak attacks. However, lacking…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Jiaxin Song , Yixu Wang , Jie Li , Rui Yu , Yan Teng , Xingjun Ma , Yingchun Wang

Recent research on large language model (LLM) jailbreaks has primarily focused on techniques that bypass safety mechanisms to elicit overtly harmful outputs. However, such efforts often overlook attacks that exploit the model's capacity for…

Computation and Language · Computer Science 2025-12-01 Zhaoxin Zhang , Borui Chen , Yiming Hu , Youyang Qu , Tianqing Zhu , Longxiang Gao

Chain-of-Thought (CoT) reasoning has emerged as a powerful technique for enhancing large language models' capabilities by generating intermediate reasoning steps for complex tasks. A common practice for equipping LLMs with reasoning is to…

Cryptography and Security · Computer Science 2026-01-29 Harsh Chaudhari , Ethan Rathbun , Hanna Foerster , Jamie Hayes , Matthew Jagielski , Milad Nasr , Ilia Shumailov , Alina Oprea

Deep neural networks (DNNs) are vulnerable to a class of attacks called "backdoor attacks", which create an association between a backdoor trigger and a target label the attacker is interested in exploiting. A backdoored DNN performs well…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Hasan Abed Al Kader Hammoud , Shuming Liu , Mohammed Alkhrashi , Fahad AlBalawi , Bernard Ghanem

Reinforcement Learning with Verifiable Rewards (RLVR) is an emerging paradigm that significantly boosts a Large Language Model's (LLM's) reasoning abilities on complex logical tasks, such as mathematics and programming. However, we…

Cryptography and Security · Computer Science 2026-04-14 Weiyang Guo , Zesheng Shi , Zeen Zhu , Yuan Zhou , Min Zhang , Jing Li

The integration of Large Language Models (LLMs) into robotics has revolutionized their ability to interpret complex human commands and execute sophisticated tasks. However, such paradigm shift introduces critical security vulnerabilities…