English
Related papers

Related papers: SHIELD: Classifier-Guided Prompting for Robust and…

200 papers

Vision-Language Models (VLMs) face significant safety vulnerabilities from malicious prompt attacks due to weakened alignment during visual integration. Existing defenses suffer from efficiency and robustness. To address these challenges,…

Machine Learning · Computer Science 2026-04-09 Peigui Qi , Kunsheng Tang , Yanpu Yu , Jialin Wu , Yide Song , Wenbo Zhou , Zhicong Huang , Cheng Hong , Weiming Zhang , Nenghai Yu

Large Vision-Language Models (LVLMs) excel in diverse cross-modal tasks. However, object hallucination, where models produce plausible but inaccurate object descriptions, remains a significant challenge. In contrast to previous work…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Yiyang Huang , Liang Shi , Yitian Zhang , Yi Xu , Yun Fu

Small Language Models (SLMs) are emerging as efficient and economically viable alternatives to Large Language Models (LLMs), offering competitive performance with significantly lower computational costs and latency. These advantages make…

Cryptography and Security · Computer Science 2026-04-01 Md Jueal Mia , Joaquin Molto , Yanzhao Wu , M. Hadi Amini

Safeguarding vision-language models (VLMs) is a critical challenge, as existing methods often suffer from over-defense, which harms utility, or rely on shallow alignment, failing to detect complex threats that require deep reasoning. To…

Cryptography and Security · Computer Science 2026-04-03 Nanxi Li , Zhengyue Zhao , G. Edward Suh , Marco Pavone , Chaowei Xiao

Large Language Models (LLMs) remain vulnerable to jailbreak attacks, where adversarially crafted prompts induce policy-violating responses despite safety alignment. Existing defenses typically improve safety through external filtering,…

Cryptography and Security · Computer Science 2026-05-12 Yulong Chen , Qi Zhang , Jiawen Zhang , Yadong Liu , Mu Li , Jie Wen , Yong Xu

Multimodal large language models (MLLMs) are widely used in vision-language reasoning tasks. However, their vulnerability to adversarial prompts remains a serious concern, as safety mechanisms often fail to prevent the generation of harmful…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Zuoou Li , Weitong Zhang , Jingyuan Wang , Shuyuan Zhang , Wenjia Bai , Bernhard Kainz , Mengyun Qiao

With the advent and widespread deployment of Multimodal Large Language Models (MLLMs), the imperative to ensure their safety has become increasingly pronounced. However, with the integration of additional modalities, MLLMs are exposed to…

Cryptography and Security · Computer Science 2024-03-15 Yu Wang , Xiaogeng Liu , Yu Li , Muhao Chen , Chaowei Xiao

System prompts are critical for guiding the behavior of Large Language Models (LLMs), yet they often contain proprietary logic or sensitive information, making them a prime target for extraction attacks. Adversarial queries can successfully…

Cryptography and Security · Computer Science 2026-02-03 Huseein Jawad , Nicolas Brunel

In real-world deployments, Vision-Language Large Models (VLLMs) face critical challenges from multilingual and multimodal composite attacks: harmful images paired with low-resource language texts can easily bypass defenses designed for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Enyi Shi , Fei Shen , Shuyi Miao , Linxia Zhu , Pengyang Shao , Jinhui Tang , Tat-Seng Chua

The increasing sophistication of large vision-language models (LVLMs) has been accompanied by advances in safety alignment mechanisms designed to prevent harmful content generation. However, these defenses remain vulnerable to sophisticated…

Cryptography and Security · Computer Science 2026-04-09 Quanchen Zou , Zonghao Ying , Moyang Chen , Wenzhuo Xu , Yisong Xiao , Yakai Li , Deyue Zhang , Dongdong Yang , Zhao Liu , Xiangzheng Zhang

With the integration of an additional modality, large vision-language models (LVLMs) exhibit greater vulnerability to safety risks (e.g., jailbreaking) compared to their language-only predecessors. Although recent studies have devoted…

Machine Learning · Computer Science 2025-01-07 Ziwei Zheng , Junyao Zhao , Le Yang , Lijun He , Fan Li

In recent years, the rapid development of large language models (LLMs) has achieved remarkable performance across various tasks. However, research indicates that LLMs are vulnerable to jailbreak attacks, where adversaries can induce the…

Cryptography and Security · Computer Science 2024-08-23 Jiawei Zhao , Kejiang Chen , Xiaojian Yuan , Weiming Zhang

The security of Large Language Model (LLM) applications is fundamentally challenged by "form-first" attacks like prompt injection and jailbreaking, where malicious instructions are embedded within user inputs. Conventional defenses, which…

Cryptography and Security · Computer Science 2025-10-15 Dominik Schwarz

AI companions powered by large language models (LLMs) are increasingly integrated into users' daily lives, offering emotional support and companionship. While existing safety systems focus on overt harms, they rarely address early-stage…

Human-Computer Interaction · Computer Science 2025-10-21 Ziv Ben-Zion , Paul Raffelhüschen , Max Zettl , Antonia Lüönd , Achim Burrer , Philipp Homan , Tobias R Spiller

Large Vision-Language Models (LVLMs) have shown remarkable capabilities across a wide range of multimodal tasks. However, their integration of visual inputs introduces expanded attack surfaces, thereby exposing them to novel security…

Computation and Language · Computer Science 2025-05-29 Juan Ren , Mark Dras , Usman Naseem

Large Language Models (LLMs) have become increasingly vulnerable to jailbreak attacks that circumvent their safety mechanisms. While existing defense methods either suffer from adaptive attacks or require computationally expensive auxiliary…

Computation and Language · Computer Science 2025-03-25 Xunguang Wang , Wenxuan Wang , Zhenlan Ji , Zongjie Li , Pingchuan Ma , Daoyuan Wu , Shuai Wang

Large Language Models (LLMs) have transformed task automation and content generation across various domains while incorporating safety filters to prevent misuse. We introduce a novel jailbreaking framework that employs distributed prompt…

Cryptography and Security · Computer Science 2025-04-01 Johan Wahréus , Ahmed Hussain , Panos Papadimitratos

Aligning Vision-Language Models (VLMs) with safety standards is essential to mitigate risks arising from their multimodal complexity, where integrating vision and language unveils subtle threats beyond the reach of conventional safeguards.…

Machine Learning · Computer Science 2025-10-14 Menglan Chen , Xianghe Pang , Jingjing Dong , WenHao Wang , Yaxin Du , Siheng Chen

Large language models (LLMs) are increasingly being adopted in a wide range of real-world applications. Despite their impressive performance, recent studies have shown that LLMs are vulnerable to deliberately crafted adversarial prompts…

Artificial Intelligence · Computer Science 2024-06-17 Wei Zhao , Zhe Li , Yige Li , Ye Zhang , Jun Sun

Safety prompts constitute an interpretable layer of defense against jailbreak attacks in vision-language models (VLMs); however, their efficacy is constrained by the models' latent structural responsiveness. We observe that such prompts…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Chongxin Li , Hanzhang Wang , Lian Duan
‹ Prev 1 2 3 10 Next ›