English
Related papers

Related papers: Dynamic Token Reweighting for Robust Vision-Langua…

200 papers

Diffusion Vision-Language Models (dVLMs), built upon the non-causal foundations of Diffusion Large Language Models (dLLMs), have demonstrated remarkable efficacy in multimodal tasks by departing from the traditional autoregressive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yu Pan , Andi Zhang , Yi Wang , Sibei Yang , Wenjie Wang

Large language models (LLMs) are widely used for task understanding and action planning in embodied intelligence (EI) systems, but their adoption substantially increases vulnerability to jailbreak attacks. While recent work explores…

Cryptography and Security · Computer Science 2026-01-06 Jirui Yang , Zheyu Lin , Zhihui Lu , Yinggui Wang , Lei Wang , Tao Wei , Qiang Duan , Xin Du , Shuhan Yang

Generative medical vision-language models~(Med-VLMs) are primarily designed to generate complex textual information~(e.g., diagnostic reports) from multimodal inputs including vision modality~(e.g., medical images) and language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Zhiyu Xue , Reza Abbasi-Asl , Ramtin Pedarsani

Large Language Models (LLMs) are known to be vulnerable to jailbreaking attacks, wherein adversaries exploit carefully engineered prompts to induce harmful or unethical responses. Such threats have raised critical concerns about the safety…

Cryptography and Security · Computer Science 2025-05-22 Taiye Chen , Zeming Wei , Ang Li , Yisen Wang

Existing training-time safety alignment techniques for large language models (LLMs) remain vulnerable to jailbreak attacks. Direct preference optimization (DPO), a widely deployed alignment method, exhibits limitations in both experimental…

Computation and Language · Computer Science 2025-10-31 Xuandong Zhao , Will Cai , Tianneng Shi , David Huang , Licong Lin , Song Mei , Dawn Song

Large language models (LLMs) have demonstrated remarkable capabilities across diverse applications, however, they remain critically vulnerable to jailbreak attacks that elicit harmful responses violating human values and safety guidelines.…

Cryptography and Security · Computer Science 2026-01-12 Zhaoqi Wang , Zijian Zhang , Daqing He , Pengtao Kou , Xin Li , Jiamou Liu , Jincheng An , Yong Liu

Despite extensive alignment efforts, Large Vision-Language Models (LVLMs) remain vulnerable to jailbreak attacks. To mitigate these risks, existing detection methods are essential, yet they face two major challenges: generalization and…

Cryptography and Security · Computer Science 2026-01-28 Shuang Liang , Zhihao Xu , Jiaqi Weng , Jialing Tao , Hui Xue , Xiting Wang

Large Language Models (LLMs) are widely applied in decision making, but their deployment is threatened by jailbreak attacks, where adversarial users manipulate model behavior to bypass safety measures. Existing defense mechanisms, such as…

Cryptography and Security · Computer Science 2025-05-30 Yi Wang , Fenghua Weng , Sibei Yang , Zhan Qin , Minlie Huang , Wenjie Wang

Vision Language Models (VLMs) have demonstrated impressive inference capabilities, but remain vulnerable to jailbreak attacks that can induce harmful or unethical responses. Existing defence methods are predominantly white-box approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xiangyu Yin , Yi Qi , Jinwei Hu , Zhen Chen , Yi Dong , Xingyu Zhao , Xiaowei Huang , Wenjie Ruan

Large Language Models (LLMs) face threats from jailbreak prompts. Existing methods for defending against jailbreak attacks are primarily based on auxiliary models. These strategies, however, often require extensive data collection or…

Cryptography and Security · Computer Science 2025-11-21 Zhuoran Yang , Yanyong Zhang

Large language models (LLMs) are vulnerable to jailbreak attacks - resulting in harmful, unethical, or biased text generations. However, existing jailbreaking methods are computationally costly. In this paper, we propose the weak-to-strong…

Computation and Language · Computer Science 2025-07-25 Xuandong Zhao , Xianjun Yang , Tianyu Pang , Chao Du , Lei Li , Yu-Xiang Wang , William Yang Wang

Multimodal Large Language Models (MLLMs) are vulnerable to jailbreak attacks, which can elicit harmful responses from MLLMs. Many MLLMs support multi-image inputs, inadvertently introducing new vulnerabilities due to less efforts on…

Cryptography and Security · Computer Science 2026-05-20 Wenzhuo Xu , Zhipeng Wei , Zonghao Ying , Deyue Zhang , Dongdong Yang , Xiangzheng Zhang , Quanchen Zou

The quality of open-weight language models has dramatically improved in recent years. Sharing weights greatly facilitates model adoption by enabling their use across diverse hardware and software platforms. They also allow for more open…

Machine Learning · Computer Science 2026-05-12 Keitaro Sakamoto , Pierre Ablin , Federico Danieli , Marco Cuturi

With the widespread application of large language models (LLMs) in various fields, the security challenges they face have become increasingly prominent, especially the issue of jailbreak. These attacks induce the model to generate erroneous…

Cryptography and Security · Computer Science 2025-11-12 Shuyuan Liu , Jiawei Chen , Xiao Yang , Hang Su , Zhaoxia Yin

Large Vision-Language Models (LVLMs) demonstrate exceptional performance across multimodal tasks, yet remain vulnerable to jailbreak attacks that bypass built-in safety mechanisms to elicit restricted content generation. Existing black-box…

Computation and Language · Computer Science 2025-06-23 Lei Jiang , Zixun Zhang , Zizhou Wang , Xiaobing Sun , Zhen Li , Liangli Zhen , Xiaohua Xu

Multi-modal large language models (MLLMs), capable of processing text, images, and audio, have been widely adopted in various AI applications. However, recent MLLMs integrating images and text remain highly vulnerable to coordinated…

Cryptography and Security · Computer Science 2025-12-19 Zihao Wang , Kar Wai Fok , Vrizlynn L. L. Thing

Large Vision-Language Models (LVLMs) are vulnerable to a growing array of multimodal jailbreak attacks, necessitating defenses that are both generalizable to novel threats and efficient for practical deployment. Many current strategies fall…

Cryptography and Security · Computer Science 2026-04-21 Peichun Hua , Hao Li , Shanghao Shi , Zhiyuan Yu , Ning Zhang

Large Reasoning Models (LRMs) have recently demonstrated impressive performances across diverse domains. However, how the safety of Large Language Models (LLMs) benefits from enhanced reasoning capabilities against jailbreak queries remains…

Computation and Language · Computer Science 2025-09-23 Junda Zhu , Lingyong Yan , Shuaiqiang Wang , Dawei Yin , Lei Sha

As multimodal reasoning improves the overall capabilities of Large Vision Language Models (LVLMs), recent studies have begun to explore safety-oriented reasoning, aiming to enhance safety awareness by analyzing potential safety risks during…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Fenghua Weng , Chaochao Lu , Xia Hu , Wenqi Shao , Wenjie Wang

While multimodal large language models (MLLMs) have achieved remarkable success in recent advancements, their susceptibility to jailbreak attacks has come to light. In such attacks, adversaries exploit carefully crafted prompts to coerce…

Cryptography and Security · Computer Science 2025-02-04 Ziyi Yin , Yuanpu Cao , Han Liu , Ting Wang , Jinghui Chen , Fenhlong Ma