中文
相关论文

相关论文: Dynamic Token Reweighting for Robust Vision-Langua…

200 篇论文

Diffusion Vision-Language Models (dVLMs), built upon the non-causal foundations of Diffusion Large Language Models (dLLMs), have demonstrated remarkable efficacy in multimodal tasks by departing from the traditional autoregressive…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Yu Pan , Andi Zhang , Yi Wang , Sibei Yang , Wenjie Wang

Large language models (LLMs) are widely used for task understanding and action planning in embodied intelligence (EI) systems, but their adoption substantially increases vulnerability to jailbreak attacks. While recent work explores…

密码学与安全 · 计算机科学 2026-01-06 Jirui Yang , Zheyu Lin , Zhihui Lu , Yinggui Wang , Lei Wang , Tao Wei , Qiang Duan , Xin Du , Shuhan Yang

Generative medical vision-language models~(Med-VLMs) are primarily designed to generate complex textual information~(e.g., diagnostic reports) from multimodal inputs including vision modality~(e.g., medical images) and language…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Zhiyu Xue , Reza Abbasi-Asl , Ramtin Pedarsani

Large Language Models (LLMs) are known to be vulnerable to jailbreaking attacks, wherein adversaries exploit carefully engineered prompts to induce harmful or unethical responses. Such threats have raised critical concerns about the safety…

密码学与安全 · 计算机科学 2025-05-22 Taiye Chen , Zeming Wei , Ang Li , Yisen Wang

Existing training-time safety alignment techniques for large language models (LLMs) remain vulnerable to jailbreak attacks. Direct preference optimization (DPO), a widely deployed alignment method, exhibits limitations in both experimental…

计算与语言 · 计算机科学 2025-10-31 Xuandong Zhao , Will Cai , Tianneng Shi , David Huang , Licong Lin , Song Mei , Dawn Song

Large language models (LLMs) have demonstrated remarkable capabilities across diverse applications, however, they remain critically vulnerable to jailbreak attacks that elicit harmful responses violating human values and safety guidelines.…

密码学与安全 · 计算机科学 2026-01-12 Zhaoqi Wang , Zijian Zhang , Daqing He , Pengtao Kou , Xin Li , Jiamou Liu , Jincheng An , Yong Liu

Despite extensive alignment efforts, Large Vision-Language Models (LVLMs) remain vulnerable to jailbreak attacks. To mitigate these risks, existing detection methods are essential, yet they face two major challenges: generalization and…

密码学与安全 · 计算机科学 2026-01-28 Shuang Liang , Zhihao Xu , Jiaqi Weng , Jialing Tao , Hui Xue , Xiting Wang

Large Language Models (LLMs) are widely applied in decision making, but their deployment is threatened by jailbreak attacks, where adversarial users manipulate model behavior to bypass safety measures. Existing defense mechanisms, such as…

密码学与安全 · 计算机科学 2025-05-30 Yi Wang , Fenghua Weng , Sibei Yang , Zhan Qin , Minlie Huang , Wenjie Wang

Vision Language Models (VLMs) have demonstrated impressive inference capabilities, but remain vulnerable to jailbreak attacks that can induce harmful or unethical responses. Existing defence methods are predominantly white-box approaches…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Xiangyu Yin , Yi Qi , Jinwei Hu , Zhen Chen , Yi Dong , Xingyu Zhao , Xiaowei Huang , Wenjie Ruan

Large Language Models (LLMs) face threats from jailbreak prompts. Existing methods for defending against jailbreak attacks are primarily based on auxiliary models. These strategies, however, often require extensive data collection or…

密码学与安全 · 计算机科学 2025-11-21 Zhuoran Yang , Yanyong Zhang

Large language models (LLMs) are vulnerable to jailbreak attacks - resulting in harmful, unethical, or biased text generations. However, existing jailbreaking methods are computationally costly. In this paper, we propose the weak-to-strong…

计算与语言 · 计算机科学 2025-07-25 Xuandong Zhao , Xianjun Yang , Tianyu Pang , Chao Du , Lei Li , Yu-Xiang Wang , William Yang Wang

Multimodal Large Language Models (MLLMs) are vulnerable to jailbreak attacks, which can elicit harmful responses from MLLMs. Many MLLMs support multi-image inputs, inadvertently introducing new vulnerabilities due to less efforts on…

密码学与安全 · 计算机科学 2026-05-20 Wenzhuo Xu , Zhipeng Wei , Zonghao Ying , Deyue Zhang , Dongdong Yang , Xiangzheng Zhang , Quanchen Zou

The quality of open-weight language models has dramatically improved in recent years. Sharing weights greatly facilitates model adoption by enabling their use across diverse hardware and software platforms. They also allow for more open…

机器学习 · 计算机科学 2026-05-12 Keitaro Sakamoto , Pierre Ablin , Federico Danieli , Marco Cuturi

With the widespread application of large language models (LLMs) in various fields, the security challenges they face have become increasingly prominent, especially the issue of jailbreak. These attacks induce the model to generate erroneous…

密码学与安全 · 计算机科学 2025-11-12 Shuyuan Liu , Jiawei Chen , Xiao Yang , Hang Su , Zhaoxia Yin

Large Vision-Language Models (LVLMs) demonstrate exceptional performance across multimodal tasks, yet remain vulnerable to jailbreak attacks that bypass built-in safety mechanisms to elicit restricted content generation. Existing black-box…

计算与语言 · 计算机科学 2025-06-23 Lei Jiang , Zixun Zhang , Zizhou Wang , Xiaobing Sun , Zhen Li , Liangli Zhen , Xiaohua Xu

Multi-modal large language models (MLLMs), capable of processing text, images, and audio, have been widely adopted in various AI applications. However, recent MLLMs integrating images and text remain highly vulnerable to coordinated…

密码学与安全 · 计算机科学 2025-12-19 Zihao Wang , Kar Wai Fok , Vrizlynn L. L. Thing

Large Vision-Language Models (LVLMs) are vulnerable to a growing array of multimodal jailbreak attacks, necessitating defenses that are both generalizable to novel threats and efficient for practical deployment. Many current strategies fall…

密码学与安全 · 计算机科学 2026-04-21 Peichun Hua , Hao Li , Shanghao Shi , Zhiyuan Yu , Ning Zhang

Large Reasoning Models (LRMs) have recently demonstrated impressive performances across diverse domains. However, how the safety of Large Language Models (LLMs) benefits from enhanced reasoning capabilities against jailbreak queries remains…

计算与语言 · 计算机科学 2025-09-23 Junda Zhu , Lingyong Yan , Shuaiqiang Wang , Dawei Yin , Lei Sha

As multimodal reasoning improves the overall capabilities of Large Vision Language Models (LVLMs), recent studies have begun to explore safety-oriented reasoning, aiming to enhance safety awareness by analyzing potential safety risks during…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Fenghua Weng , Chaochao Lu , Xia Hu , Wenqi Shao , Wenjie Wang

While multimodal large language models (MLLMs) have achieved remarkable success in recent advancements, their susceptibility to jailbreak attacks has come to light. In such attacks, adversaries exploit carefully crafted prompts to coerce…

密码学与安全 · 计算机科学 2025-02-04 Ziyi Yin , Yuanpu Cao , Han Liu , Ting Wang , Jinghui Chen , Fenhlong Ma