中文
相关论文

相关论文: MIRAGE: Multimodal Immersive Reasoning and Guided …

200 篇论文

Multimodal Large Language Models (MLLMs) excel at structural reasoning yet suffer from a sharp logical brittleness in structural consistency. We term this phenomenon Structural Cognitive Overload (SCO), a byproduct of the contention between…

人工智能 · 计算机科学 2026-05-26 Yang Luo , Xinran Liu , Tiantian Ji , Zhiyi Yin , Lingyun Peng , Shuyu Li

Large Language Model (LLM) agents have demonstrated remarkable proficiency in learned tasks, yet they often struggle to adapt to non-stationary environments with feedback. While In-Context Learning and external memory offer some…

人工智能 · 计算机科学 2026-03-05 Lu Yang , Zelai Xu , Minyang Xie , Jiaxuan Gao , Zhao Shok , Yu Wang , Yi Wu

Large Audio Language Models (LALMs) have significantly advanced audio understanding but introduce critical security risks, particularly through audio jailbreaks. While prior work has focused on English-centric attacks, we expose a far more…

声音 · 计算机科学 2025-04-03 Jaechul Roh , Virat Shejwalkar , Amir Houmansadr

Large Language Model (LLM) jailbreak refers to a type of attack aimed to bypass the safeguard of an LLM to generate contents that are inconsistent with the safe usage guidelines. Based on the insights from the self-attention computation…

密码学与安全 · 计算机科学 2025-02-10 Zhilong Wang , Haizhou Wang , Nanqing Luo , Lan Zhang , Xiaoyan Sun , Yebo Cao , Peng Liu

Multimodal large language models (MLLMs) are gaining increasing attention. Due to the heterogeneity of their input features, they face significant challenges in terms of jailbreak defenses. Current defense methods rely on costly fine-tuning…

人工智能 · 计算机科学 2026-05-13 Xinyi Zeng , Xue Yang , Jingyuan Zhang , Huanqian Yan , Xiang Chen , Kaiwen Wei , Hankun Kang , Yu Tian

Despite the implementation of safety alignment strategies, large language models (LLMs) remain vulnerable to jailbreak attacks, which undermine these safety guardrails and pose significant security threats. Some defenses have been proposed…

密码学与安全 · 计算机科学 2025-02-12 Shenyi Zhang , Yuchen Zhai , Keyan Guo , Hongxin Hu , Shengnan Guo , Zheng Fang , Lingchen Zhao , Chao Shen , Cong Wang , Qian Wang

Think-with-image reasoning is emerging as a new inference paradigm for large vision-language models, but its safety implications remain poorly understood. Existing systems already span multiple process designs, including direct response…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Yuan Tian , Bing Hu , Fang Wu , Xiaomin Li , Binghang Lu , Neil Zhenqiang Gong

The proliferation of jailbreak attacks against large language models (LLMs) highlights the need for robust security measures. However, in multi-round dialogues, malicious intentions may be hidden in interactions, leading LLMs to be more…

密码学与安全 · 计算机科学 2025-05-26 Weiyang Guo , Jing Li , Wenya Wang , YU LI , Daojing He , Jun Yu , Min Zhang

Large Language Models (LLMs) are susceptible to Jailbreaking attacks, which aim to extract harmful information by subtly modifying the attack query. As defense mechanisms evolve, directly obtaining harmful information becomes increasingly…

机器学习 · 计算机科学 2024-10-03 Yixin Cheng , Markos Georgopoulos , Volkan Cevher , Grigorios G. Chrysos

Multimodal Large Language Models (MLLMs) bridge the gap between visual and textual data, enabling a range of advanced applications. However, complex internal interactions among visual elements and their alignment with text can introduce…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Zuopeng Yang , Jiluan Fan , Anli Yan , Erdun Gao , Xin Lin , Tao Li , Kanghua Mo , Changyu Dong

Large Vision-Language Models (LVLMs) have achieved impressive performance across multimodal understanding and reasoning tasks, yet their internal safety mechanisms remain opaque and poorly controlled. In this work, we present a…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Jinhu Fu , Yihang Lou , Qingyi Si , Shudong Zhang , Yan Bai , Sen Su

Agentic methods have emerged as a powerful and autonomous paradigm that enhances reasoning, collaboration, and adaptive control, enabling systems to coordinate and independently solve complex tasks. We extend this paradigm to safety…

人工智能 · 计算机科学 2025-10-30 Juan Ren , Mark Dras , Usman Naseem

Ensuring the verifiability of model answers is a fundamental challenge for retrieval-augmented generation (RAG) in the question answering (QA) domain. Recently, self-citation prompting was proposed to make large language models (LLMs)…

计算与语言 · 计算机科学 2024-12-02 Jirui Qi , Gabriele Sarti , Raquel Fernández , Arianna Bisazza

While Multimodal Large Language Models (MLLMs) show remarkable capabilities, their safety alignments are susceptible to jailbreak attacks. Existing attack methods typically focus on text-image interplay, treating the visual modality as a…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Yuan Xiong , Ziqi Miao , Lijun Li , Chen Qian , Jie Li , Jing Shao

Multimodal Large Language Models (MLLMs) have showcased impressive performance in a variety of multimodal tasks. On the other hand, the integration of additional image modality may allow the malicious users to inject harmful content inside…

密码学与安全 · 计算机科学 2025-04-23 Yulin Chen , Haoran Li , Yirui Zhang , Zihao Zheng , Yangqiu Song , Bryan Hooi

Large Reasoning Models (LRMs) have recently demonstrated impressive performances across diverse domains. However, how the safety of Large Language Models (LLMs) benefits from enhanced reasoning capabilities against jailbreak queries remains…

计算与语言 · 计算机科学 2025-09-23 Junda Zhu , Lingyong Yan , Shuaiqiang Wang , Dawei Yin , Lei Sha

While sequential reasoning enhances the capability of Vision-Language Models (VLMs) to execute complex multimodal tasks, their reliability in grounding these reasoning chains within actual visual evidence remains insufficiently explored. We…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Rory Driscoll , Alexandros Christoforos , Chadbourne Davis

As LLMs become more common, non-expert users can pose risks, prompting extensive research into jailbreak attacks. However, most existing black-box jailbreak attacks rely on hand-crafted heuristics or narrow search spaces, which limit…

密码学与安全 · 计算机科学 2025-11-21 Zhen Sun , Zongmin Zhang , Deqi Liang , Han Sun , Yule Liu , Yun Shen , Xiangshan Gao , Yilong Yang , Shuai Liu , Yutao Yue , Xinlei He

Extensive work has been devoted to improving the safety mechanism of Large Language Models (LLMs). However, LLMs still tend to generate harmful responses when faced with malicious instructions, a phenomenon referred to as "Jailbreak…

计算与语言 · 计算机科学 2024-02-26 Yanrui Du , Sendong Zhao , Ming Ma , Yuhan Chen , Bing Qin

Large language models (LLMs) remain vulnerable to jailbreak attacks that bypass safety alignment and elicit harmful responses. A growing body of work shows that contextual priming, where earlier turns covertly bias later replies,…

计算与语言 · 计算机科学 2026-05-05 Mario Rodríguez Béjar , Francisco J. Cortés-Delgado , S. Braghin , Jose L. Hernández-Ramos