中文
相关论文

相关论文: When Safe Unimodal Inputs Collide: Optimizing Reas…

200 篇论文

Multimodal Large Language Models (MLLMs) pose critical safety challenges, as they are susceptible not only to adversarial attacks such as jailbreaking but also to inadvertently generating harmful content for benign users. While internal…

机器学习 · 计算机科学 2026-03-17 Ming Wen , Kun Yang , Xin Chen , Jingyu Zhang , Dingding Han , Shiwen Cui , Yuedong Xu

While safety alignment for Multimodal Large Language Models (MLLMs) has gained significant attention, current paradigms primarily target malicious intent or situational violations. We propose shifting the safety frontier toward…

人工智能 · 计算机科学 2026-03-11 Ming Wen , Kun Yang , Jingyu Zhang , Yuxuan Liu , shiwen cui , Shouling Ji , Xingjun Ma

Attracted by the impressive power of Multimodal Large Language Models (MLLMs), the public is increasingly utilizing them to improve the efficiency of daily work. Nonetheless, the vulnerabilities of MLLMs to unsafe instructions bring huge…

计算机视觉与模式识别 · 计算机科学 2024-06-21 Xin Liu , Yichen Zhu , Yunshi Lan , Chao Yang , Yu Qiao

Multimodal Large Language Models (MLLMs) are widely used in various fields due to their powerful cross-modal comprehension and generation capabilities. However, more modalities bring more vulnerabilities to being utilized for jailbreak…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Shiji Zhao , Shukun Xiong , Yao Huang , Yan Jin , Zhenyu Wu , Jiyang Guan , Ranjie Duan , Jialing Tao , Hui Xue , Xingxing Wei

As large language models (LLMs) are increasingly integrated into numerous applications across various domains, LLMs' safety becomes a critical concern for both application developers and intended users. Currently, great efforts have been…

密码学与安全 · 计算机科学 2025-09-30 Haoran Li , Yulin Chen , Jingru Zeng , Hao Peng , Huihao Jing , Wenbin Hu , Xi Yang , Ziqian Zeng , Sirui Han , Yangqiu Song

Powered by remarkable advancements in Large Language Models (LLMs), Multimodal Large Language Models (MLLMs) demonstrate impressive capabilities in manifold tasks. However, the practical application scenarios of MLLMs are intricate,…

Multi-modal large language models (MLLMs) have made significant progress, yet their safety alignment remains limited. Typically, current open-source MLLMs rely on the alignment inherited from their language module to avoid harmful…

密码学与安全 · 计算机科学 2025-04-15 Yanbo Wang , Jiyang Guan , Jian Liang , Ran He

Recent advancements in multimodal large language models (MLLMs) have shown strong understanding of driving scenes, drawing interest in their application to autonomous driving. However, high-level reasoning in safety-critical scenarios,…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Seungjun Yu , Seonho Lee , Namho Kim , Jaeyo Shin , Junsung Park , Wonjeong Ryu , Raehyuk Jung , Hyunjung Shim

Traditional approaches to safety event analysis in autonomous systems have relied on complex machine learning models and extensive datasets for high accuracy and reliability. However, the advent of Multimodal Large Language Models (MLLMs)…

计算机视觉与模式识别 · 计算机科学 2024-06-21 Mohammad Abu Tami , Huthaifa I. Ashqar , Mohammed Elhenawy

Large reasoning models (LRMs) extend large language models by generating explicit chain-of-thought (CoT) reasoning, significantly improving mathematical and logical problem solving. However, this explicit reasoning process also introduces…

计算与语言 · 计算机科学 2025-12-02 Jinghan Jia , Nathalie Baracaldo , Sijia Liu

Recently, multimodal large language models (MLLMs) have emerged as a unified paradigm for language and image generation. Compared with diffusion models, MLLMs possess a much stronger capability for semantic understanding, enabling them to…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Ye Leng , Junjie Chu , Mingjie Li , Chenhao Lin , Chao Shen , Michael Backes , Yun Shen , Yang Zhang

The current expressway operation relies on rule-based and isolated models, which limits the ability to jointly analyze knowledge across different systems. Meanwhile, Large Language Models (LLMs) are increasingly applied in intelligent…

While large language models (LLMs) exhibit remarkable capabilities across a wide range of tasks, they pose potential safety concerns, such as the ``jailbreak'' problem, wherein malicious instructions can manipulate LLMs to exhibit…

计算与语言 · 计算机科学 2024-03-05 Yue Deng , Wenxuan Zhang , Sinno Jialin Pan , Lidong Bing

Multimodal large language models (MLLMs) have emerged as powerful tools for computational pathology, offering unprecedented opportunities to integrate pathological images with language context for comprehensive diagnostic analysis. These…

As the development of Large Models (LMs) progresses rapidly, their safety is also a priority. In current Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) safety workflow, evaluation, diagnosis, and alignment are…

Multi-modal Large Language Models (MLLMs) have achieved remarkable performance across a wide range of visual reasoning tasks, yet their vulnerability to safety risks remains a pressing concern. While prior research primarily focuses on…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Ce Zhang , Jinxi He , Junyi He , Katia Sycara , Yaqi Xie

With the rapid development of multimodal large language models (MLLMs), they are increasingly deployed as autonomous computer-use agents capable of accomplishing complex computer tasks. However, a pressing issue arises: Can the safety risk…

人工智能 · 计算机科学 2025-06-23 Jingyi Yang , Shuai Shao , Dongrui Liu , Jing Shao

Recent advances in Multi-Modal Large Language Models (MLLMs) have enabled unified processing of language, vision, and structured inputs, opening the door to complex tasks such as logical deduction, spatial reasoning, and scientific…

人工智能 · 计算机科学 2025-07-03 Guiyao Tie , Xueyang Zhou , Tianhe Gu , Ruihang Zhang , Chaoran Hu , Sizhe Zhang , Mengqu Sun , Yan Zhang , Pan Zhou , Lichao Sun

Multimodal large language models (MLLMs) have shown great potential in perception and interpretation tasks, but their capabilities in predictive reasoning remain under-explored. To address this gap, we introduce a novel benchmark that…

计算机视觉与模式识别 · 计算机科学 2023-10-23 Mingwei Zhu , Leigang Sha , Yu Shu , Kangjia Zhao , Tiancheng Zhao , Jianwei Yin

Human drivers possess spatial and causal intelligence, enabling them to perceive driving scenarios, anticipate hazards, and react to dynamic environments. In contrast, autonomous vehicles lack these abilities, making it challenging to…

机器人学 · 计算机科学 2025-09-12 Shucheng Huang , Freda Shi , Chen Sun , Jiaming Zhong , Minghao Ning , Yufeng Yang , Yukun Lu , Hong Wang , Amir Khajepour