English

When Safe Unimodal Inputs Collide: Optimizing Reasoning Chains for Cross-Modal Safety in Multimodal Large Language Models

Artificial Intelligence 2025-09-17 v2

Abstract

Multimodal Large Language Models (MLLMs) are susceptible to the implicit reasoning risk, wherein innocuous unimodal inputs synergistically assemble into risky multimodal data that produce harmful outputs. We attribute this vulnerability to the difficulty of MLLMs maintaining safety alignment through long-chain reasoning. To address this issue, we introduce Safe-Semantics-but-Unsafe-Interpretation (SSUI), the first dataset featuring interpretable reasoning paths tailored for such a cross-modal challenge. A novel training framework, Safety-aware Reasoning Path Optimization (SRPO), is also designed based on the SSUI dataset to align the MLLM's internal reasoning process with human safety values. Experimental results show that our SRPO-trained models achieve state-of-the-art results on key safety benchmarks, including the proposed Reasoning Path Benchmark (RSBench), significantly outperforming both open-source and top-tier commercial MLLMs.

Keywords

Cite

@article{arxiv.2509.12060,
  title  = {When Safe Unimodal Inputs Collide: Optimizing Reasoning Chains for Cross-Modal Safety in Multimodal Large Language Models},
  author = {Wei Cai and Shujuan Liu and Jian Zhao and Ziyan Shi and Yusheng Zhao and Yuchen Yuan and Tianle Zhang and Chi Zhang and Xuelong Li},
  journal= {arXiv preprint arXiv:2509.12060},
  year   = {2025}
}
R2 v1 2026-07-01T05:37:08.570Z