English
Related papers

Related papers: MSR-Align: Policy-Grounded Multimodal Alignment fo…

200 papers

Recent advancements in multimodal large language models (MLLMs) have shown strong understanding of driving scenes, drawing interest in their application to autonomous driving. However, high-level reasoning in safety-critical scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Seungjun Yu , Seonho Lee , Namho Kim , Jaeyo Shin , Junsung Park , Wonjeong Ryu , Raehyuk Jung , Hyunjung Shim

Recent advancements in large language models (LLMs) have accelerated progress toward artificial general intelligence, yet their potential to generate harmful content poses critical safety challenges. Existing alignment methods often…

Computation and Language · Computer Science 2025-10-08 Kehua Feng , Keyan Ding , Yuhao Wang , Menghan Li , Fanjunduo Wei , Xinda Wang , Qiang Zhang , Huajun Chen

Vision-language models (VLMs) are increasingly applied to identify unsafe or inappropriate images due to their internal ethical standards and powerful reasoning abilities. However, it is still unclear whether they can recognize various…

Cryptography and Security · Computer Science 2025-07-16 Yiting Qu , Michael Backes , Yang Zhang

Recent Multimodal Large Language Models (MLLMs) have demonstrated significant progress in perceiving and reasoning over multimodal inquiries, ushering in a new research era for foundation models. However, vision-language misalignment in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Wei-Yao Wang , Zhao Wang , Helen Suzuki , Yoshiyuki Kobayashi

Recent advancements in Vision-Language (VL) research have sparked new benchmarks for complex visual reasoning, challenging models' advanced reasoning ability. Traditional Vision-Language Models (VLMs) perform well in visual perception tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zhiyuan Li , Dongnan Liu , Chaoyi Zhang , Heng Wang , Tengfei Xue , Weidong Cai

Vision-language models (VLMs) have recently emerged as powerful representation learning systems that align visual observations with natural language concepts, offering new opportunities for semantic reasoning in safety-critical autonomous…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Ross Greer , Maitrayee Keskar , Angel Martinez-Sanchez , Parthib Roy , Shashank Shriram , Mohan Trivedi

As multimodal reasoning improves the overall capabilities of Large Vision Language Models (LVLMs), recent studies have begun to explore safety-oriented reasoning, aiming to enhance safety awareness by analyzing potential safety risks during…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Fenghua Weng , Chaochao Lu , Xia Hu , Wenqi Shao , Wenjie Wang

Multimodal large language models (MLLMs) are increasingly deployed as the core reasoning engine for web-facing systems, powering GUI agents and front-end automation that must interpret page structure, select actionable widgets, and execute…

Artificial Intelligence · Computer Science 2026-03-05 Junliang Liu , Jingyu Xiao , Wenxin Tang , Zhixian Wang , Zipeng Xie , Wenxuan Wang , Minrui Zhang , Shuanghe Yu

In the field of multimodal chain-of-thought (CoT) reasoning, existing approaches predominantly rely on reasoning on pure language space, which inherently suffers from language bias and is largely confined to math or science domains. This…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Jiacong Wang , Zijian Kang , Haochen Wang , Haiyong Jiang , Jiawen Li , Bohong Wu , Ya Wang , Jiao Ran , Xiao Liang , Chao Feng , Jun Xiao

Recent advances in Vision Language Models (VLMs) have driven significant progress in visual reasoning. However, open-source VLMs still lag behind proprietary systems, largely due to the lack of high-quality reasoning data. Existing datasets…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Honglin Lin , Zheng Liu , Yun Zhu , Chonghan Qin , Juekai Lin , Xiaoran Shang , Conghui He , Wentao Zhang , Lijun Wu

Vision-and-Language Navigation (VLN) requires agents to autonomously navigate complex environments via visual images and natural language instructions--remains highly challenging. Recent research on enhancing language-guided navigation…

Artificial Intelligence · Computer Science 2026-02-10 Changxin Huang , Lv Tang , Zhaohuan Zhan , Lisha Yu , Runhao Zeng , Zun Liu , Zhengjie Wang , Jianqiang Li

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in processing both visual and textual information. However, the critical challenge of alignment between visual and textual representations is not fully…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Dong Shu , Haiyan Zhao , Jingyu Hu , Weiru Liu , Ali Payani , Lu Cheng , Mengnan Du

The emergence of Multimodal Large Language Models (MLRMs) has enabled sophisticated visual reasoning capabilities by integrating reinforcement learning and Chain-of-Thought (CoT) supervision. However, while these enhanced reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Bingrui Sima , Linhua Cong , Wenxuan Wang , Kun He

Reasoning Language Models (RLMs) have gained traction for their ability to perform complex, multi-step reasoning tasks through mechanisms such as Chain-of-Thought (CoT) prompting or fine-tuned reasoning traces. While these capabilities…

Computation and Language · Computer Science 2025-07-04 Riccardo Cantini , Nicola Gabriele , Alessio Orsino , Domenico Talia

Large visual-language models (LVLMs) integrate aligned large language models (LLMs) with visual modules to process multimodal inputs. However, the safety mechanisms developed for text-based LLMs do not naturally extend to visual modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Shen Li , Liuyi Yao , Wujia Niu , Lan Zhang , Yaliang Li

The emergence of Vision Language Models (VLMs) has brought unprecedented advances in understanding multimodal information. The combination of textual and visual semantics in VLMs is highly complex and diverse, making the safety alignment of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Yongting Zhang , Lu Chen , Guodong Zheng , Yifeng Gao , Rui Zheng , Jinlan Fu , Zhenfei Yin , Senjie Jin , Yu Qiao , Xuanjing Huang , Feng Zhao , Tao Gui , Jing Shao

Reinforcement learning has recently improved the reasoning ability of Large Language Models and Multimodal LLMs, yet prevailing reward designs emphasise final-answer correctness and consequently tolerate process hallucinations--cases where…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yantao Li , Qiang Hui , Chenyang Yan , Kanzhi Cheng , Fang Zhao , Chao Tan , Huanling Gao , Jianbing Zhang , Kai Wang , Xinyu Dai , Shiguo Lian

Large Vision-Language Models face growing safety challenges with multimodal inputs. This paper introduces the concept of Implicit Reasoning Safety, a vulnerability in LVLMs. Benign combined inputs trigger unsafe LVLM outputs due to flawed…

Artificial Intelligence · Computer Science 2025-08-13 Wei Cai , Jian Zhao , Yuchu Jiang , Tianle Zhang , Xuelong Li

Large Vision-Language Models (LVLMs) have achieved impressive progress across various applications but remain vulnerable to malicious queries that exploit the visual modality. Existing alignment approaches typically fail to resist malicious…

Cryptography and Security · Computer Science 2025-11-18 Yitong Zhang , Jia Li , Liyi Cai , Ge Li

Multimodal large language models (MLLMs) are increasingly deployed as assistants that interact through text and images, making it crucial to evaluate contextual safety when risk depends on both the visual scene and the evolving dialogue.…

Computation and Language · Computer Science 2026-01-13 Zheyuan Liu , Dongwhi Kim , Yixin Wan , Xiangchi Yuan , Zhaoxuan Tan , Fengran Mo , Meng Jiang