English
Related papers

Related papers: Multimodal Latent Reasoning via Hierarchical Visua…

200 papers

Multimodal Large Language Models (MLLMs) strive to achieve a profound, human-like understanding of and interaction with the physical world, but often exhibit a shallow and incoherent integration when acquiring information (Perception) and…

Multimodal large language models (MLLMs) have shown strong performance on offline video understanding, but most are limited to offline inference or have weak online reasoning, making multi-turn interaction over continuously arriving video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Lu Wang , Zhuoran Jin , Yupu Hao , Yubo Chen , Kang Liu , Yulong Ao , Jun Zhao

Latent reasoning has been recently proposed as a reasoning paradigm and performs multi-step reasoning through generating steps in the latent space instead of the textual space. This paradigm enables reasoning beyond discrete language tokens…

Artificial Intelligence · Computer Science 2026-02-27 Yingqian Cui , Zhenwei Dai , Bing He , Zhan Shi , Hui Liu , Rui Sun , Zhiji Liu , Yue Xing , Jiliang Tang , Benoit Dumoulin

Healthcare robotics requires robust multimodal perception and reasoning to ensure safety in dynamic clinical environments. Current Vision-Language Models (VLMs) demonstrate strong general-purpose capabilities but remain limited in temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Saurav Jha , Stefan K. Ehrlich

Recent multimodal large language models (MLLMs) have advanced video understanding, yet most still "think about videos" ie once a video is encoded, reasoning unfolds entirely in text, treating visual input as a static context. This passive…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Hanoona Rasheed , Mohammed Zumri , Muhammad Maaz , Ming-Hsuan Yang , Fahad Shahbaz Khan , Salman Khan

Multimodal large language models (MLLMs) still struggle with complex reasoning tasks in Visual Question Answering (VQA). While current methods have advanced by incorporating visual prompts, our study uncovers critical limitations: these…

Computation and Language · Computer Science 2025-06-03 Songtao Jiang , Chenyi Zhou , Yan Zhang , Yeying Jin , Zuozhu Liu

In recent years, multimodal large language models (MLLMs) have made significant strides by training on vast high-quality image-text datasets, enabling them to generally understand images well. However, the inherent difficulty in explicitly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuanze Lin , Yunsheng Li , Dongdong Chen , Weijian Xu , Ronald Clark , Philip Torr , Lu Yuan

The current remote sensing image analysis task is increasingly evolving from traditional object recognition to complex intelligence reasoning, which places higher requirements on the model's reasoning ability and the flexibility of tool…

Artificial Intelligence · Computer Science 2025-12-04 Chujie Wang , Zhiyuan Luo , Ruiqi Liu , Can Ran , Shenghua Fan , Xi Chen , Chu He

Spatial reasoning -- the ability to perceive and reason about relationships in space -- advances vision-language models (VLMs) from visual perception toward spatial semantic understanding. Existing approaches either revisit local image…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Weijian Ma , Shizhao Sun , Tianyu Yu , Ruiyu Wang , Tat-Seng Chua , Jiang Bian

Chain-of-thought (CoT) reasoning is critical for improving the interpretability and reliability of Large Vision-Language Models (LVLMs). However, existing training algorithms such as SFT, PPO, and GRPO may not generalize well across unseen…

Artificial Intelligence · Computer Science 2025-10-31 Guohao Sun , Hang Hua , Jian Wang , Jiebo Luo , Sohail Dianat , Majid Rabbani , Raghuveer Rao , Zhiqiang Tao

Multimodal Large Language Models (MLLMs) have shown promise in visual-textual reasoning, with Multimodal Chain-of-Thought (MCoT) prompting significantly enhancing interpretability. However, existing MCoT methods rely on rationale-rich…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yiwen Jiang , Deval Mehta , Siyuan Yan , Yaling Shen , Zimu Wang , Zongyuan Ge

Recently, Multimodal Large Language Models (MLLMs) have demonstrated significant potential in complex visual tasks through the integration of Chain-of-Thought (CoT) reasoning. However, in Video Question Answering, extended thinking…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Xiaokun Sun , Yubo Wang , Haoyu Cao , Linli Xu

Recent advancements in Large Language Models (LLMs) have demonstrated enhanced reasoning capabilities, evolving from Chain-of-Thought (CoT) prompting to advanced, product-oriented solutions like OpenAI o1. During our re-implementation of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Hai-Long Sun , Zhun Sun , Houwen Peng , Han-Jia Ye

Recently, slow-thinking reasoning systems, built upon large language models (LLMs), have garnered widespread attention by scaling the thinking time during inference. There is also growing interest in adapting this capability to multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Yifan Du , Zikang Liu , Yifan Li , Wayne Xin Zhao , Yuqi Huo , Bingning Wang , Weipeng Chen , Zheng Liu , Zhongyuan Wang , Ji-Rong Wen

Current multimodal large lanauge models possess strong perceptual and reasoning capabilities, however high computational and memory requirements make them difficult to deploy directly on on-device environments. While small-parameter models…

Spatial reasoning is a cornerstone capability for intelligent systems to perceive and interact with the physical world. However, multimodal large language models (MLLMs) frequently suffer from hallucinations and imprecision when parsing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Shi-Yu Tian , Zhi Zhou , Kun-Yang Yu , Ming Yang , Yang Chen , Ziqiao Shang , Lan-Zhe Guo , Yu-Feng Li

Multimodal Large Language Models (MLLMs) often struggle to accurately perceive fine-grained visual details, especially when targets are tiny or visually subtle. This challenge can be addressed through semantic-visual information fusion,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yuxiang Shen , Hailong Huang , Zhenkun Gao , Xueheng Li , Man Zhou , Chengjun Xie , Haoxuan Che , Xuanhua He , Jie Zhang

Multimodal Large Reasoning Models (MLRMs) have achieved remarkable strides in visual reasoning through test time compute scaling, yet long chain reasoning remains prone to hallucinations. We identify a concerning phenomenon termed the…

Artificial Intelligence · Computer Science 2026-05-29 Zhe Qian , Yanbiao Ma , Zhuohan Ouyang , Zhonghua Wang , Zhongxing Xu , Fei Luo , Xinyu Liu , Zongyuan Ge , Yike Guo , Jungong Han

Multi-modal Large Language Models (MLLMs) have demonstrated remarkable capabilities in understanding and generating content across various modalities, such as images and text. However, their interpretability remains a challenge, hindering…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Loris Giulivi , Giacomo Boracchi

Multimodal Large Language Models (MLLMs) achieve strong multimodal reasoning performance, yet we identify a recurring failure mode in long-form generation: as outputs grow longer, models progressively drift away from image evidence and fall…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Shuai Lv , Chang Liu , Feng Tang , Yujie Yuan , Aojun Zhou , Kui Zhang , Xi Yang , Yangqiu Song