English
Related papers

Related papers: SpatialThinker: Reinforcing 3D Reasoning in Multim…

200 papers

Spatial reasoning in large-scale 3D environments such as warehouses remains a significant challenge for vision-language systems due to scene clutter, occlusions, and the need for precise spatial understanding. Existing models often struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Tanner Muturi , Blessing Agyei Kyem , Joshua Kofi Asamoah , Neema Jakisa Owor , Richard Dyzinela , Andrews Danyo , Yaw Adu-Gyamfi , Armstrong Aboah

Large Language Models (LLMs) demonstrate transformative potential, yet their reasoning remains inconsistent and unreliable. Reinforcement learning (RL)-based fine-tuning is a key mechanism for improvement, but its effectiveness is…

Machine Learning · Computer Science 2026-02-11 Pei-Chi Pan , Yingbin Liang , Sen Lin

Building on the success of text-based reasoning models like DeepSeek-R1, extending these capabilities to multimodal reasoning holds great promise. While recent works have attempted to adapt DeepSeek-R1-style reinforcement learning (RL)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jie Yang , Feipeng Ma , Zitian Wang , Dacheng Yin , Kang Rong , Fengyun Rao , Ruimao Zhang

Multimodal large language models (MLLMs) have shown great potential in perception and interpretation tasks, but their capabilities in predictive reasoning remain under-explored. To address this gap, we introduce a novel benchmark that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Mingwei Zhu , Leigang Sha , Yu Shu , Kangjia Zhao , Tiancheng Zhao , Jianwei Yin

While Large Language Models (LLMs) demonstrate exceptional performance in surface-level text generation, their nature in handling complex multi-step reasoning tasks often remains one of ``statistical fitting'' rather than systematic logical…

Machine Learning · Computer Science 2026-01-27 Lianlei Shan , Han Chen , Yixuan Wang , Zhenjie Liu , Wei Li

Reliable spatial reasoning remains a core bottleneck for vision-language models (VLMs). Existing mainstream training paradigms for spatial reasoning largely rely on outcome alignment or process imitation, lacking explicit constraints on the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jiangyang Li , Cong Wan , Changjie Wu , Songlin Dong , Lingjun Zhang , Linzhe Shi , Xu Wang , Zhiheng Ma , Hang Zhang , Mu Xu , Yihong Gong

Large language models (LLMs) have shown emerging potential in spatiotemporal reasoning, making them promising candidates for building urban agents that support diverse urban downstream applications. Despite these benefits, existing studies…

Artificial Intelligence · Computer Science 2025-05-26 Siqi Lai , Yansong Ning , Zirui Yuan , Zhixi Chen , Hao Liu

Emotional information in speech plays a unique role in multimodal perception. However, current Speech Large Language Models (SpeechLLMs), similar to conventional speech emotion recognition (SER) systems, still treat emotion understanding as…

Sound · Computer Science 2026-03-17 Dingdong Wang , Shujie Liu , Tianhua Zhang , Youjun Chen , Jinyu Li , Helen Meng

Multimodal language models (MLLMs) are increasingly being applied in real-world environments, necessitating their ability to interpret 3D spaces and comprehend temporal dynamics. Current methods often rely on specialized architectural…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Benlin Liu , Yuhao Dong , Yiqin Wang , Zixian Ma , Yansong Tang , Luming Tang , Yongming Rao , Wei-Chiu Ma , Ranjay Krishna

Large vision-language models (VLMs) show strong multimodal understanding but still struggle with 3D spatial reasoning, such as distance estimation, size comparison, and cross-view consistency. Existing 3D-aware methods either depend on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Ruosen Zhao , Zhikang Zhang , Jialei Xu , Jiahao Chang , Dong Chen , Lingyun Li , Weijian Sun , Zizhuang Wei

Large Language Models (LLMs) are increasingly adopted as evaluators, offering a scalable alternative to human annotation. However, existing supervised fine-tuning (SFT) approaches often fall short in domains that demand complex reasoning.…

Computation and Language · Computer Science 2025-11-04 Nuo Chen , Zhiyuan Hu , Qingyun Zou , Jiaying Wu , Qian Wang , Bryan Hooi , Bingsheng He

The rapid advancement of Large Multimodal Models (LMMs) for 2D images and videos has motivated extending these models to understand 3D scenes, aiming for human-like visual-spatial intelligence. Nevertheless, achieving deep spatial…

While recent Multimodal Large Language Models (MLLMs) have attained significant strides in multimodal reasoning, their reasoning processes remain predominantly text-centric, leading to suboptimal performance in complex long-horizon,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Zefeng He , Xiaoye Qu , Yafu Li , Tong Zhu , Siyuan Huang , Yu Cheng

Humans excel at spatial-temporal reasoning, effortlessly interpreting dynamic visual events from an egocentric viewpoint. However, whether multimodal large language models (MLLMs) can similarly understand the 4D world remains uncertain.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Peiran Wu , Yunze Liu , Miao Liu , Junxiao Shen

Recent advances in large reasoning models have been driven by reinforcement learning and test-time scaling, accompanied by growing interest in latent rather than purely textual reasoning. However, existing latent reasoning methods lack…

Computation and Language · Computer Science 2026-04-21 Shengmin Piao , Sanghyun Park

Vision-Language Models (VLMs) are known to struggle with spatial reasoning and visual alignment. To help overcome these limitations, we introduce iVISPAR, an interactive multimodal benchmark designed to evaluate the spatial reasoning…

Computation and Language · Computer Science 2025-10-01 Julius Mayer , Mohamad Ballout , Serwan Jassim , Farbod Nosrat Nezami , Elia Bruni

While Vision-Language Models (VLMs) exhibit exceptional 2D visual understanding, their ability to comprehend and reason about 3D space--a cornerstone of spatial intelligence--remains superficial. Current methodologies attempt to bridge this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Haoyi Jiang , Liu Liu , Xinjie Wang , Yonghao He , Wei Sui , Zhizhong Su , Wenyu Liu , Xinggang Wang

Multimodal Large Language Models (MLLMs) have gained significant traction for their ability to process diverse input data types and generate coherent, contextually relevant outputs across various applications. While supervised fine-tuning…

Machine Learning · Computer Science 2025-03-31 Zhiyuan Liu , Yuting Zhang , Feng Liu , Changwang Zhang , Ying Sun , Jun Wang

Vision-Language Models (VLMs) have been increasingly applied in real-world scenarios due to their outstanding understanding and reasoning capabilities. Although VLMs have already demonstrated impressive capabilities in common visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Yuechen Xie , Xiaoyan Zhang , Yicheng Shan , Hao Zhu , Rui Tang , Rong Wei , Mingli Song , Yuanyu Wan , Jie Song

As spatial intelligence becomes an increasingly important capability for foundation models, it remains unclear whether large language models' (LLMs) performance on spatial reasoning benchmarks reflects structured internal spatial…

Computation and Language · Computer Science 2026-03-30 Jiyuan An , Liner Yang , Mengyan Wang , Luming Lu , Weihua An , Erhong Yang