English
Related papers

Related papers: Hilbert-Geo: Solving Solid Geometric Problems by N…

200 papers

Large Vision--Language Models (LVLMs) hold great promise for advancing optical remote sensing (RS) analysis, yet existing reasoning segmentation frameworks couple linguistic reasoning and pixel prediction through end-to-end supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xu Zhang , Junyao Ge , Yang Zheng , Kaitai Guo , Jimin Liang

Spatio-temporal reasoning in vision-language models requires visual representations that preserve physical geometry rather than merely semantic appearance. Recent multimodal models incorporate geometric information through structural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Deshui Miao , Xingsen Huang , Yameng Gu , Xin Li , Haijun Zhang , Ming-Hsuan Yang

We introduce GeoBuildBench, a benchmark designed to evaluate whether large language models and multimodal agents can ground informal natural-language plane geometry problems into executable geometric constructions. Unlike existing geometry…

Computation and Language · Computer Science 2026-05-14 Jinwoong Kim , Rui Yang , Huishuai Zhang

Vision Language Models (VLMs) have demonstrated remarkable performance in 2D vision and language tasks. However, their ability to reason about spatial arrangements remains limited. In this work, we introduce Spatial Region GPT (SpatialRGPT)…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 An-Chieh Cheng , Hongxu Yin , Yang Fu , Qiushan Guo , Ruihan Yang , Jan Kautz , Xiaolong Wang , Sifei Liu

Recent advancements in reinforcement learning (RL) have enhanced the reasoning abilities of large language models (LLMs), yet the impact on multimodal LLMs (MLLMs) is limited. Particularly in vision-intensive tasks like geometric reasoning,…

Computation and Language · Computer Science 2025-09-23 Guizhen Chen , Weiwen Xu , Hao Zhang , Hou Pong Chan , Deli Zhao , Anh Tuan Luu , Yu Rong

Multimodal Large Language Models (MLLMs) struggle with complex geometric reasoning, largely because "black box" outcome-based supervision fails to distinguish between lucky guesses and rigorous deduction. To address this, we introduce a…

Machine Learning · Computer Science 2026-01-09 Jianlong Chen , Daocheng Fu , Shengze Xu , Jiawei Chen , Yuan Feng , Yue Yang , Junchi Yan , Hongyuan Zha , Renqiu Xia

Multi-image reasoning and grounding require understanding complex cross-image relationships at both object levels and image levels. Current Large Visual Language Models (LVLMs) face two critical challenges: the lack of cross-image reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Lihao Zheng , Jiawei Chen , Xintian Shen , Hao Ma , Tao Wei

This paper presents GPSM4K, a comprehensive geometry multimodal dataset tailored to augment the problem-solving capabilities of Large Vision Language Models (LVLMs). GPSM4K encompasses 2157 multimodal question-answer pairs manually…

Despite advancements in Multi-modal Large Language Models (MLLMs) for scene understanding, their performance on complex spatial reasoning tasks requiring mental simulation remains significantly limited. Current methods often rely on passive…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Meng Cao , Xingyu Li , Xue Liu , Ian Reid , Xiaodan Liang

Multimodal Small-to-Medium sized Language Models (MSLMs) have demonstrated strong capabilities in integrating visual and textual information but still face significant limitations in visual comprehension and mathematical reasoning,…

Machine Learning · Computer Science 2026-01-27 Ashutosh Bajpai , Akshat Bhandari , Akshay Nambi , Tanmoy Chakraborty

Despite recent advances in multimodal reasoning, representing auxiliary geometric constructions remains a fundamental challenge for multimodal large language models (MLLMs). Such constructions are absent from the original diagram and must…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Haiying Xu , Zihan Wang , Song Dai , Zhengxuan Zhang , Kairan Dou , Xuming Hu

We propose Map2Thought, a framework that enables explicit and interpretable spatial reasoning for 3D VLMs. The framework is grounded in two key components: Metric Cognitive Map (Metric-CogMap) and Cognitive Chain-of-Thought (Cog-CoT).…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Xiangjun Gao , Zhensong Zhang , Dave Zhenyu Chen , Songcen Xu , Long Quan , Eduardo Pérez-Pellitero , Youngkyoon Jang

3D Visual Grounding (3DVG) focuses on locating objects in 3D scenes based on natural language descriptions, serving as a fundamental task for embodied AI and robotics. Recent advances in Multi-modal Large Language Models (MLLMs) have…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Beining Xu , Siting Zhu , Zhao Jin , Junxian Li , Hesheng Wang

We propose Text2Motion, a language-based planning framework enabling robots to solve sequential manipulation tasks that require long-horizon reasoning. Given a natural language instruction, our framework constructs both a task- and…

Robotics · Computer Science 2024-11-01 Kevin Lin , Christopher Agia , Toki Migimatsu , Marco Pavone , Jeannette Bohg

Multimodal reasoning remains a fundamental challenge in artificial intelligence. Despite substantial advances in text-based reasoning, even state-of-the-art models such as GPT-o3 struggle to maintain strong performance in multimodal…

Computation and Language · Computer Science 2025-09-09 Hao Liang , Ruitao Wu , Bohan Zeng , Junbo Niu , Wentao Zhang , Bin Dong

Vision-language models (VLM) excel at general understanding yet remain weak at dynamic spatial reasoning (DSR), i.e., reasoning about the evolvement of object geometry and relationship in 3D space over time, largely due to the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Shengchao Zhou , Yuxin Chen , Yuying Ge , Wei Huang , Jiehong Lin , Ying Shan , Xiaojuan Qi

Vision-Language Models (VLMs) have shown remarkable capabilities in spatial reasoning, yet they remain fundamentally limited to qualitative precision and lack the computational precision required for real-world robotics. Current approaches…

Robotics · Computer Science 2026-03-05 Yi Han , Enshen Zhou , Shanyu Rong , Jingkun An , Pengwei Wang , Zhongyuan Wang , Cheng Chi , Lu Sheng , Shanghang Zhang

In the field of multimodal chain-of-thought (CoT) reasoning, existing approaches predominantly rely on reasoning on pure language space, which inherently suffers from language bias and is largely confined to math or science domains. This…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Jiacong Wang , Zijian Kang , Haochen Wang , Haiyong Jiang , Jiawen Li , Bohong Wu , Ya Wang , Jiao Ran , Xiao Liang , Chao Feng , Jun Xiao

LLMs have demonstrated strong mathematical reasoning abilities by leveraging reinforcement learning with long chain-of-thought, yet they continue to struggle with theorem proving due to the lack of clear supervision signals when solely…

Precise spatial understanding from multi-view images remains a fundamental challenge for Multimodal Large Language Models (MLLMs), as their visual representations are predominantly semantic and lack explicit geometric grounding. While…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Chanyoung Gwak , Yoonwoo Jeong , Byungwoo Jeon , Hyunseok Lee , Jinwoo Shin , Minsu Cho