English
Related papers

Related papers: Struct2D: A Perception-Guided Framework for Spatia…

200 papers

Multimodal Large Language Models (MLLMs) demonstrate exceptional semantic reasoning but struggle with 3D spatial perception when restricted to pure RGB inputs. Despite leveraging implicit geometric priors from 3D reconstruction models,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Jiaxin Zhang , Junjun Jiang , Haijie Li , Youyu Chen , Kui Jiang , Dave Zhenyu Chen

Advancing towards artificial superintelligence requires rich and intelligent perceptual capabilities. A critical frontier in this pursuit is overcoming the limited spatial understanding of Multimodal Large Language Models (MLLMs), where…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Ruiheng Liu , Haihong Hao , Mingfei Han , Xin Gu , Kecheng Zhang , Changlin Li , Xiaojun Chang

We propose cognitive prompting as a novel approach to guide problem-solving in large language models (LLMs) through structured, human-like cognitive operations, such as goal clarification, decomposition, filtering, abstraction, and pattern…

Computation and Language · Computer Science 2024-12-03 Oliver Kramer , Jill Baumann

Spatial relation reasoning is a crucial task for multimodal large language models (MLLMs) to understand the objective world. However, current benchmarks have issues like relying on bounding boxes, ignoring perspective substitutions, or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Jingping Liu , Ziyan Liu , Zhedong Cen , Yan Zhou , Yinan Zou , Weiyan Zhang , Haiyun Jiang , Tong Ruan

Recent advancements in Spatial Intelligence (SI) have predominantly relied on Vision-Language Models (VLMs), yet a critical question remains: does spatial understanding originate from visual encoders or the fundamental reasoning backbone?…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Zhongbin Guo , Zhen Yang , Yushan Li , Xinyue Zhang , Wenyu Gao , Jiacheng Wang , Chengzhi Li , Xiangrui Liu , Ping Jian

Chain-of-Thought (CoT) reasoning has proven effective in natural language tasks but remains underexplored in multimodal alignment. This study investigates its integration into 3D vision-language learning by embedding structured reasoning…

Computation and Language · Computer Science 2025-03-18 Yanjun Chen , Yirong Sun , Xinghao Chen , Jian Wang , Xiaoyu Shen , Wenjie Li , Wei Zhang

Spatiotemporal reasoning is a fundamental capability for artificial intelligence (AI) in soft tissue surgery, paving the way for intelligent assistive systems and autonomous robotics. While 2D vision-language models show increasing promise…

Embodied intelligence fundamentally requires a capability to determine where to act in 3D space. We formalize this requirement as embodied localization -- the problem of predicting executable 3D points conditioned on visual observations and…

Robotics · Computer Science 2026-03-31 Qiming Zhu , Zhirui Fang , Tianming Zhang , Chuanxiu Liu , Xiaoke Jiang , Lei Zhang

A navigable agent needs to understand both high-level semantic instructions and precise spatial perceptions. Building navigation agents centered on Multimodal Large Language Models (MLLMs) demonstrates a promising solution due to their…

Robotics · Computer Science 2026-02-18 Zerui Li , Hongpei Zheng , Fangguo Zhao , Aidan Chan , Jian Zhou , Sihao Lin , Shijie Li , Qi Wu

Reasoning lies at the heart of intelligence, shaping the ability to make decisions, draw conclusions, and generalize across domains. In artificial intelligence, as systems increasingly operate in open, uncertain, and multimodal…

This paper addresses the high demand in advanced intelligent robot navigation for a more holistic understanding of spatial environments, by introducing a novel system that harnesses the capabilities of Large Language Models (LLMs) to…

Robotics · Computer Science 2025-03-20 Yao Cheng , Zhe Han , Fengyang Jiang , Huaizhen Wang , Fengyu Zhou , Qingshan Yin , Lei Wei

With the current surge in spatial reasoning explorations, researchers have made significant progress in understanding indoor scenes, but still struggle with diverse applications such as robotics and autonomous driving. This paper aims to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Peiwen Sun , Shiqiang Lang , Dongming Wu , Yi Ding , Kaituo Feng , Huadai Liu , Zhen Ye , Rui Liu , Yun-Hui Liu , Jianan Wang , Xiangyu Yue

We present Team asdfo123's submission to the LLMSR@XLLM25 shared task, which evaluates large language models on producing fine-grained, controllable, and interpretable reasoning processes. Systems must extract all problem conditions,…

Computation and Language · Computer Science 2025-05-20 Xinye Li , Mingqi Wan , Dianbo Sui

When reading long-form text, human cognition is complex and structurized. While large language models (LLMs) process input contexts through a causal and sequential perspective, this approach can potentially limit their ability to handle…

Computation and Language · Computer Science 2024-11-01 Kai Liu , Zhihang Fu , Chao Chen , Wei Zhang , Rongxin Jiang , Fan Zhou , Yaowu Chen , Yue Wu , Jieping Ye

Recent advancements in multi-modal large language models (MLLMs) have shown strong potential for 3D scene understanding. However, existing methods struggle with fine-grained object grounding and contextual reasoning, limiting their ability…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Haifeng Huang , Yilun Chen , Zehan Wang , Jiangmiao Pang , Zhou Zhao

Large language models (LLMs) are becoming attractive as few-shot reasoners to solve Natural Language (NL)-related tasks. However, the understanding of their capability to process structured data like tables remains an under-explored area.…

Computation and Language · Computer Science 2024-07-18 Yuan Sui , Mengyu Zhou , Mingjie Zhou , Shi Han , Dongmei Zhang

While diffusion models have shown exceptional capabilities in aesthetic image synthesis, they often struggle with complex spatial understanding and reasoning. Existing approaches resort to Multimodal Large Language Models (MLLMs) to enhance…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Wei Chen , Yancheng Long , Mingqiao Liu , Haojie Ding , Yankai Yang , Hongyang Wei , Yi-Fan Zhang , Bin Wen , Fan Yang , Tingting Gao , Han Li , Long Chen

Understanding 3D point clouds through language remains a fundamental challenge in computer graphics and visual computing, due to the irregular structure of point cloud data and the lack of explicit reasoning in existing 3D multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Chaoqi Chen , Qile Xu , Wenjun Zhou , Hui Huang

Vision-language models (VLMs) achieve strong performance on spatial reasoning benchmarks, yet it remains unclear whether this reflects structured 3D understanding or reliance on statistical shortcuts in natural images. We introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Cheolhong Min , Jaeyun Jung , Daeun Lee , Hyeonseong Jeon , Yu Su , Jonathan Tremblay , Chan Hee Song , Jaesik Park

Spatial reasoning, the ability to ground language in 3D understanding, remains a persistent challenge for Vision-Language Models (VLMs). We identify two fundamental bottlenecks: inadequate 3D understanding capabilities stemming from…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Yejie Guo , Yunzhong Hou , Wufei Ma , Meng Tang , Ming-Hsuan Yang
‹ Prev 1 8 9 10 Next ›