English
Related papers

Related papers: SpatialEvo: Self-Evolving Spatial Intelligence via…

200 papers

Recent advancements in foundation models have improved autonomous tool usage and reasoning, but their capabilities in map-based reasoning remain underexplored. To address this, we introduce MapEval, a benchmark designed to assess foundation…

We present MetaSpatial, the first reinforcement learning (RL)-based framework designed to enhance 3D spatial reasoning in vision-language models (VLMs), enabling real-time 3D scene generation without the need for hard-coded optimizations.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Zhenyu Pan , Han Liu

Although large multimodal models (LMMs) have demonstrated remarkable capabilities in visual scene interpretation and reasoning, their capacity for complex and precise 3-dimensional spatial reasoning remains uncertain. Existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Xingrui Wang , Wufei Ma , Tiezheng Zhang , Celso M de Melo , Jieneng Chen , Alan Yuille

Vision-language models solve geometry problems with rising accuracy, yet their intermediate states remain latent and unverifiable: a relation expressed in textual reasoning or drawing code carries no guarantee that a constraint-satisfying…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Juncheng Hu , Jiawei Du , Xin Zhang , Joey Tianyi Zhou

Geometry is central to PDE-governed systems, motivating shape optimization and inversion. Classical pipelines conduct costly forward simulation with geometry processing, requiring substantial expert effort. Neural surrogates accelerate…

Machine Learning · Computer Science 2026-05-15 Guoze Sun , Tianya Miao , Haoyang Huang , Huaguan Chen , Han Wan , Rui Zhang , Hao Sun

Geospatial modeling provides critical solutions for pressing global challenges such as sustainability and climate change. Existing large language model (LLM)-based algorithm discovery frameworks, such as AlphaEvolve, excel at evolving…

Artificial Intelligence · Computer Science 2025-09-29 Peng Luo , Xiayin Lou , Yu Zheng , Zhuo Zheng , Stefano Ermon

Despite recent advances in multimodal reasoning, representing auxiliary geometric constructions remains a fundamental challenge for multimodal large language models (MLLMs). Such constructions are absent from the original diagram and must…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Haiying Xu , Zihan Wang , Song Dai , Zhengxuan Zhang , Kairan Dou , Xuming Hu

While current multimodal models can answer questions based on 2D images, they lack intrinsic 3D object perception, limiting their ability to comprehend spatial relationships and depth cues in 3D scenes. In this work, we propose N3D-VLM, a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Yuxin Wang , Lei Ke , Boqiang Zhang , Tianyuan Qu , Hanxun Yu , Zhenpeng Huang , Meng Yu , Dan Xu , Dong Yu

This study investigates the spatial reasoning capabilities of vision-language models (VLMs) through Chain-of-Thought (CoT) prompting and reinforcement learning. We begin by evaluating the impact of different prompting strategies and find…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Binbin Ji , Siddharth Agrawal , Qiance Tang , Yvonne Wu

We introduce Spatial Reasoning Models (SRMs), a framework to perform reasoning over sets of continuous variables via denoising generative models. SRMs infer continuous representations on a set of unobserved variables, given observations on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Christopher Wewer , Bart Pogodzinski , Bernt Schiele , Jan Eric Lenssen

Vision language models (VLMs) perform well on many tasks but often fail at spatial reasoning, which is essential for navigation and interaction with physical environments. Many spatial reasoning tasks depend on fundamental two-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Yihong Tang , Ao Qu , Zhaokai Wang , Dingyi Zhuang , Zhaofeng Wu , Wei Ma , Shenhao Wang , Yunhan Zheng , Zhan Zhao , Jinhua Zhao

Vision-language models (VLMs) have shown a promising ability in image geolocation, but they still lack structured geographic reasoning and the capacity for autonomous self-evolution. Existing methods predominantly rely on implicit…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Chenjie Yang , Yutian Jiang , Yutong Deng , Chenyu Wu

Free-text promptable 3D medical image segmentation offers an intuitive and clinically flexible interaction paradigm. However, current methods are highly sensitive to linguistic variability: minor changes in phrasing can cause substantial…

Image and Video Processing · Electrical Eng. & Systems 2026-03-10 Tongrui Zhang , Chenhui Wang , Yongming Li , Zhihao Chen , Xufeng Zhan , Hongming Shan

Spatial reasoning -- the ability to perceive and reason about relationships in space -- advances vision-language models (VLMs) from visual perception toward spatial semantic understanding. Existing approaches either revisit local image…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Weijian Ma , Shizhao Sun , Tianyu Yu , Ruiyu Wang , Tat-Seng Chua , Jiang Bian

Spatial intelligence (SI) represents a cognitive ability encompassing the visualization, manipulation, and reasoning about spatial relationships, underpinning disciplines from neuroscience to robotics. We introduce SITE, a benchmark dataset…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Wenqi Wang , Reuben Tan , Pengyue Zhu , Jianwei Yang , Zhengyuan Yang , Lijuan Wang , Andrey Kolobov , Jianfeng Gao , Boqing Gong

Reasoning about spatial relationships between objects is essential for many real-world robotic tasks, such as fetch-and-delivery, object rearrangement, and object search. The ability to detect and disambiguate different objects and identify…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Negar Nejatishahidin , Madhukar Reddy Vongala , Jana Kosecka

Grounding language in the physical world requires AI systems to interpret references that emerge dynamically during conversation. While current vision-language models (VLMs) excel at static image tasks, they struggle to resolve ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Anna Deichler , Jim O'Regan , Fethiye Irmak Dogan , Lubos Marcinek , Anna Klezovich , Iolanda Leite , Jonas Beskow

Vision-Language Models (VLMs) have advanced rapidly in multimodal perception and language understanding, yet it remains unclear whether they can reliably ground language into spatially coherent, plausibly executable actions in 3D digital…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Niyati Rawal , Sushant Ravva , Shah Alam Abir , Saksham Jain , Aman Chadha , Vinija Jain , Suranjana Trivedy , Amitava Das

Multimodal large language models (MLLMs) are increasingly being applied to spatial cognition tasks, where they are expected to understand and interact with complex environments. Most existing works improve spatial reasoning by introducing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zhenghao Chen , Huiqun Wang , Di Huang

Despite impressive high-level video comprehension, multimodal language models struggle with spatial reasoning across time and space. While current spatial training approaches rely on real-world video data, obtaining diverse footage with…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Ellis Brown , Arijit Ray , Ranjay Krishna , Ross Girshick , Rob Fergus , Saining Xie
‹ Prev 1 4 5 6 7 8 10 Next ›