English
Related papers

Related papers: E3D-Bench: A Benchmark for End-to-End 3D Geometric…

200 papers

Recent generative AI models have achieved remarkable breakthroughs in language and visual understanding. However, although these models can generate realistic visual content, their spatial scale remains confined to bounded environments,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Jinqi Cao , Zhiping Yu , Baihong Lin , Chenyang Liu , Zhenwei Shi , Zhengxia Zou

Foundation models are deep neural networks (such as GPT-5, Gemini~3, and Opus~4) trained on large datasets that can perform diverse downstream tasks -- text and code generation, question answering, summarization, image classification, and…

Machine Learning · Computer Science 2026-05-01 Logan G Wright , Tianyu Wang , Tatsuhiro Onodera , Peter L. McMahon

Visual Foundation Models (VFMs), such as DINO and CLIP, excel in semantic understanding of images but exhibit limited spatial reasoning capabilities, which limits their applicability to embodied systems. As a result, recent work…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Turhan Can Kargin , Wojciech Jasiński , Adam Pardyl , Bartosz Zieliński , Marcin Przewięźlikowski

360 panoramic images are increasingly used in virtual reality, autonomous driving, and robotics for holistic scene understanding. However, current Vision-Language Models (VLMs) struggle with 3D spatial reasoning on Equirectangular…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Zekai Lin , Xu Zheng

Foundation models have recently gained significant attention because of their generalizability and adaptability across multiple tasks and data distributions. Although medical foundation models have emerged, solutions for cardiac imaging,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Sekeun Kim , Pengfei Jin , Sifan Song , Cheng Chen , Yiwei Li , Hui Ren , Xiang Li , Tianming Liu , Quanzheng Li

Understanding 3D spatial relationships remains a major limitation of current Vision-Language Models (VLMs). Prior work has addressed this issue by creating spatial question-answering (QA) datasets based on single images or indoor videos.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Mohsen Gholami , Ahmad Rezaei , Zhou Weimin , Sitong Mao , Shunbo Zhou , Yong Zhang , Mohammad Akbari

Three-dimensional geospatial analysis is critical for applications in urban planning, climate adaptation, and environmental assessment. However, current methodologies depend on costly, specialized sensors, such as LiDAR and multispectral…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Mai Tsujimoto , Junjue Wang , Weihao Xuan , Naoto Yokoya

Spatial understanding over continuous visual input is crucial for MLLMs to evolve into general-purpose assistants in physical environments. Yet there is still no comprehensive benchmark that holistically assesses the progress toward this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Jingli Lin , Runsen Xu , Shaohao Zhu , Sihan Yang , Peizhou Cao , Yunlong Ran , Miao Hu , Chenming Zhu , Yiman Xie , Yilin Long , Wenbo Hu , Dahua Lin , Tai Wang , Jiangmiao Pang

Modern monocular 3D reconstruction methods and vision-language models (VLMs) demonstrate impressive results on standard benchmarks, yet recent works cast doubt on their true understanding of geometric properties. We introduce GOQ, a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Mateusz Michalkiewicz , Anekha Sokhal , Tadeusz Michalkiewicz , Piotr Pawlikowski , Mahsa Baktashmotlagh , Varun Jampani , Guha Balakrishnan

Following its success in natural language processing and computer vision, foundation models that are pre-trained on large-scale multi-task datasets have also shown great potential in robotics. However, most existing robot foundation models…

Robotics · Computer Science 2025-03-13 Rujia Yang , Geng Chen , Chuan Wen , Yang Gao

We present GR3D, a spatial vision language model equipped with three complementary grounding capabilities--explicit 2D grounding, implicit 2D grounding, and monocular 3D grounding--within a single framework. GR3D introduces an implicit…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 An-Chieh Cheng , Yang Fu , Yatai Ji , Ligeng Zhu , Guanqi Zhan , Zhuoyang Zhang , Zhaojing Yang , Song Han , Yao Lu , Pavlo Molchanov , Vidya Nariyambut Murali , Jan Kautz , Xiaolong Wang , Hongxu Yin , Sifei Liu

Text-to-3D (T23D) generation has emerged as a crucial visual generation task, aiming at synthesizing 3D content from textual descriptions. Studies of this task are currently shifting from per-scene T23D, which requires optimization of the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Xiao Cai , Sitong Su , Jingkuan Song , Pengpeng Zeng , Ji Zhang , Qinhong Du , Mengqi Li , Heng Tao Shen , Lianli Gao

We present GeoGrid-Bench, a benchmark designed to evaluate the ability of foundation models to understand geo-spatial data in the grid structure. Geo-spatial datasets pose distinct challenges due to their dense numerical values, strong…

Computation and Language · Computer Science 2025-05-27 Bowen Jiang , Yangxinyu Xie , Xiaomeng Wang , Jiashu He , Joshua Bergerson , John K Hutchison , Jordan Branham , Camillo J Taylor , Tanwi Mallick

Computer representations of three-dimensional (3D) geometries are crucial for simulating systems and processes in engineering and science. In medicine, and more specifically, biomechanics and orthopaedics, obtaining and using 3D geometries…

Quantitative Methods · Quantitative Biology 2024-04-05 Thor E. Andreassen , Donald R. Hume , Landon D. Hamilton , Sean E. Higinbotham , Kevin B. Shelburne

This paper addresses the problem of simultaneous 3D reconstruction and material recognition and segmentation. Enabling robots to recognise different materials (concrete, metal etc.) in a scene is important for many tasks, e.g. robotic…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Cheng Zhao , Li Sun , Rustam Stolkin

The emergence of large-scale pre-trained point cloud models has significantly advanced 3D scene understanding, but adapting these models to specific downstream tasks typically demands full fine-tuning, incurring high computational and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Liyao Tang , Zhe Chen , Dacheng Tao

Understanding Earth's subsurface is critical for energy transition, natural hazard mitigation, and planetary science. Yet subsurface analysis remains fragmented, with separate models required for structural interpretation, stratigraphic…

Given that visual foundation models (VFMs) are trained on extensive datasets but often limited to 2D images, a natural question arises: how well do they understand the 3D world? With the differences in architecture and training protocols…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yue Chen , Xingyu Chen , Anpei Chen , Gerard Pons-Moll , Yuliang Xiu

3D scene reconstruction is fundamental for spatial intelligence applications such as AR, robotics, and digital twins. Traditional multi-view stereo struggles with sparse viewpoints or low-texture regions, while neural rendering approaches,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Jiaqi Yao , Zhongmiao Yan , Jingyi Xu , Songpengcheng Xia , Yan Xiang , Ling Pei

Geometric spatial reasoning forms the foundation of many applications in artificial intelligence, yet the ability of large language models (LLMs) to operate over geometric spatial information expressed in procedural code remains…

Artificial Intelligence · Computer Science 2026-02-11 Shixian Luo , Zezhou Zhu , Yu Yuan , Yuncheng Yang , Lianlei Shan , Yong Wu