English
Related papers

Related papers: Learning 3D Representations for Spatial Intelligen…

200 papers

Sparse-view 3D reconstruction is increasingly addressed with feed-forward splatting networks that predict explicit primitives directly from images. Yet most existing methods remain centered on Gaussian primitives and expose surfaces only…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Weijie Wang , Zimu Li , Jinchuan Shi , Zeyu Zhang , Botao Ye , Marc Pollefeys , Donny Y. Chen , Bohan Zhuang

Scene reconstruction has emerged as a central challenge in computer vision, with approaches such as Neural Radiance Fields (NeRF) and Gaussian Splatting achieving remarkable progress. While Gaussian Splatting demonstrates strong performance…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Alexander Valverde , Brian Xu , Yuyin Zhou , Meng Xu , Hongyun Wang

We propose an unsupervised method for 3D geometry-aware representation learning of articulated objects, in which no image-pose pairs or foreground masks are used for training. Though photorealistic images of articulated objects can be…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Atsuhiro Noguchi , Xiao Sun , Stephen Lin , Tatsuya Harada

Dense 4D reconstruction from unposed images remains a critical challenge, with current methods relying on slow test-time optimization or fragmented, task-specific feedforward models. We introduce UFO-4D, a unified feedforward framework to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Junhwa Hur , Charles Herrmann , Songyou Peng , Philipp Henzler , Zeyu Ma , Todd Zickler , Deqing Sun

Recently, generalizable feed-forward methods based on 3D Gaussian Splatting have gained significant attention for their potential to reconstruct 3D scenes using finite resources. These approaches create a 3D radiance field, parameterized by…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Wonseok Roh , Hwanhee Jung , Jong Wook Kim , Seunggwan Lee , Innfarn Yoo , Andreas Lugmayr , Seunggeun Chi , Karthik Ramani , Sangpil Kim

3D visual grounding (3DVG) is a critical task in scene understanding that aims to identify objects in 3D scenes based on text descriptions. However, existing methods rely on separately pre-trained vision and text encoders, resulting in a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Yinuo Zheng , Lipeng Gu , Honghua Chen , Liangliang Nan , Mingqiang Wei

Representing 3D scenes from multiview images is a core challenge in computer vision and graphics, which requires both precise rendering and accurate reconstruction. Recently, 3D Gaussian Splatting (3DGS) has garnered significant attention…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 You Shen , Zhipeng Zhang , Xinyang Li , Yansong Qu , Yu Lin , Shengchuan Zhang , Liujuan Cao

Learning sensorimotor control policies from high-dimensional images crucially relies on the quality of the underlying visual representations. Prior works show that structured latent space such as visual keypoints often outperforms…

Machine Learning · Computer Science 2021-06-15 Boyuan Chen , Pieter Abbeel , Deepak Pathak

Image representation is a fundamental task in computer vision. Recently, Gaussian Splatting has emerged as an efficient representation framework, and its extension to 2D image representation enables lightweight, yet expressive modeling of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Masaya Takabe , Hiroshi Watanabe , Sujun Hong , Tomohiro Ikai , Zheming Fan , Ryo Ishimoto , Kakeru Sugimoto , Ruri Imichi

Despite the impressive progress on understanding and generating images shown by the recent unified architectures, the integration of 3D tasks remains challenging and largely unexplored. In this paper, we introduce UniUGG, the first unified…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yueming Xu , Jiahui Zhang , Ze Huang , Yurui Chen , Yanpeng Zhou , Zhenyu Chen , Yu-Jie Yuan , Pengxiang Xia , Guowei Huang , Xinyue Cai , Zhongang Qi , Xingyue Quan , Jianye Hao , Hang Xu , Li Zhang

Recent advancements in 3D reconstruction methods and vision-language models have propelled the development of multi-modal 3D scene understanding, which has vital applications in robotics, autonomous driving, and virtual/augmented reality.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Qucheng Peng , Benjamin Planche , Zhongpai Gao , Meng Zheng , Anwesa Choudhuri , Terrence Chen , Chen Chen , Ziyan Wu

Bird's-Eye-View (BEV) perception serves as a cornerstone for autonomous driving, offering a unified spatial representation that fuses surrounding-view images to enable reasoning for various downstream tasks, such as semantic segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yiren Lu , Xin Ye , Burhaneddin Yaman , Jingru Luo , Zhexiao Xiong , Liu Ren , Yu Yin

Establishing dense correspondence across 3D shapes is crucial for fundamental downstream tasks, including texture transfer, shape interpolation, and robotic manipulation. However, learning these mappings without manual supervision remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Qinfeng Xiao , Guofeng Mei , Qilong Liu , Chenyuan Yi , Fabio Poiesi , Jian Zhang , Bo Yang , Yick Kit-lun

The boundary representation (B-Rep) models a 3D solid as its explicit boundaries: trimmed corners, edges, and faces. Recovering B-Rep representation from unstructured data is a challenging and valuable task of computer vision and graphics.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Jiaxing Yu , Dongyang Ren , Hangyu Xu , Zhouyuxiao Yang , Yuanqi Li , Jie Guo , Zhengkang Zhou , Yanwen Guo

Neuroscientists postulate 3D representations in the brain in a variety of different coordinate frames (e.g. 'head-centred', 'hand-centred' and 'world-based'). Recent advances in reinforcement learning demonstrate a quite different approach…

Neurons and Cognition · Quantitative Biology 2020-07-10 Alex Muryy , N. Siddharth , Nantas Nardelli , Philip H. S. Torr , Andrew Glennerster

Recent advances in 3D perception have shown impressive progress in understanding geometric structures of 3Dshapes and even scenes. Inspired by these advances in geometric understanding, we aim to imbue image-based perception with…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Ji Hou , Saining Xie , Benjamin Graham , Angela Dai , Matthias Nießner

Pose-free feed-forward 3D Gaussian Splatting (3DGS) has opened a new frontier for rapid 3D modeling, enabling high-quality Gaussian representations to be generated from uncalibrated multi-view images in a single forward pass. The dominant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Hwasik Jeong , Seungryong Lee , Gyeongjin Kang , Seungkwon Yang , Xiangyu Sun , Seungtae Nam , Eunbyung Park

Gaussian Splatting has achieved remarkable progress in multi-view surface reconstruction, yet it exhibits notable degradation when only few views are available. Although recent efforts alleviate this issue by enhancing multi-view…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Jimin Tang , Wenyuan Zhang , Junsheng Zhou , Zian Huang , Kanle Shi , Shenkun Xu , Yu-Shen Liu , Zhizhong Han

Reconstructing and understanding 3D structures from a limited number of images is a well-established problem in computer vision. Traditional methods usually break this task into multiple subtasks, each requiring complex transformations…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Zhiwen Fan , Jian Zhang , Wenyan Cong , Peihao Wang , Renjie Li , Kairun Wen , Shijie Zhou , Achuta Kadambi , Zhangyang Wang , Danfei Xu , Boris Ivanovic , Marco Pavone , Yue Wang

Low-level 3D representations, such as point clouds, meshes, NeRFs and 3D Gaussians, are commonly used for modeling 3D objects and scenes. However, cognitive studies indicate that human perception operates at higher levels and interprets 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Zhirui Gao , Renjiao Yi , Yuhang Huang , Wei Chen , Chenyang Zhu , Kai Xu