English
Related papers

Related papers: Feed-Forward 3D Scene Modeling: A Problem-Driven P…

200 papers

Feedforward reconstruction is crucial for autonomous driving applications, where rapid scene reconstruction enables efficient utilization of large-scale driving datasets in closed-loop simulation and other downstream tasks, eliminating the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Zhongrui Yu , Zhao Wang , Yijia Xie , Yida Wang , Xueyang Zhang , Yifei Zhan , Kun Zhan

Recent works on 3D reconstruction from posed images have demonstrated that direct inference of scene-level 3D geometry without test-time optimization is feasible using deep neural networks, showing remarkable promise and high efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Noah Stier , Anurag Ranjan , Alex Colburn , Yajie Yan , Liang Yang , Fangchang Ma , Baptiste Angles

Feed-forward foundation models for multi-view 3-dimensional (3D) reconstruction have been trained on large-scale datasets of perspective images; when tested on wide field-of-view images, e.g., from a fisheye camera, their performance…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Ruxiao Duan , Erin Hong , Dongxu Zhao , Eric Turner , Alex Wong , Yunwen Zhou

This report surveys advances in deep learning-based modeling techniques that address four different 3D indoor scene analysis tasks, as well as synthesis of 3D indoor scenes. We describe different kinds of representations for indoor scenes,…

Graphics · Computer Science 2023-08-22 Akshay Gadi Patil , Supriya Gadi Patil , Manyi Li , Matthew Fisher , Manolis Savva , Hao Zhang

The efficient spatial allocation of primitives serves as the foundation of 3D Gaussian Splatting, as it directly dictates the synergy between representation compactness, reconstruction speed, and rendering fidelity. Previous solutions,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Roni Itkin , Noam Issachar , Yehonatan Keypur , Xingyu Chen , Anpei Chen , Sagie Benaim

The idea of 3D reconstruction as scene understanding is foundational in computer vision. Reconstructing 3D scenes from 2D visual observations requires strong priors to disambiguate structure. Much work has been focused on the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Peter Kulits , Michael J. Black , Silvia Zuffi

Posing 3D characters is a fundamental task in computer graphics. However, existing paradigms, ranging from traditional auto-rigging to recent pose-conditioned generative models, frequently struggle with inaccurate skinning weights, fixed…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Zhiyang Guo , Ori Zhang , Jax Xiang , Alan Zhao , Zhenxun Yuan , Wengang Zhou , Houqiang Li

In this paper, we present a novel, scalable approach for constructing open set, instance-level 3D scene representations, advancing open world understanding of 3D environments. Existing methods require pre-constructed 3D scenes and face…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Rafay Mohiuddin , Sai Manoj Prakhya , Fiona Collins , Ziyuan Liu , André Borrmann

Reconstructing and semantically interpreting 3D scenes from sparse 2D views remains a fundamental challenge in computer vision. Conventional methods often decouple semantic understanding from reconstruction or necessitate costly per-scene…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Xiangyu Sun , Haoyi Jiang , Liu Liu , Seungtae Nam , Gyeongjin Kang , Xinjie Wang , Wei Sui , Zhizhong Su , Wenyu Liu , Xinggang Wang , Eunbyung Park

The ability to accurately reconstruct the 3D facets of a scene is one of the key problems in robotic vision. However, even with recent advances with machine learning, there is no high-fidelity universal 3D reconstruction method for this…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Bipul Islam , Ji Liu , Anthony Yezzi , Romeil Sandhu

Recent progresses on deep discriminative and generative modeling have shown promising results on texture synthesis. However, existing feed-forward based methods trade off generality for efficiency, which suffer from many issues, such as…

Computer Vision and Pattern Recognition · Computer Science 2017-03-07 Yijun Li , Chen Fang , Jimei Yang , Zhaowen Wang , Xin Lu , Ming-Hsuan Yang

We present UniQueR, a unified query-based feedforward framework for efficient and accurate 3D reconstruction from unposed images. Existing feedforward models such as DUSt3R, VGGT, and AnySplat typically predict per-pixel point maps or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Chensheng Peng , Quentin Herau , Jiezhi Yang , Yichen Xie , Yihan Hu , Wenzhao Zheng , Matthew Strong , Masayoshi Tomizuka , Wei Zhan

Visually localizing an image, i.e., estimating its camera pose, requires building a scene representation that serves as a visual map. The representation we choose has direct consequences towards the practicability of our system. Even when…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Axel Barroso-Laguna , Tommaso Cavallari , Victor Adrian Prisacariu , Eric Brachmann

3D mapping in dynamic environments poses a challenge for modern researchers in robotics and autonomous transportation. There are no universal representations for dynamic 3D scenes that incorporate multimodal data such as images, point…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Dmitry Yudin

Robust 3D representation learning forms the perceptual foundation of spatial intelligence, enabling downstream tasks in scene understanding and embodied AI. However, learning such representations directly from unposed multi-view images…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Bo Zhou , Qiuxia Lai , Zeren Sun , Xiangbo Shu , Yazhou Yao , Wenguan Wang

Recent advances in deep learning have significantly transformed the field of 3D shape generation, enabling the synthesis of complex, diverse, and semantically meaningful 3D objects. This survey provides a comprehensive overview of the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Nicolas Caytuiro , Ivan Sipiran

High-fidelity visual reconstruction and novel-view synthesis are essential for realistic closed-loop evaluation in autonomous driving. While 4D Gaussian Splatting (4DGS) offers a promising balance of accuracy and efficiency, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Haibao Yu , Kuntao Xiao , Jiahang Wang , Ruiyang Hao , Yuxin Huang , Guoran Hu , Haifang Qin , Bowen Jing , Yuntian Bo , Ping Luo

Feed-forward paradigms for 3D reconstruction have become a focus of recent research, which learn implicit, fixed view transformations to generate a single scene representation. However, their application to complex driving scenes reveals…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Haochen Yu , Qiankun Liu , Hongyuan Liu , Jianfei Jiang , Juntao Lyu , Jiansheng Chen , Huimin Ma

3D reconstruction from 2D images is a central problem in computer vision. Recent works have been focusing on reconstruction directly from a single image. It is well known however that only one image cannot provide enough information for…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Jhony K. Pontes , Chen Kong , Anders Eriksson , Clinton Fookes , Sridha Sridharan , Simon Lucey

Deep learning has enabled remarkable improvements in grasp synthesis for previously unseen objects from partial object views. However, existing approaches lack the ability to explicitly reason about the full 3D geometry of the object when…

Robotics · Computer Science 2020-03-19 Mark Van der Merwe , Qingkai Lu , Balakumar Sundaralingam , Martin Matak , Tucker Hermans