English
Related papers

Related papers: PE3R: Perception-Efficient 3D Reconstruction

200 papers

Target localization is a prerequisite for embodied tasks such as navigation and manipulation. Conventional approaches rely on constructing explicit 3D scene representations to enable target localization, such as point clouds, voxel grids,…

Robotics · Computer Science 2026-04-22 Rui Zhou , Xander Yap , Jianwen Cao , Allison Lau , Boyang Sun , Marc Pollefeys

3D scene reconstruction is a long-standing vision task. Existing approaches can be categorized into geometry-based and learning-based methods. The former leverages multi-view geometry but can face catastrophic failures due to the reliance…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Guangkai Xu , Wei Yin , Hao Chen , Chunhua Shen , Kai Cheng , Feng Zhao

In recent years, 3D visual foundation models pioneered by pointmap-based approaches such as DUSt3R have attracted a lot of interest, achieving impressive accuracy and strong generalization across diverse scenes. However, these methods are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Shuang Guo , Filbert Febryanto , Lei Sun , Guillermo Gallego

Recent advances in DUSt3R have enabled robust estimation of dense point clouds and camera parameters of static scenes, leveraging Transformer network architectures and direct supervision on large-scale 3D datasets. In contrast, the limited…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Xingyu Chen , Yue Chen , Yuliang Xiu , Andreas Geiger , Anpei Chen

Streaming 3D perception is well suited to robotics and augmented reality, where long visual streams must be processed efficiently and consistently. Recent recurrent models offer a promising solution by maintaining fixed-size states and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Changkun Liu , Jiezhi Yang , Zeman Li , Yuan Deng , Jiancong Guo , Luca Ballan

Feed-forward 3D reconstruction models are efficient but rigid: once trained, they perform inference in a zero-shot manner and cannot adapt to the test scene. As a result, visually plausible reconstructions often contain errors, particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Yuhang Dai , Xingyi Yang

Traditional high-quality 3D scanning and reconstruction typically relies on human labor to plan the scanning procedure. With the rapid development of embodied systems such as drones and robots, there is a growing demand of performing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Chentao Shen , Sizhe Zheng , Bingqian Wu , Yaohua Feng , Yuanchen Fei , Mingyu Mei , Hanwen Jiang , Xiangru Huang

We introduce a novel, training-free system for reconstructing, understanding, and rendering 3D indoor scenes from a sparse set of unposed RGB images. Unlike traditional radiance field approaches that require dense views and per-scene…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jiatong Xia , Lingqiao Liu

We present PAD3R, a method for reconstructing deformable 3D objects from casually captured, unposed monocular videos. Unlike existing approaches, PAD3R handles long video sequences featuring substantial object deformation, large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Ting-Hsuan Liao , Haowen Liu , Yiran Xu , Songwei Ge , Gengshan Yang , Jia-Bin Huang

Recent work on image content manipulation based on vision-language pre-training models has been effectively extended to text-driven 3D scene editing. However, existing schemes for 3D scene editing still exhibit certain shortcomings,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Shuangkang Fang , Yufeng Wang , Yi-Hsuan Tsai , Yi Yang , Wenrui Ding , Shuchang Zhou , Ming-Hsuan Yang

Accurate Digital Surface Model (DSM) reconstruction from satellite imagery is critical for applications such as disaster response, urban planning, and large-scale geographic mapping. Existing approaches face a fundamental trade-off:…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Qiaoyi Yang , Chaoyi Zhou , Xi Liu , Run Wang , Minghui Xu , Mert D. Pesé , Feng Luo , Yuhao Xu , Zhi-Qi Cheng , Qiushi Chen , Hairong Qi , Siyu Huang

We present a novel way of approaching image-based 3D reconstruction based on radiance fields. The problem of volumetric reconstruction is formulated as a non-linear least-squares problem and solved explicitly without the use of neural…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Sverker Rasmuson , Erik Sintorn , Ulf Assarsson

Single-view 3D reconstruction is currently approached from two dominant perspectives: reconstruction of scenes with limited diversity using 3D data supervision or reconstruction of diverse singular objects using large image priors. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Andreea Ardelean , Mert Özer , Bernhard Egger

Recovering dense 3D geometry from unposed images remains a foundational challenge in computer vision. Current state-of-the-art models are predominantly trained on perspective datasets, which implicitly constrains them to a standard pinhole…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Namitha Guruprasad , Abhay Yadav , Cheng Peng , Rama Chellappa

Robust 3D geometry estimation from videos is critical for applications such as autonomous navigation, SLAM, and 3D scene reconstruction. Recent methods like DUSt3R demonstrate that regressing dense pointmaps from image pairs enables…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Xiaoshan Wu , Yifei Yu , Xiaoyang Lyu , Yihua Huang , Bo Wang , Baoheng Zhang , Zhongrui Wang , Xiaojuan Qi

Recovering the 3D geometry of a scene from a sparse set of uncalibrated images is a long-standing problem in computer vision. While recent learning-based approaches such as DUSt3R and MASt3R have demonstrated impressive results by directly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Sara Rojas , Matthieu Armando , Bernard Ghamen , Philippe Weinzaepfel , Vincent Leroy , Gregory Rogez

Multi-view 3D reconstruction remains a core challenge in computer vision, particularly in applications requiring accurate and scalable representations across diverse perspectives. Current leading methods such as DUSt3R employ a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Jianing Yang , Alexander Sax , Kevin J. Liang , Mikael Henaff , Hao Tang , Ang Cao , Joyce Chai , Franziska Meier , Matt Feiszli

Realtime 4D reconstruction for dynamic scenes remains a crucial challenge for autonomous driving perception. Most existing methods rely on depth estimation through self-supervision or multi-modality sensor fusion. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xin Fei , Wenzhao Zheng , Yueqi Duan , Wei Zhan , Masayoshi Tomizuka , Kurt Keutzer , Jiwen Lu

Reconstructing dynamic 3D scenes (i.e., 4D geometry) from monocular video is an important yet challenging problem. Conventional multiview geometry-based approaches often struggle with dynamic motion, whereas recent learning-based methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Jinjie Mai , Wenxuan Zhu , Haozhe Liu , Bing Li , Cheng Zheng , Jürgen Schmidhuber , Bernard Ghanem

Bridging natural language and 3D geometry is a crucial step toward flexible, language-driven scene understanding. While recent advances in 3D Gaussian Splatting (3DGS) have enabled fast and high-quality scene reconstruction, research has…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Shaohui Dai , Yansong Qu , Zheyan Li , Xinyang Li , Shengchuan Zhang , Liujuan Cao