English
Related papers

Related papers: Continuous 3D Perception Model with Persistent Sta…

200 papers

In recent years, 3D visual foundation models pioneered by pointmap-based approaches such as DUSt3R have attracted a lot of interest, achieving impressive accuracy and strong generalization across diverse scenes. However, these methods are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Shuang Guo , Filbert Febryanto , Lei Sun , Guillermo Gallego

We present Pow3r, a novel large 3D vision regression model that is highly versatile in the input modalities it accepts. Unlike previous feed-forward models that lack any mechanism to exploit known camera or scene priors at test time, Pow3r…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Wonbong Jang , Philippe Weinzaepfel , Vincent Leroy , Lourdes Agapito , Jerome Revaud

We present Online3R, a new sequential reconstruction framework that is capable of adapting to new scenes through online learning, effectively resolving inconsistency issues. Specifically, we introduce a set of learnable lightweight visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Shunkai Zhou , Zike Yan , Fei Xue , Dong Wu , Yuchen Deng , Hongbin Zha

In this work, we address the task of 3D reconstruction in dynamic scenes, where object motions frequently degrade the quality of previous 3D pointmap regression methods, such as DUSt3R, that are originally designed for static 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Jisang Han , Honggyu An , Jaewoo Jung , Takuya Narihira , Junyoung Seo , Kazumi Fukuda , Chaehyun Kim , Sunghwan Hong , Yuki Mitsufuji , Seungryong Kim

Reconstructing models of the real world, including 3D geometry, appearance, and motion of real scenes, is essential for computer graphics and computer vision. It enables the synthesizing of photorealistic novel views, useful for the movie…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Raza Yunus , Jan Eric Lenssen , Michael Niemeyer , Yiyi Liao , Christian Rupprecht , Christian Theobalt , Gerard Pons-Moll , Jia-Bin Huang , Vladislav Golyanik , Eddy Ilg

An intelligent observer looks at the world and sees not only what is, but what is moving and what can be moved. In other words, the observer sees how the present state of the world can transform in the future. We propose a model that…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Andrew Jaegle , Oleh Rybkin , Konstantinos G. Derpanis , Kostas Daniilidis

This paper addresses the task of large-scale 3D scene reconstruction from long video sequences. Recent feed-forward reconstruction models have shown promising results by directly regressing 3D geometry from RGB images without explicit 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Tao Xie , Peishan Yang , Yudong Jin , Yingfeng Cai , Wei Yin , Weiqiang Ren , Qian Zhang , Wei Hua , Sida Peng , Xiaoyang Guo , Xiaowei Zhou

Object-centric scene understanding is a fundamental challenge in computer vision. Existing approaches often rely on multi-stage pipelines that first apply pre-trained segmentors to extract individual objects, followed by per-object 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Yi Du , Yang You , Xiang Wan , Leonidas Guibas

Stylizing 3D scenes instantly while maintaining multi-view consistency and faithfully resembling a style image remains a significant challenge. Current state-of-the-art 3D stylization methods typically involve computationally intensive…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Peng Wang , Xiang Liu , Peidong Liu

In this paper, we present a novel shape reconstruction method leveraging diffusion model to generate 3D sparse point cloud for the object captured in a single RGB image. Recent methods typically leverage global embedding or local…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yan Di , Chenyangguang Zhang , Pengyuan Wang , Guangyao Zhai , Ruida Zhang , Fabian Manhardt , Benjamin Busam , Xiangyang Ji , Federico Tombari

Recent advances in 2D-to-3D perception have enabled the recovery of 3D scene semantics from unposed images. However, prevailing methods often suffer from limited generalization, reliance on per-scene optimization, and semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Jie Hu , Shizun Wang , Xinchao Wang

Streaming feed-forward 3D reconstruction enables real-time joint estimation of scene geometry and camera poses from RGB images. However, without explicit dynamic reasoning, streaming models can be affected by moving objects, causing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Feiran Wang , Zezhou Shang , Gaowen Liu , Yan Yan

In the realm of 3D reconstruction from 2D images, a persisting challenge is to achieve high-precision reconstructions devoid of 3D Ground Truth data reliance. We present UNeR3D, a pioneering unsupervised methodology that sets a new standard…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Hongbin Lin , Juangui Xu , Qingfeng Xu , Zhengyu Hu , Handing Xu , Yunzhi Chen , Yongjun Hu , Zhenguo Nie

Identifying changes in a pair of 3D aerial LiDAR point clouds, obtained during two distinct time periods over the same geographic region presents a significant challenge due to the disparities in spatial coverage and the presence of noise…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Peter Naylor , Diego Di Carlo , Arianna Traviglia , Makoto Yamada , Marco Fiorucci

Building a robust perception module is crucial for visuomotor policy learning. While recent methods incorporate pre-trained 2D foundation models into robotic perception modules to leverage their strong semantic understanding, they struggle…

Robotics · Computer Science 2025-07-14 Wenbo Cui , Chengyang Zhao , Yuhui Chen , Haoran Li , Zhizheng Zhang , Dongbin Zhao , He Wang

Large scale 3D scene reconstruction is important for applications such as virtual reality and simulation. Existing neural rendering approaches (e.g., NeRF, 3DGS) have achieved realistic reconstructions on large scenes, but optimize per…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yun Chen , Jingkang Wang , Ze Yang , Sivabalan Manivasagam , Raquel Urtasun

Advances in 3D reconstruction have enabled high-quality 3D capture, but require a user to collect hundreds to thousands of images to create a 3D scene. We present CAT3D, a method for creating anything in 3D by simulating this real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Ruiqi Gao , Aleksander Holynski , Philipp Henzler , Arthur Brussee , Ricardo Martin-Brualla , Pratul Srinivasan , Jonathan T. Barron , Ben Poole

We present Spann3R, a novel approach for dense 3D reconstruction from ordered or unordered image collections. Built on the DUSt3R paradigm, Spann3R uses a transformer-based architecture to directly regress pointmaps from images without any…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Hengyi Wang , Lourdes Agapito

Realtime 4D reconstruction for dynamic scenes remains a crucial challenge for autonomous driving perception. Most existing methods rely on depth estimation through self-supervision or multi-modality sensor fusion. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xin Fei , Wenzhao Zheng , Yueqi Duan , Wei Zhan , Masayoshi Tomizuka , Kurt Keutzer , Jiwen Lu

Multi-view 3D reconstruction remains a core challenge in computer vision, particularly in applications requiring accurate and scalable representations across diverse perspectives. Current leading methods such as DUSt3R employ a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Jianing Yang , Alexander Sax , Kevin J. Liang , Mikael Henaff , Hao Tang , Ang Cao , Joyce Chai , Franziska Meier , Matt Feiszli