English
Related papers

Related papers: RayMap3R: Inference-Time RayMap for Dynamic 3D Rec…

200 papers

Realtime 4D reconstruction for dynamic scenes remains a crucial challenge for autonomous driving perception. Most existing methods rely on depth estimation through self-supervision or multi-modality sensor fusion. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xin Fei , Wenzhao Zheng , Yueqi Duan , Wei Zhan , Masayoshi Tomizuka , Kurt Keutzer , Jiwen Lu

We present STream3R, a novel approach to 3D reconstruction that reformulates pointmap prediction as a decoder-only Transformer problem. Existing state-of-the-art methods for multi-view reconstruction either depend on expensive global…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Yushi Lan , Yihang Luo , Fangzhou Hong , Shangchen Zhou , Honghua Chen , Zhaoyang Lyu , Shuai Yang , Bo Dai , Chen Change Loy , Xingang Pan

Dense 3D reconstruction from continuous image streams requires both accurate geometric aggregation and stable long-term memory management. Recent feed-forward reconstruction frameworks integrate observations through persistent memory…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Feifei Li , Qi Song , Chi Zhang , Rui Huang

In this work, we address the task of 3D reconstruction in dynamic scenes, where object motions frequently degrade the quality of previous 3D pointmap regression methods, such as DUSt3R, that are originally designed for static 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Jisang Han , Honggyu An , Jaewoo Jung , Takuya Narihira , Junyoung Seo , Kazumi Fukuda , Chaehyun Kim , Sunghwan Hong , Yuki Mitsufuji , Seungryong Kim

Recent advancements in multi-view scene reconstruction have been significant, yet existing methods face limitations when processing streams of input images. These methods either rely on time-consuming offline optimization or are restricted…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Zhuoguang Chen , Minghui Qin , Tianyuan Yuan , Zhe Liu , Hang Zhao

Dense 3D scene reconstruction from an ordered sequence or unordered image collections is a critical step when bringing research in computer vision into practical scenarios. Following the paradigm introduced by DUSt3R, which unifies an image…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yuqi Wu , Wenzhao Zheng , Jie Zhou , Jiwen Lu

DUSt3R has recently shown that one can reduce many tasks in multi-view geometry, including estimating camera intrinsics and extrinsics, reconstructing the scene in 3D, and establishing image correspondences, to the prediction of a pair of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Edgar Sucar , Zihang Lai , Eldar Insafutdinov , Andrea Vedaldi

We present Spann3R, a novel approach for dense 3D reconstruction from ordered or unordered image collections. Built on the DUSt3R paradigm, Spann3R uses a transformer-based architecture to directly regress pointmaps from images without any…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Hengyi Wang , Lourdes Agapito

Streaming 3D reconstruction aims to recover 3D information, such as camera poses and point clouds, from a video stream, which necessitates geometric accuracy, temporal consistency, and computational efficiency. Motivated by the principles…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Lin-Zhuo Chen , Jian Gao , Yihang Chen , Ka Leong Cheng , Yipengjing Sun , Liangxiao Hu , Nan Xue , Xing Zhu , Yujun Shen , Yao Yao , Yinghao Xu

We present CogniMap3D, a bioinspired framework for dynamic 3D scene understanding and reconstruction that emulates human cognitive processes. Our approach maintains a persistent memory bank of static scenes, enabling efficient spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Feiran Wang , Junyi Wu , Dawen Cai , Yuan Hong , Yan Yan

The remarkable achievements of both generative models of 2D images and neural field representations for 3D scenes present a compelling opportunity to integrate the strengths of both approaches. In this work, we propose a methodology that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Azmi Haider , Dan Rosenbaum

Streaming 3D perception is well suited to robotics and augmented reality, where long visual streams must be processed efficiently and consistently. Recent recurrent models offer a promising solution by maintaining fixed-size states and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Changkun Liu , Jiezhi Yang , Zeman Li , Yuan Deng , Jiancong Guo , Luca Ballan

Estimating agent pose and 3D scene structure from multi-camera rigs is a central task in embodied AI applications such as autonomous driving. Recent learned approaches such as DUSt3R have shown impressive performance in multiview settings.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Samuel Li , Pujith Kachana , Prajwal Chidananda , Saurabh Nair , Yasutaka Furukawa , Matthew Brown

We present TraceFlow, a novel framework for high-fidelity rendering of dynamic specular scenes by addressing two key challenges: precise reflection direction estimation and physically accurate reflection modeling. To achieve this, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Jiachen Tao , Junyi Wu , Haoxuan Wang , Zongxin Yang , Dawen Cai , Yan Yan

We propose SLARM, a feed-forward model that unifies dynamic scene reconstruction, semantic understanding, and real-time streaming inference. SLARM captures complex, non-uniform motion through higher-order motion modeling, trained solely on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Zhicheng Qiu , Jiarui Meng , Tong-an Luo , Yican Huang , Xuan Feng , Xuanfu Li , ZHan Xu

We present WinT3R, a feed-forward reconstruction model capable of online prediction of precise camera poses and high-quality point maps. Previous methods suffer from a trade-off between reconstruction quality and real-time performance. To…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Zizun Li , Jianjun Zhou , Yifan Wang , Haoyu Guo , Wenzheng Chang , Yang Zhou , Haoyi Zhu , Junyi Chen , Chunhua Shen , Tong He

Real-time reconstruction of dynamic 3D scenes from uncalibrated video streams demands robust online methods that recover scene dynamics from sparse observations under strict latency and memory constraints. Yet most dynamic reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Zike Wu , Qi Yan , Xuanyu Yi , Lele Wang , Renjie Liao

Large scale 3D scene reconstruction is important for applications such as virtual reality and simulation. Existing neural rendering approaches (e.g., NeRF, 3DGS) have achieved realistic reconstructions on large scenes, but optimize per…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yun Chen , Jingkang Wang , Ze Yang , Sivabalan Manivasagam , Raquel Urtasun

We introduce a novel, training-free system for reconstructing, understanding, and rendering 3D indoor scenes from a sparse set of unposed RGB images. Unlike traditional radiance field approaches that require dense views and per-scene…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jiatong Xia , Lingqiao Liu

Recent feed-forward geometry foundation models have demonstrated impressive generalization by recovering depth and poses in a single forward pass. However, these models are typically constrained by a global coordinate frame assumption. This…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Congrong Xu , Huachen Gao , Xingyu Chen , Yuliang Xiu , Jun Gao , Anpei Chen
‹ Prev 1 2 3 10 Next ›