English
Related papers

Related papers: RayMap3R: Inference-Time RayMap for Dynamic 3D Rec…

200 papers

3D reconstruction of large scenes is a challenging problem due to the high-complexity nature of the solution space, in particular for generative neural networks. In contrast to traditional generative learned models which encode the full…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Yawar Siddiqui , Justus Thies , Fangchang Ma , Qi Shan , Matthias Nießner , Angela Dai

Powerful 3D representations such as DUSt3R invariant point maps, which encode 3D shape and camera parameters, have significantly advanced feed forward 3D reconstruction. While point maps assume static scenes, Dynamic Point Maps (DPMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Edgar Sucar , Eldar Insafutdinov , Zihang Lai , Andrea Vedaldi

In this paper, we propose an approach to address the problem of 3D reconstruction of scenes from a single image captured by a light-field camera equipped with a rolling shutter sensor. Our method leverages the 3D information cues present in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Hermes McGriff , Renato Martins , Nicolas Andreff , Cédric Demonceaux

3D reconstruction, which aims to recover the dense three-dimensional structure of a scene, is a cornerstone technology for numerous applications, including augmented/virtual reality, autonomous driving, and robotics. While traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Wei Zhang , Yihang Wu , Songhua Li , Wenjie Ma , Xin Ma , Qiang Li , Qi Wang

Reliable 3D dynamic perception requires models that can anticipate motion beyond predefined categories, yet progress is hindered by the scarcity of dense, high-quality motion annotations. While self-supervision on unlabeled real data offers…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Qingwen Zhang , Xiaomeng Zhu , Chenhan Jiang , Patric Jensfelt

Consistent 3D geometry estimation from streaming RGB input is crucial for real-world applications such as autonomous driving, embodied AI, and large-scale reconstruction. While modern monocular geometry foundation models achieve strong…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xiaoyang Lyu , Muxin Liu , Xiaoshan Wu , Ruicheng Wang , Yi-Hua Huang , Yang-Tian Sun , Shaoshuai Shi , Xiaojuan Qi

The accurate reconstruction of dynamic street scenes is critical for applications in autonomous driving, augmented reality, and virtual reality. Traditional methods relying on dense point clouds and triangular meshes struggle with moving…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Peizhen Zheng , Dongjing Jiang , Qingchong Jiao , Redouane EL Bouchtaoui , Flynnwell Jianfei Zhang

Dense 3D reconstruction and ego-motion estimation are key challenges in autonomous driving and robotics. Compared to the complex, multi-modal systems deployed today, multi-camera systems provide a simpler, low-cost alternative. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Aron Schmied , Tobias Fischer , Martin Danelljan , Marc Pollefeys , Fisher Yu

We propose a scene-level inverse rendering framework that uses multi-view images to decompose the scene into geometry, a SVBRDF, and 3D spatially-varying lighting. Because multi-view images provide a variety of information about the scene,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 JunYong Choi , SeokYeong Lee , Haesol Park , Seung-Won Jung , Ig-Jae Kim , Junghyun Cho

We present 3DP3, a framework for inverse graphics that uses inference in a structured generative model of objects, scenes, and images. 3DP3 uses (i) voxel models to represent the 3D shape of objects, (ii) hierarchical scene graphs to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Nishad Gothoskar , Marco Cusumano-Towner , Ben Zinberg , Matin Ghavamizadeh , Falk Pollok , Austin Garrett , Joshua B. Tenenbaum , Dan Gutfreund , Vikash K. Mansinghka

Ray tracing algorithms, that can simulate multipath radio propagation in presence of geometric obstacles such as buildings, objects or vehicles, are becoming quite popular, due to the increasing availability of digital environment databases…

Signal Processing · Electrical Eng. & Systems 2023-06-14 Denis Bilibashi , Enrico M. Vitucci , Vittorio Degli-Esposti

We present 3DScenePrompt, a framework that generates the next video chunk from arbitrary-length input while enabling precise camera control and preserving scene consistency. Unlike methods conditioned on a single image or a short clip, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 JoungBin Lee , Jaewoo Jung , Jisang Han , Takuya Narihira , Kazumi Fukuda , Junyoung Seo , Sunghwan Hong , Yuki Mitsufuji , Seungryong Kim

Rendering realistic images from 3D reconstruction is an essential task of many Computer Vision and Robotics pipelines, notably for mixed-reality applications as well as training autonomous agents in simulated environments. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Lukas Bösiger , Mihai Dusmanu , Marc Pollefeys , Zuria Bauer

Static mapping is fundamental to robot navigation, providing a persistent geometric prior and a consistent reference for long-term autonomy. However, dynamic objects leave residual traces and cause surface loss, which reduces map…

Robotics · Computer Science 2026-05-12 Daebeom Kim , Seungjae Lee , Seoyeon Jang , Kevin Christiansen Marsim , Hyun Myung

Interactive 3D scenes are increasingly vital for embodied intelligence, yet existing datasets remain limited due to the labor-intensive process of annotating part segmentation, kinematic types, and motion trajectories. We present REACT3D, a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Zhao Huang , Boyang Sun , Alexandros Delitzas , Jiaqi Chen , Marc Pollefeys

This paper reports on a dynamic semantic mapping framework that incorporates 3D scene flow measurements into a closed-form Bayesian inference model. Existence of dynamic objects in the environment can cause artifacts and traces in current…

Event cameras are novel sensors that report brightness changes in the form of a stream of asynchronous "events" instead of intensity frames. They offer significant advantages with respect to conventional cameras: high temporal resolution,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Henri Rebecq , René Ranftl , Vladlen Koltun , Davide Scaramuzza

We propose a novel online, point-based 3D reconstruction method from posed monocular RGB videos. Our model maintains a global point cloud representation of the scene, continuously updating the features and 3D locations of points as new…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Chen Ziwen , Zexiang Xu , Li Fuxin

Information retrieval (IR) in dynamic data streams is a crucial task, as shifts in data distribution degrade the performance of AI-powered IR systems. To mitigate this issue, memory-based continual learning has been widely adopted for IR.…

Information Retrieval · Computer Science 2026-01-13 HuiJeong Son , Hyeongu Kang , Sunho Kim , Subeen Ho , SeongKu Kang , Dongha Lee , Susik Yoon

Achieving truly practical dynamic 3D reconstruction requires online operation, global pose and map consistency, detailed appearance modeling, and the flexibility to handle both RGB and RGB-D inputs. However, existing SLAM methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Shi Chen , Erik Sandström , Sandro Lombardi , Siyuan Li , Martin R. Oswald