English
Related papers

Related papers: V-DPM: 4D Video Reconstruction with Dynamic Point …

200 papers

We present Spann3R, a novel approach for dense 3D reconstruction from ordered or unordered image collections. Built on the DUSt3R paradigm, Spann3R uses a transformer-based architecture to directly regress pointmaps from images without any…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Hengyi Wang , Lourdes Agapito

Dense 3D reconstruction and ego-motion estimation are key challenges in autonomous driving and robotics. Compared to the complex, multi-modal systems deployed today, multi-camera systems provide a simpler, low-cost alternative. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Aron Schmied , Tobias Fischer , Martin Danelljan , Marc Pollefeys , Fisher Yu

To facilitate depth-based 3D action recognition, 3D dynamic voxel (3DV) is proposed as a novel 3D motion representation. With 3D space voxelization, the key idea of 3DV is to encode 3D motion information within depth video into a regular…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Yancheng Wang , Yang Xiao , Fu Xiong , Wenxiang Jiang , Zhiguo Cao , Joey Tianyi Zhou , Junsong Yuan

Recent research has shown that mmWave radar sensing is effective for object detection in low visibility environments, which makes it an ideal technique in autonomous navigation systems such as autonomous vehicles. However, due to the…

Image and Video Processing · Electrical Eng. & Systems 2021-09-21 Yue Sun , Honggang Zhang , Zhuoming Huang , Benyuan Liu

In this work, we enhance a professional end-to-end volumetric video production pipeline to achieve high-fidelity human body reconstruction using only passive cameras. While current volumetric video approaches estimate depth maps using…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Decai Chen , Markus Worchel , Ingo Feldmann , Oliver Schreer , Peter Eisert

Recent feed-forward networks have achieved remarkable progress in sparse-view 3D reconstruction by predicting dense point maps directly from RGB images. However, they often suffer from geometric inconsistencies and limited fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Yutong Chen , Yiming Wang , Xucong Zhang , Sergey Prokudin , Siyu Tang

Modern feed-forward 3D reconstruction methods like VGGT predict pixel-aligned pointmaps in camera-centric coordinate frames. However, this choice of coordinate frame is not always optimal. We propose instead to predict pointmaps in upright,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Bharath Raj Nagoor Kani , Noah Snavely

DUSt3R introduced a novel paradigm in geometric computer vision by proposing a model that can provide dense and unconstrained Stereo 3D Reconstruction of arbitrary image collections with no prior information about camera calibration nor…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yohann Cabon , Lucas Stoffl , Leonid Antsfeld , Gabriela Csurka , Boris Chidlovskii , Jerome Revaud , Vincent Leroy

Recent advances in DUSt3R have enabled robust estimation of dense point clouds and camera parameters of static scenes, leveraging Transformer network architectures and direct supervision on large-scale 3D datasets. In contrast, the limited…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Xingyu Chen , Yue Chen , Yuliang Xiu , Andreas Geiger , Anpei Chen

Multi-view 3D reconstruction remains a core challenge in computer vision. Recent methods, such as DUST3R and its successors, directly regress pointmaps from image pairs without relying on known scene geometry or camera parameters. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jiahao Ma , Lei Wang , Miaomiao liu , David Ahmedt-Aristizabal , Chuong Nguyen

Reconstructing dynamic 3D scenes (i.e., 4D geometry) from monocular video is an important yet challenging problem. Conventional multiview geometry-based approaches often struggle with dynamic motion, whereas recent learning-based methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Jinjie Mai , Wenxuan Zhu , Haozhe Liu , Bing Li , Cheng Zheng , Jürgen Schmidhuber , Bernard Ghanem

Reconstructing scenes and tracking motion are two sides of the same coin. Tracking points allow for geometric reconstruction [14], while geometric reconstruction of (dynamic) scenes allows for 3D tracking of points over time [24, 39]. The…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Jenny Seidenschwarz , Qunjie Zhou , Bardienus Duisterhof , Deva Ramanan , Laura Leal-Taixé

This paper introduces a novel representation of volumetric videos for real-time view synthesis of dynamic scenes. Recent advances in neural scene representations demonstrate their remarkable capability to model and render complex static…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Sida Peng , Yunzhi Yan , Qing Shuai , Hujun Bao , Xiaowei Zhou

Recent advances in 4D generation mainly focus on generating 4D content by distilling pre-trained text or single-view image-conditioned models. It is inconvenient for them to take advantage of various off-the-shelf 3D assets with multi-view…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yanqin Jiang , Chaohui Yu , Chenjie Cao , Fan Wang , Weiming Hu , Jin Gao

Particle tracking velocimetry in 3D is becoming an increasingly important imaging tool in the study of fluid dynamics, combustion as well as plasmas. We introduce a dynamic discrete tomography algorithm for reconstructing particle…

Fluid Dynamics · Physics 2015-01-23 Andreas Alpers , Peter Gritzmann , Dmitry Moseev , Mirko Salewski

Building accurate maps is a key building block to enable reliable localization, planning, and navigation of autonomous vehicles. We propose a novel approach for building accurate maps of dynamic environments utilizing a sequence of LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Xingguang Zhong , Yue Pan , Cyrill Stachniss , Jens Behley

DUSt3R-based end-to-end scene reconstruction has recently shown promising results in dense visual SLAM. However, most existing methods only use image pairs to estimate pointmaps, overlooking spatial memory and global consistency.To this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Guole Shen , Tianchen Deng , Yanbo Wang , Yongtao Chen , Yilin Shen , Jiuming Liu , Jingchuan Wang

We present a unified framework capable of solving a broad range of 3D tasks. Our approach features a stateful recurrent model that continuously updates its state representation with each new observation. Given a stream of images, this…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Qianqian Wang , Yifei Zhang , Aleksander Holynski , Alexei A. Efros , Angjoo Kanazawa

In this paper, we introduce POMA-3D, the first self-supervised 3D representation model learned from point maps. Point maps encode explicit 3D coordinates on a structured 2D grid, preserving global 3D geometry while remaining compatible with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Ye Mao , Weixun Luo , Ranran Huang , Junpeng Jing , Krystian Mikolajczyk

Promptable segmentation has emerged as a powerful paradigm in computer vision, enabling users to guide models in parsing complex scenes with prompts such as clicks, boxes, or textual cues. Recent advances, exemplified by the Segment…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yoonwoo Jeong , Cheng Sun , Yu-Chiang Frank Wang , Minsu Cho , Jaesung Choe