English
Related papers

Related papers: Towards Physically Consistent 4D Scene Reconstruct…

200 papers

Dynamic novel view synthesis (NVS) is essential for creating immersive experiences. Existing approaches have advanced dynamic NVS by introducing 3D Gaussian Splatting (3DGS) with implicit deformation fields or indiscriminately assigned…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Kaizhe Zhang , Yijie Zhou , Weizhan Zhang , Caixia Yan , Haipeng Du , yugui xie , Yu-Hui Wen , Yong-Jin Liu

Recent breakthroughs in radiance fields have significantly advanced 3D scene reconstruction and novel view synthesis (NVS) in autonomous driving. Nevertheless, critical limitations persist: reconstruction-based methods exhibit substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yingshuang Zou , Yikang Ding , Chuanrui Zhang , Jiazhe Guo , Bohan Li , Xiaoyang Lyu , Feiyang Tan , Xiaojuan Qi , Haoqian Wang

Mapping and scene representation are fundamental to reliable planning and navigation in mobile robots. While purely geometric maps using voxel grids allow for general navigation, obtaining up-to-date spatial and semantically rich…

Robotics · Computer Science 2025-03-12 Tim Steinke , Martin Büchner , Niclas Vödisch , Abhinav Valada

Reconstructing dynamic, time-varying scenes with computed tomography (4D-CT) is a challenging and ill-posed problem common to industrial and medical settings. Existing 4D-CT reconstructions are designed for sparse sampling schemes that…

Image and Video Processing · Electrical Eng. & Systems 2021-04-26 Albert W. Reed , Hyojin Kim , Rushil Anirudh , K. Aditya Mohan , Kyle Champley , Jingu Kang , Suren Jayasuriya

Scene graph alignment establishes object correspondences between two 3D scene graphs constructed from partially overlapping observations. This enables efficient scene understanding and object-level relocalization when a robot revisits a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Gang Chen , Sebastián Barbas Laina , Stefan Leutenegger , Javier Alonso-Mora

Digitizing 3D static scenes and 4D dynamic events from multi-view images has long been a challenge in computer vision and graphics. Recently, 3D Gaussian Splatting (3DGS) has emerged as a practical and scalable reconstruction method,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Marko Mihajlovic , Sergey Prokudin , Siyu Tang , Robert Maier , Federica Bogo , Tony Tung , Edmond Boyer

Outdoor intelligent autonomous robotic operation relies on a sufficiently expressive map of the environment. Classical geometric mapping methods retain essential structural environment information, but lack a semantic understanding and…

Many existing autonomous driving paradigms involve a multi-stage discrete pipeline of tasks. To better predict the control signals and enhance user safety, an end-to-end approach that benefits from joint spatial-temporal feature learning is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Shengchao Hu , Li Chen , Penghao Wu , Hongyang Li , Junchi Yan , Dacheng Tao

Purpose. Localizing structures and estimating the motion of a specific target region are common problems for navigation during surgical interventions. Optical coherence tomography (OCT) is an imaging modality with a high spatial and…

Image and Video Processing · Electrical Eng. & Systems 2020-04-22 Marcel Bengs , Nils Gessert , Matthias Schlüter , Alexander Schlaefer

Existing techniques for dynamic scene reconstruction from multiple wide-baseline cameras primarily focus on reconstruction in controlled environments, with fixed calibrated cameras and strong prior constraints. This paper introduces a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Armin Mustafa , Marco Volino , Hansung Kim , Jean-Yves Guillemaut , Adrian Hilton

Closed-loop simulation is crucial for end-to-end autonomous driving. Existing sensor simulation methods (e.g., NeRF and 3DGS) reconstruct driving scenes based on conditions that closely mirror training data distributions. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Chaojun Ni , Guosheng Zhao , Xiaofeng Wang , Zheng Zhu , Wenkang Qin , Guan Huang , Chen Liu , Yuyin Chen , Yida Wang , Xueyang Zhang , Yifei Zhan , Kun Zhan , Peng Jia , Xianpeng Lang , Xingang Wang , Wenjun Mei

This paper presents an approach for reconstruction of 4D temporally coherent models of complex dynamic scenes. No prior knowledge is required of scene structure or camera calibration allowing reconstruction from multiple moving cameras.…

Computer Vision and Pattern Recognition · Computer Science 2016-03-29 Armin Mustafa , Hansung Kim , Jean-Yves Guillemaut , Adrian Hilton

Autonomous robotic systems require spatio-temporal understanding of dynamic environments to ensure reliable navigation and interaction. While Vision-Language Models (VLMs) provide open-world semantic priors, they lack grounding in 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Tin Stribor Sohn , Maximilian Dillitzer , Jason J. Corso , Eric Sax

Current generative models struggle to synthesize dynamic 4D driving scenes that simultaneously support temporal extrapolation and spatial novel view synthesis (NVS) without per-scene optimization. Bridging generation and novel view…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Hao Lu , Zhuang Ma , Guangfeng Jiang , Wenhang Ge , Bohan Li , Yuzhan Cai , Wenzhao Zheng , Yunpeng Zhang , Yingcong Chen

Occupancy is crucial for autonomous driving, providing essential geometric priors for perception and planning. However, existing methods predominantly rely on LiDAR-based occupancy annotations, which limits scalability and prevents…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Baijun Ye , Minghui Qin , Saining Zhang , Moonjun Gong , Shaoting Zhu , Zebang Shen , Luan Zhang , Lu Zhang , Hao Zhao , Hang Zhao

Video scene detection is the task of dividing videos into temporal semantic chapters. This is an important preliminary step before attempting to analyze heterogeneous video content. Recently, Optimal Sequential Grouping (OSG) was proposed…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Daniel Rotman , Yevgeny Yaroker , Elad Amrani , Udi Barzelay , Rami Ben-Ari

Visual-based perception is the key module for autonomous driving. Among those visual perception tasks, video object detection is a primary yet challenging one because of feature degradation caused by fast motion or multiple poses. Current…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Yiming Cui , Cheng Han , Dongfang Liu

Urban scene reconstruction is critical for autonomous driving, enabling structured 3D representations for data synthesis and closed-loop testing. Supervised approaches rely on costly human annotations and lack scalability, while current…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Chenpeng Su , Wenhua Wu , Chensheng Peng , Tianchen Deng , Zhe Liu , Hesheng Wang

Current point-based approaches encounter limitations in scalability and rendering quality when using large 3D point cloud maps because using them directly for novel view synthesis (NVS) leads to degraded visualizations. We identify the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Mohammad Altillawi , Fengyi Shen , Liudi Yang , Sai Manoj Prakhya , Ziyuan Liu

Although dynamic scene reconstruction has long been a fundamental challenge in 3D vision, the recent emergence of 3D Gaussian Splatting (3DGS) offers a promising direction by enabling high-quality, real-time rendering through explicit…

Graphics · Computer Science 2025-05-29 Zehao Li , Hao Jiang , Yujun Cai , Jianing Chen , Baolong Bi , Shuqin Gao , Honglong Zhao , Yiwei Wang , Tianlu Mao , Zhaoqi Wang