English
Related papers

Related papers: Modeling Ambient Scene Dynamics for Free-view Synt…

200 papers

The recent advent of 3D Gaussian Splatting (3DGS) has revolutionized the 3D scene reconstruction space enabling high-fidelity novel view synthesis in real-time. However, with the exception of RawNeRF, all prior 3DGS and NeRF-based methods…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Shreyas Singh , Aryan Garg , Kaushik Mitra

Novel view synthesis of urban scenes is essential for autonomous driving-related applications.Existing NeRF and 3DGS-based methods show promising results in achieving photorealistic renderings but require slow, per-scene optimization. We…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Sheng Miao , Jiaxin Huang , Dongfeng Bai , Xu Yan , Hongyu Zhou , Yue Wang , Bingbing Liu , Andreas Geiger , Yiyi Liao

Text-driven 3D indoor scene generation holds broad applications, ranging from gaming and smart homes to AR/VR applications. Fast and high-fidelity scene generation is paramount for ensuring user-friendly experiences. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yikun Ma , Dandan Zhan , Zhi Jin

In this paper, we aim to jointly model the geometry, appearance, and physical information of 3D scenes solely from dynamic multi-view videos, without relying on any physical priors. Existing works typically employ physical losses merely as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Nengbo Lu , Bin Zhao

Synthesizing novel views for urban environments is crucial for tasks like autonomous driving and virtual tours. Compared to object-level or indoor situations, outdoor settings present unique challenges, such as inconsistency across frames…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Mreenav Shyam Deka , Lu Sang , Daniel Cremers

Novel view synthesis for underwater scene reconstruction presents unique challenges due to complex light-media interactions. Optical scattering and absorption in water body bring inhomogeneous medium attenuation interference that disrupts…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Jieyu Yuan , Yujun Li , Yuanlin Zhang , Chunle Guo , Xiongxin Tang , Ruixing Wang , Chongyi Li

Controllable generative models for images and videos have seen significant success, yet 3D scene generation, especially in unbounded scenarios like autonomous driving, remains underdeveloped. Existing methods lack flexible controllability…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Ruiyuan Gao , Kai Chen , Zhihao Li , Lanqing Hong , Zhenguo Li , Qiang Xu

In this paper, we report on a parallel freeviewpoint video synthesis algorithm that can efficiently reconstruct a high-quality 3D scene representation of sports scenes. The proposed method focuses on a scene that is captured by multiple…

Computer Vision and Pattern Recognition · Computer Science 2019-08-01 Jun Chen , Ryosuke Watanabe , Keisuke Nonaka , Tomoaki Konno , Hiroshi Sankoh , Sei Naito

We present TrackGS, a novel method to integrate global feature tracks with 3D Gaussian Splatting (3DGS) for COLMAP-free novel view synthesis. While 3DGS delivers impressive rendering quality, its reliance on accurate precomputed camera…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Dongbo Shi , Shen Cao , Lubin Fan , Bojian Wu , Jinhui Guo , Ligang Liu , Renjie Chen

Rendering photo-realistic novel-view images of complex scenes has been a long-standing challenge in computer graphics. In recent years, great research progress has been made on enhancing rendering quality and accelerating rendering speed in…

Graphics · Computer Science 2024-02-21 Tiansong Zhou , Yebin Liu , Xuangeng Chu , Chengkun Cao , Changyin Zhou , Fei Yu , Yu Li

Dynamic reconstruction and spatiotemporal novel-view synthesis of non-rigidly deforming scenes recently gained increased attention. While existing work achieves impressive quality and performance on multi-view or teleporting camera setups,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Moritz Kappel , Florian Hahlbohm , Timon Scholz , Susana Castillo , Christian Theobalt , Martin Eisemann , Vladislav Golyanik , Marcus Magnor

Reconstructing dynamic humans together with static scenes from monocular videos remains difficult, especially under fast motion, where RGB frames suffer from motion blur. Event cameras exhibit distinct advantages, e.g., microsecond temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Xiaoting Yin , Hao Shi , Kailun Yang , Jiajun Zhai , Shangwei Guo , Lin Wang , Kaiwei Wang

Implicit neural representation and explicit 3D Gaussian Splatting (3D-GS) for novel view synthesis have achieved remarkable progress with frame-based camera (e.g. RGB and RGB-D cameras) recently. Compared to frame-based camera, a novel type…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jian Huang , Chengrui Dong , Xuanhua Chen , Peidong Liu

Achieving truly practical dynamic 3D reconstruction requires online operation, global pose and map consistency, detailed appearance modeling, and the flexibility to handle both RGB and RGB-D inputs. However, existing SLAM methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Shi Chen , Erik Sandström , Sandro Lombardi , Siyuan Li , Martin R. Oswald

We present a novel framework for animating humans in 3D scenes using 3D Gaussian Splatting (3DGS), a neural scene representation that has recently achieved state-of-the-art photorealistic results for novel-view synthesis but remains…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Aymen Mir , Jian Wang , Riza Alp Guler , Chuan Guo , Gerard Pons-Moll , Bing Zhou

Deformable 3D Gaussian Splatting (3D-GS) is limited by missing intermediate motion information due to the low temporal resolution of RGB cameras. To address this, we introduce the first approach combining event cameras, which capture…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Wenhao Xu , Wenming Weng , Yueyi Zhang , Ruikang Xu , Zhiwei Xiong

Despite the substantial progress of novel view synthesis, existing methods, either based on the Neural Radiance Fields (NeRF) or more recently 3D Gaussian Splatting (3DGS), suffer significant degradation when the input becomes sparse.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Rui Peng , Wangze Xu , Luyang Tang , Liwei Liao , Jianbo Jiao , Ronggang Wang

3D Gaussian Splatting (3DGS) allows flexible adjustments to scene representation, enabling continuous optimization of scene quality during dense visual simultaneous localization and mapping (SLAM) in static environments. However, 3DGS faces…

Robotics · Computer Science 2024-11-26 Long Wen , Shixin Li , Yu Zhang , Yuhong Huang , Jianjie Lin , Fengjunjie Pan , Zhenshan Bing , Alois Knoll

3D Gaussian Splatting has recently enabled fast and photorealistic reconstruction of static 3D scenes. However, dynamic editing of such scenes remains a significant challenge. We introduce a novel framework, Physics-Guided Score…

Graphics · Computer Science 2026-03-26 Gal Fiebelman , Hadar Averbuch-Elor , Sagie Benaim

3D scene generation seeks to synthesize spatially structured, semantically meaningful, and photorealistic environments for applications such as immersive media, robotics, autonomous driving, and embodied AI. Early methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Beichen Wen , Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu