English
Related papers

Related papers: Real-time Global Illumination for Dynamic 3D Gauss…

200 papers

Forecasting future scenarios in dynamic environments is essential for intelligent decision-making and navigation, a challenge yet to be fully realized in computer vision and robotics. Traditional approaches like video prediction and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Boming Zhao , Yuan Li , Ziyu Sun , Lin Zeng , Yujun Shen , Rui Ma , Yinda Zhang , Hujun Bao , Zhaopeng Cui

Rendering novel view images in dynamic scenes is a crucial yet challenging task. Current methods mainly utilize NeRF-based methods to represent the static scene and an additional time-variant MLP to model scene deformations, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Diwen Wan , Ruijie Lu , Gang Zeng

We tackle the task of learning dynamic 3D semantic radiance fields given a single monocular video as input. Our learned semantic radiance field captures per-point semantics as well as color and geometric properties for a dynamic 3D scene,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Isaac Labe , Noam Issachar , Itai Lang , Sagie Benaim

We present Deep Illumination, a novel machine learning technique for approximating global illumination (GI) in real-time applications using a Conditional Generative Adversarial Network. Our primary focus is on generating indirect…

Graphics · Computer Science 2018-05-24 Manu Mathew Thomas , Angus G. Forbes

3D Gaussian Splatting (3DGS) has become an emerging tool for dynamic scene reconstruction. However, existing methods focus mainly on extending static 3DGS into a time-variant representation, while overlooking the rich motion information…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhiyang Guo , Wengang Zhou , Li Li , Min Wang , Houqiang Li

3D Gaussian splatting (3DGS) is an emerging technique for photorealistic 3D scene rendering. However, rendering city-scale 3DGS scenes on resource-constrained mobile devices in real-time remains a significant challenge due to two…

Graphics · Computer Science 2025-09-29 Zheng Liu , He Zhu , Xinyang Li , Yirun Wang , Yujiao Shi , Yiming Gan , Wei Li , Jingwen Leng , Minyi Guo , Yu Feng

3D scene reconstruction and rendering are core tasks in computer vision, with applications spanning industrial monitoring, robotics, and autonomous driving. Recent advances in 3D Gaussian Splatting (GS) and its variants have achieved…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Chi-Shiang Gau , Konstantinos D. Polyzos , Athanasios Bacharis , Saketh Madhuvarasu , Tara Javidi

3D Gaussian Splatting techniques have enabled efficient photo-realistic rendering of static scenes. Recent works have extended these approaches to support surface reconstruction and tracking. However, tracking dynamic surfaces with 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Chengwei Zheng , Lixin Xue , Juan Zarate , Jie Song

Dynamic 3D scene representation and novel view synthesis are crucial for enabling immersive experiences required by AR/VR and metaverse applications. It is a challenging task due to the complexity of unconstrained real-world scenes and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Zeyu Yang , Zijie Pan , Xiatian Zhu , Li Zhang , Jianfeng Feng , Yu-Gang Jiang , Philip H. S. Torr

Implicit neural representation has paved the way for new approaches to dynamic scene reconstruction and rendering. Nonetheless, cutting-edge dynamic neural rendering methods rely heavily on these implicit representations, which frequently…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Ziyi Yang , Xinyu Gao , Wen Zhou , Shaohui Jiao , Yuqing Zhang , Xiaogang Jin

To achieve realistic immersion in landscape images, fluids such as water and clouds need to move within the image while revealing new scenes from various camera perspectives. Recently, a field called dynamic scene video has emerged, which…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 In-Hwan Jin , Haesoo Choo , Seong-Hun Jeong , Heemoon Park , Junghwan Kim , Oh-joon Kwon , Kyeongbo Kong

Recent advances in 3D content creation mostly leverage optimization-based 3D generation via score distillation sampling (SDS). Though promising results have been exhibited, these methods often suffer from slow per-sample optimization,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Jiaxiang Tang , Jiawei Ren , Hang Zhou , Ziwei Liu , Gang Zeng

This paper aims to tackle the problem of modeling dynamic urban streets for autonomous driving scenes. Recent methods extend NeRF by incorporating tracked vehicle poses to animate vehicles, enabling photo-realistic view synthesis of dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Yunzhi Yan , Haotong Lin , Chenxu Zhou , Weijie Wang , Haiyang Sun , Kun Zhan , Xianpeng Lang , Xiaowei Zhou , Sida Peng

The 3D Gaussian Splatting (3DGS)-based SLAM system has garnered widespread attention due to its excellent performance in real-time high-fidelity rendering. However, in real-world environments with dynamic objects, existing 3DGS-based SLAM…

Robotics · Computer Science 2025-02-19 Mingrui Li , Weijian Chen , Na Cheng , Jingyuan Xu , Dong Li , Hongyu Wang

3D Gaussian Splatting (3DGS) has gained significant attention for its real-time, photo-realistic rendering in novel-view synthesis and 3D modeling. However, existing methods struggle with accurately modeling in-the-wild scenes affected by…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Chuanyu Fu , Guanying Chen , Yuqi Zhang , Kunbin Yao , Yuan Xiong , Chuan Huang , Shuguang Cui , Yasuyuki Matsushita , Xiaochun Cao

Simultaneous localization and mapping (SLAM) systems with novel view synthesis capabilities are widely used in computer vision, with applications in augmented reality, robotics, and autonomous driving. However, existing approaches are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Vladimir Yugay , Theo Gevers , Martin R. Oswald

We present an efficient neural 3D scene representation for novel-view synthesis (NVS) in large-scale, dynamic urban areas. Existing works are not well suited for applications like mixed-reality or closed-loop simulation due to their limited…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Tobias Fischer , Jonas Kulhanek , Samuel Rota Bulò , Lorenzo Porzi , Marc Pollefeys , Peter Kontschieder

We present GI-GS, a novel inverse rendering framework that leverages 3D Gaussian Splatting (3DGS) and deferred shading to achieve photo-realistic novel view synthesis and relighting. In inverse rendering, accurately modeling the shading…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Hongze Chen , Zehong Lin , Jun Zhang

In the domain of 3D scene representation, 3D Gaussian Splatting (3DGS) has emerged as a pivotal technology. However, its application to large-scale, high-resolution scenes (exceeding 4k$\times$4k pixels) is hindered by the excessive…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Wenkai Liu , Tao Guan , Bin Zhu , Lili Ju , Zikai Song , Dan Li , Yuesong Wang , Wei Yang

Due to the complex and highly dynamic motions in the real world, synthesizing dynamic videos from multi-view inputs for arbitrary viewpoints is challenging. Previous works based on neural radiance field or 3D Gaussian splatting are limited…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Jiahao Wu , Rui Peng , Jianbo Jiao , Jiayu Yang , Luyang Tang , Kaiqiang Xiong , Jie Liang , Jinbo Yan , Runling Liu , Ronggang Wang