English
Related papers

Related papers: 4D Gaussian Splatting as a Learned Dynamical Syste…

200 papers

Novel view synthesis of urban scenes is essential for autonomous driving-related applications.Existing NeRF and 3DGS-based methods show promising results in achieving photorealistic renderings but require slow, per-scene optimization. We…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Sheng Miao , Jiaxin Huang , Dongfeng Bai , Xu Yan , Hongyu Zhou , Yue Wang , Bingbing Liu , Andreas Geiger , Yiyi Liao

Forecasting future scenarios in dynamic environments is essential for intelligent decision-making and navigation, a challenge yet to be fully realized in computer vision and robotics. Traditional approaches like video prediction and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Boming Zhao , Yuan Li , Ziyu Sun , Lin Zeng , Yujun Shen , Rui Ma , Yinda Zhang , Hujun Bao , Zhaopeng Cui

We introduce Gaussian-Flow, a novel point-based approach for fast dynamic scene reconstruction and real-time rendering from both multi-view and monocular videos. In contrast to the prevalent NeRF-based approaches hampered by slow training…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Youtian Lin , Zuozhuo Dai , Siyu Zhu , Yao Yao

Reconstructing a dynamic target moving over a large area is challenging. Standard approaches for dynamic object reconstruction require dense coverage in both the viewing space and the temporal dimension, typically relying on multi-view…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jun-Jee Chao , Volkan Isler

The recent development of 3D Gaussian Splatting (3DGS) has led to great interest in 4D dynamic spatial reconstruction. Existing approaches mainly rely on full-length multi-view videos, while there has been limited exploration of online…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Zhening Liu , Yingdong Hu , Xinjie Zhang , Rui Song , Jiawei Shao , Zehong Lin , Jun Zhang

Dynamic novel view synthesis (NVS) is essential for creating immersive experiences. Existing approaches have advanced dynamic NVS by introducing 3D Gaussian Splatting (3DGS) with implicit deformation fields or indiscriminately assigned…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Kaizhe Zhang , Yijie Zhou , Weizhan Zhang , Caixia Yan , Haipeng Du , yugui xie , Yu-Hui Wen , Yong-Jin Liu

In the domain of 3D scene representation, 3D Gaussian Splatting (3DGS) has emerged as a pivotal technology. However, its application to large-scale, high-resolution scenes (exceeding 4k$\times$4k pixels) is hindered by the excessive…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Wenkai Liu , Tao Guan , Bin Zhu , Lili Ju , Zikai Song , Dan Li , Yuesong Wang , Wei Yang

We present SpectroMotion, a novel approach that combines 3D Gaussian Splatting (3DGS) with physically-based rendering (PBR) and deformation fields to reconstruct dynamic specular scenes. Previous methods extending 3DGS to model dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Cheng-De Fan , Chen-Wei Chang , Yi-Ruei Liu , Jie-Ying Lee , Jiun-Long Huang , Yu-Chee Tseng , Yu-Lun Liu

The recent advance in neural rendering has enabled the ability to reconstruct high-quality 4D scenes using neural networks. Although 4D neural reconstruction is popular, registration for such representations remains a challenging task,…

Robotics · Computer Science 2024-07-30 Yiming Huang , Beilei Cui , Ikemura Kei , Jiekai Zhang , Long Bai , Hongliang Ren

4D Gaussian Splatting (4DGS) enables high-quality dynamic novel view synthesis, yet current models remain monolithic bitstreams that clients must download in full before any frame can be rendered, causing black-screen waits of tens to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Jiachen Li , Guangzhi Han , Jin Wan , Delong Han , Yuan Gao , Min Li , Mingle Zhou , Gang Li

As consumer Virtual Reality (VR) and Mixed Reality (MR) technologies gain momentum, there's a growing focus on the development of engagements with 3D virtual content. Unfortunately, traditional techniques for content creation, editing, and…

Human-Computer Interaction · Computer Science 2024-05-07 Ying Jiang , Chang Yu , Tianyi Xie , Xuan Li , Yutao Feng , Huamin Wang , Minchen Li , Henry Lau , Feng Gao , Yin Yang , Chenfanfu Jiang

3D Gaussian Splatting (3DGS) has recently gained popularity for efficient scene rendering by representing scenes as explicit sets of anisotropic 3D Gaussians. However, most existing work focuses primarily on modeling external surfaces. In…

Image and Video Processing · Electrical Eng. & Systems 2026-01-12 Shuxin Liang , Yihan Xiao , Wenlu Tang

Egocentric scenes exhibit frequent occlusions, varied viewpoints, and dynamic interactions compared to typical scene understanding tasks. Occlusions and varied viewpoints can lead to multi-view semantic inconsistencies, while dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Di Li , Jie Feng , Jiahao Chen , Weisheng Dong , Guanbin Li , Guangming Shi , Licheng Jiao

4D content generation has achieved remarkable progress recently. However, existing methods suffer from long optimization times, a lack of motion controllability, and a low quality of details. In this paper, we introduce DreamGaussian4D…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jiawei Ren , Liang Pan , Jiaxiang Tang , Chi Zhang , Ang Cao , Gang Zeng , Ziwei Liu

3D Gaussian Splatting (3DGS) has shown promising results for 3D scene modeling using mixtures of Gaussians, yet its existing simultaneous localization and mapping (SLAM) variants typically rely on direct, deterministic pose optimization…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Yuhan Zhu , Yanyu Zhang , Jie Xu , Wei Ren

Understanding dynamic 3D environments is essential for safe autonomous driving, particularly when reasoning about human-centric, nonrigid agents. However, existing weakly supervised occupancy prediction frameworks predominantly assume…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yang Gao , Wuyang Li , Po-Chien Luan , Alexandre Alahi

This paper aims to tackle the problem of modeling dynamic urban streets for autonomous driving scenes. Recent methods extend NeRF by incorporating tracked vehicle poses to animate vehicles, enabling photo-realistic view synthesis of dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Yunzhi Yan , Haotong Lin , Chenxu Zhou , Weijie Wang , Haiyang Sun , Kun Zhan , Xianpeng Lang , Xiaowei Zhou , Sida Peng

3D Gaussian Splatting (3DGS) has gained significant attention for its real-time, photo-realistic rendering in novel-view synthesis and 3D modeling. However, existing methods struggle with accurately modeling in-the-wild scenes affected by…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Chuanyu Fu , Guanying Chen , Yuqi Zhang , Kunbin Yao , Yuan Xiong , Chuan Huang , Shuguang Cui , Yasuyuki Matsushita , Xiaochun Cao

Gaussian Splatting has emerged as a prominent 3D representation in novel view synthesis, but it still suffers from appearance variations, which are caused by various factors, such as modern camera ISPs, different time of day, weather…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Jiaqi Lin , Zhihao Li , Binxiao Huang , Xiao Tang , Jianzhuang Liu , Shiyong Liu , Xiaofei Wu , Fenglong Song , Wenming Yang

We present Inst4DGS, an instance-decomposed 4D Gaussian Splatting (4DGS) approach with long-horizon per-Gaussian trajectories. While dynamic 4DGS has advanced rapidly, instance-decomposed 4DGS remains underexplored, largely due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yonghan Lee , Dinesh Manocha