English
Related papers

Related papers: Motion4D: Learning 3D-Consistent Motion and Semant…

200 papers

Recent advances in 4D Gaussian Splatting (4DGS) editing still face challenges with view, temporal, and non-editing region consistency, as well as with handling complex text instructions. To address these issues, we propose 4DGS-Craft, a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Lei Liu , Can Wang , Zhenghao Chen , Dong Xu

This paper addresses the challenge of learning semantically and functionally meaningful 3D motion priors from real-world videos, in order to enable prediction of future 3D scene motion from a single input image. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Jiahui Lei , Kyle Genova , George Kopanas , Noah Snavely , Leonidas Guibas

Recent semantic 3D Gaussian Splatting (3DGS) methods primarily rely on 2D foundation models, often yielding ambiguous boundaries and limited support for structured urban semantics. While city models such as CityGML encode hierarchically…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Qilin Zhang , Jinyu Zhu , Olaf Wysocki , Benjamin Busam , Boris Jutzi

Dynamic Gaussian Splatting approaches have achieved remarkable performance for 4D scene reconstruction. However, these approaches rely on dense-frame video sequences for photorealistic reconstruction. In real-world scenarios, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Changyue Shi , Chuxiao Yang , Xinyuan Hu , Minghao Chen , Wenwen Pan , Yan Yang , Jiajun Ding , Zhou Yu , Jun Yu

Open-vocabulary 3D scene understanding presents a significant challenge in computer vision, with wide-ranging applications in embodied agents and augmented reality systems. Existing methods adopt neurel rendering methods as 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jun Guo , Xiaojian Ma , Yue Fan , Huaping Liu , Qing Li

Reconstructing Dynamic 3D Gaussian Splatting (3DGS) from low-framerate RGB videos is challenging. This is because large inter-frame motions will increase the uncertainty of the solution space. For example, one pixel in the first frame might…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Junhao He , Jiaxu Wang , Jia Li , Mingyuan Sun , Qiang Zhang , Jiahang Cao , Ziyi Zhang , Yi Gu , Jingkai Sun , Renjing Xu

3D Gaussian Splatting (3DGS) has emerged as a powerful explicit representation enabling real-time, high-fidelity 3D reconstruction and novel view synthesis. However, its practical use is hindered by the massive memory and computational…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Seokhyun Youn , Soohyun Lee , Geonho Kim , Weeyoung Kwon , Sung-Ho Bae , Jihyong Oh

Handling the dynamic environments is a significant research challenge in Visual Simultaneous Localization and Mapping (SLAM). Recent research combines 3D Gaussian Splatting (3DGS) with SLAM to achieve both robust camera pose estimation and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Yunsong Wang , Gim Hee Lee

Reconstructing and tracking dynamic 3D scenes remains a fundamental challenge in computer vision. Existing approaches often decouple geometry from motion: multi-view reconstruction methods assume static scenes, while dynamic tracking…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Shenhan Qian , Ganlin Zhang , Shangzhe Wu , Daniel Cremers

World models have made significant progress in modeling dynamic environments; however, most embodied world models are still restricted to 2D representations, lacking the comprehensive multi-view information essential for embodied spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Peiyan Tu , Hanxin Zhu , Jingwen Sun , Shaojie Ren , Cong Wang , Jiayi Luo , Xiaoqian Cheng , Zhibo Chen

Gaussian Splatting and its dynamic extensions are effective for reconstructing 3D scenes from 2D images when there is significant camera movement to facilitate motion parallax and when scene objects remain relatively static. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Liuyue Xie , Joel Julin , Koichiro Niinuma , Laszlo A. Jeni

Forecasting future scenarios in dynamic environments is essential for intelligent decision-making and navigation, a challenge yet to be fully realized in computer vision and robotics. Traditional approaches like video prediction and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Boming Zhao , Yuan Li , Ziyu Sun , Lin Zeng , Yujun Shen , Rui Ma , Yinda Zhang , Hujun Bao , Zhaopeng Cui

Scene understanding based on 3D Gaussian Splatting (3DGS) has recently achieved notable advances. Although 3DGS related methods have efficient rendering capabilities, they fail to address the inherent contradiction between the anisotropic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Q. G. Duan , Benyun Zhao , Mingqiao Han Yijun Huang , Ben M. Chen

Dynamic extensions of 3D Gaussian Splatting (3DGS) achieve high-quality reconstructions through neural motion fields, but per-Gaussian neural inference makes these models computationally expensive. Building on DeformableGS, we introduce…

Graphics · Computer Science 2026-03-31 Allen Tu , Haiyang Ying , Alex Hanson , Yonghan Lee , Tom Goldstein , Matthias Zwicker

We introduce Style4D-Bench, the first benchmark suite specifically designed for 4D stylization, with the goal of standardizing evaluation and facilitating progress in this emerging area. Style4D-Bench comprises: 1) a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Beiqi Chen , Shuai Shao , Haitang Feng , Jianhuang Lai , Jianlou Si , Guangcong Wang

High-fidelity reconstruction of driving scenes is crucial for autonomous driving. While recent feedforward 3D Gaussian Splatting (3DGS) methods enable fast reconstruction, their per-pixel Gaussian prediction paradigm often suffers from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Cheng Chi , Xianqi Wang , Hongcheng Luo , Mingfei Tu , Gangwei Xu , Zehan Zhang , Bing Wang , Guang Chen , Hangjun Ye , Sida Peng , Xin Yang , Haiyang Sun

We present a method that simultaneously addresses the tasks of dynamic scene novel-view synthesis and six degree-of-freedom (6-DOF) tracking of all dense scene elements. We follow an analysis-by-synthesis framework, inspired by recent work…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Jonathon Luiten , Georgios Kopanas , Bastian Leibe , Deva Ramanan

We reinterpret 4D Gaussian Splatting as a continuous-time dynamical system, where scene motion arises from integrating a learned neural dynamical field rather than applying per-frame deformations. This formulation, which we call EvoGS,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Arnold Caleb Asiimwe , Carl Vondrick

Generative models have achieved success in producing apparently coherent 2D videos, but remain challenging in the physical world due to lack of 4D spatiotemporal scale. Typically, existing 4D generative models directly embed macro scale…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Haonan Wang , Hanyu Zhou , Tao Gu , Luxin Yan

3D occupancy prediction is critical for comprehensive scene understanding in vision-centric autonomous driving. Recent advances have explored utilizing 3D semantic Gaussians to model occupancy while reducing computational overhead, but they…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Xiaoyang Yan , Muleilan Pei , Shaojie Shen