English
Related papers

Related papers: Space-Time Forecasting of Dynamic Scenes with Moti…

200 papers

We reinterpret 4D Gaussian Splatting as a continuous-time dynamical system, where scene motion arises from integrating a learned neural dynamical field rather than applying per-frame deformations. This formulation, which we call EvoGS,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Arnold Caleb Asiimwe , Carl Vondrick

In this paper, we tackle the problem of scene-aware 3D human motion forecasting. A key challenge of this task is to predict future human motions that are consistent with the scene by modeling the human-scene interactions. While recent works…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Chaoyue Xing , Wei Mao , Miaomiao Liu

3D Gaussian Splatting, known for enabling high-quality static scene reconstruction with fast rendering, is increasingly being applied to multi-view dynamic scene reconstruction. A common strategy involves learning a deformation field to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Han Jiao , Jiakai Sun , Yexing Xu , Lei Zhao , Wei Xing , Huaizhong Lin

Forecasting human trajectories is critical for tasks such as robot crowd navigation and autonomous driving. Modeling social interactions is of great importance for accurate group-wise motion prediction. However, most existing methods do not…

Computer Vision and Pattern Recognition · Computer Science 2020-05-06 Yuying Chen , Congcong Liu , Bertram Shi , Ming Liu

Dynamic Scene Graph Generation (DSGG) aims to structurally model objects and their dynamic interactions in video sequences for high-level semantic understanding. However, existing methods struggle with fine-grained relationship modeling,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xuejiao Wang , Bohao Zhang , Changbo Wang , Gaoqi He

Stochastic video prediction enables the consideration of uncertainty in future motion, thereby providing a better reflection of the dynamic nature of the environment. Stochastic video prediction methods based on image auto-regressive…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Fei Cui , Jiaojiao Fang , Xiaojiang Wu , Zelong Lai , Mengke Yang , Menghan Jia , Guizhong Liu

Combining accurate geometry with rich semantics has been proven to be highly effective for language-guided robotic manipulation. Existing methods for dynamic scenes either fail to update in real-time or rely on additional depth sensors for…

Robotics · Computer Science 2024-10-22 Yu Sheng , Runfeng Lin , Lidian Wang , Quecheng Qiu , YanYong Zhang , Yu Zhang , Bei Hua , Jianmin Ji

Gaussian splatting has emerged as a powerful tool for high-fidelity reconstruction of dynamic scenes. However, existing methods primarily rely on implicit motion representations, such as encoding motions into neural networks or per-Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Xinyu Zhang , Haonan Chang , Yuhan Liu , Abdeslam Boularias

Modeling dynamic, large-scale urban scenes is challenging due to their highly intricate geometric structures and unconstrained dynamics in both space and time. Prior methods often employ high-level architectural priors, separating static…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yurui Chen , Chun Gu , Junzhe Jiang , Xiatian Zhu , Li Zhang

Dynamic scene graph generation extends scene graph generation from images to videos by modeling entity relationships and their temporal evolution. However, existing methods either generate scene graphs from observed frames without…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Yi Yang , Yuren Cong , Hao Cheng , Bodo Rosenhahn , Michael Ying Yang

Reconstructing dynamic 3D scenes from monocular video remains fundamentally challenging due to the need to jointly infer motion, structure, and appearance from limited observations. Existing dynamic scene reconstruction methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jiahui Li , Shengeng Tang , Jingxuan He , Gang Huang , Zhangye Wang , Yantao Pan , Lechao Cheng

Novel view synthesis has shown rapid progress recently, with methods capable of producing increasingly photorealistic results. 3D Gaussian Splatting has emerged as a promising method, producing high-quality renderings of scenes and enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Richard Shaw , Michal Nazarczuk , Jifei Song , Arthur Moreau , Sibi Catley-Chandar , Helisa Dhamo , Eduardo Perez-Pellitero

Recent advances in 3D Gaussian Splatting (3DGS) deliver striking photorealism, and extending it to large scenes opens new opportunities for semantic reasoning and prediction in applications such as autonomous driving. Today's…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Shengkai Zhang , Yuhe Liu , Jianhua He , Xuedou Xiao , Mozi Chen , Kezhong Liu

The reconstruction of dynamic 3D scenes using 3D Gaussian Splatting has shown significant promise. A key challenge, however, remains in modeling realistic motion, as most methods fail to align the motion of Gaussians with real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Junoh Lee , Junmyeong Lee , Yeon-Ji Song , Inhwan Bae , Jisu Shin , Hae-Gon Jeon , Jin-Hwa Kim

We present a method that simultaneously addresses the tasks of dynamic scene novel-view synthesis and six degree-of-freedom (6-DOF) tracking of all dense scene elements. We follow an analysis-by-synthesis framework, inspired by recent work…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Jonathon Luiten , Georgios Kopanas , Bastian Leibe , Deva Ramanan

We present an efficient neural 3D scene representation for novel-view synthesis (NVS) in large-scale, dynamic urban areas. Existing works are not well suited for applications like mixed-reality or closed-loop simulation due to their limited…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Tobias Fischer , Jonas Kulhanek , Samuel Rota Bulò , Lorenzo Porzi , Marc Pollefeys , Peter Kontschieder

Volumetric video is emerging as a key medium for digitizing the dynamic physical world, creating the virtual environments with six degrees of freedom to deliver immersive user experiences. However, robustly modeling general dynamic scenes,…

Recent advances in world models have demonstrated strong capabilities in simulating physical reality, making them an increasingly important foundation for embodied intelligence. For UAV agents in particular, accurate prediction of complex…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Zile Guo , Zhan Chen , Enze Zhu , Kan Wei , Yongkang Zou , Xiaoxuan Liu , Lei Wang

We focus on the problem of planning the motion of a robot in a dynamic multiagent environment such as a pedestrian scene. Enabling the robot to navigate safely and in a socially compliant fashion in such scenes requires a representation…

Robotics · Computer Science 2022-03-17 Allan Wang , Christoforos Mavrogiannis , Aaron Steinfeld

Dynamic scene reconstruction in autonomous driving remains a fundamental challenge due to significant temporal variations, moving objects, and complex scene dynamics. Existing feed-forward 3D models have demonstrated strong performance in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Zhuolin He , Jing Li , Guanghao Li , Xiaolei Chen , Jiacheng Tang , Siyang Zhang , Zhounan Jin , Feipeng Cai , Bin Li , Jian Pu , Jia Cai , Xiangyang Xue