English
Related papers

Related papers: Sync4D: Video Guided Controllable Dynamics for Phy…

200 papers

Reconstructing dynamic 3D scenes from monocular videos is a fundamental yet highly challenging task, as real-world motions often involve both long-term smooth transformations and short-term complex deformations. Existing methods either…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Chenyu Wu , Wanhua Li , Zhu-Tian Chen , Hanspeter Pfister

Volumetric video has emerged as a key medium for immersive telepresence and augmented/virtual reality, enabling six-degrees-of-freedom (6DoF) navigation and realistic spatial interactions. However, delivering high-quality dynamic volumetric…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Houqiang Zhong , Zihan Zheng , Qiang Hu , Yuan Tian , Ning Cao , Lan Xu , Xiaoyun Zhang , Zhengxue Cheng , Li Song , Wenjun Zhang

Recently, Gaussian Splatting methods have emerged as a desirable substitute for prior Radiance Field methods for novel-view synthesis of scenes captured with multi-view images or videos. In this work, we propose a novel extension to 4D…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Karly Hou , Wanhua Li , Hanspeter Pfister

Existing dynamic scene generation methods mostly rely on distilling knowledge from pre-trained 3D generative models, which are typically fine-tuned on synthetic object datasets. As a result, the generated scenes are often object-centric and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Heng Yu , Chaoyang Wang , Peiye Zhuang , Willi Menapace , Aliaksandr Siarohin , Junli Cao , Laszlo A Jeni , Sergey Tulyakov , Hsin-Ying Lee

Reconstructing dynamic 3D scenes from blurry monocular videos is challenging as motion-induced blur entangles object motion and geometry, hindering geometric consistency. We present Kinematics-GS, a kinematics-aware framework that models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yeon-Ji Song , Kiyoung Kwon , Junoh Lee , Jin-Hwa Kim , Byoung-Tak Zhang

We present a novel video generation framework that integrates 3-dimensional geometry and dynamic awareness. To achieve this, we augment 2D videos with 3D point trajectories and align them in pixel space. The resulting 3D-aware video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Yunuo Chen , Junli Cao , Vidit Goel , Sergei Korolev , Chenfanfu Jiang , Jian Ren , Sergey Tulyakov , Anil Kag

Generating synthetic images is a useful method for cheaply obtaining labeled data for training computer vision models. However, obtaining accurate 3D models of relevant objects is necessary, and the resulting images often have a gap in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Bram Vanherle , Brent Zoomers , Jeroen Put , Frank Van Reeth , Nick Michiels

We present GP-4DGS, a novel framework that integrates Gaussian Processes (GPs) into 4D Gaussian Splatting (4DGS) for principled probabilistic modeling of dynamic scenes. While existing 4DGS methods focus on deterministic reconstruction,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Mijeong Kim , Jungtaek Kim , Bohyung Han

Recent advances in video diffusion models have enabled the generation of high-quality videos. However, these videos still suffer from unrealistic deformations, semantic violations, and physical inconsistencies that are largely rooted in the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Shurui Gui , Deep Anil Patel , Xiner Li , Martin Renqiang Min

Due to the fascinating generative performance of text-to-image diffusion models, growing text-to-3D generation works explore distilling the 2D generative priors into 3D, using the score distillation sampling (SDS) loss, to bypass the data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yu-Jie Yuan , Leif Kobbelt , Jiwen Liu , Yuan Zhang , Pengfei Wan , Yu-Kun Lai , Lin Gao

Generating dynamic 4D objects from sparse inputs is difficult because it demands joint preservation of appearance and motion coherence across views and time while suppressing artifacts and temporal drift. We hypothesize that the view…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Su Sun , Cheng Zhao , Himangi Mittal , Gaurav Mittal , Rohith Kukkala , Yingjie Victor Chen , Mei Chen

Simultaneously localizing camera poses and constructing Gaussian radiance fields in dynamic scenes establish a crucial bridge between 2D images and the 4D real world. Instead of removing dynamic objects as distractors and reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Yanyan Li , Youxu Fang , Zunjie Zhu , Kunyi Li , Yong Ding , Federico Tombari

Reconstructing dynamic 3D scenes from 2D images and generating diverse views over time is challenging due to scene complexity and temporal dynamics. Despite advancements in neural implicit models, limitations persist: (i) Inadequate Scene…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Zeyu Yang , Hongye Yang , Zijie Pan , Li Zhang

Physics-driven 4D dynamic simulation from static 3D scenes remains constrained by an overlooked contradiction: reliable motion supervision often relies on online video diffusion or optical-flow pipelines whose computational cost exceeds…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Changshe Zhang , Jie Feng , Siyu Chen , Guanbin Li , Ronghua Shang , Junpeng Zhang

Recent advancements in 2D and 3D generative models have expanded the capabilities of computer vision. However, generating high-quality 4D dynamic content from a single static image remains a significant challenge. Traditional methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jing Yang , Yufeng Yang

In recent years, there has been rapid development in 3D generation models, opening up new possibilities for applications such as simulating the dynamic movements of 3D objects and customizing their behaviors. However, current 3D generative…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Fangfu Liu , Hanyang Wang , Shunyu Yao , Shengjun Zhang , Jie Zhou , Yueqi Duan

In this paper, we propose Dynamics Transfer GAN; a new method for generating video sequences based on generative adversarial learning. The spatial constructs of a generated video sequence are acquired from the target image. The dynamics of…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Wissam J. Baddar , Geonmo Gu , Sangmin Lee , Yong Man Ro

3D Gaussians, as a low-level scene representation, typically involve thousands to millions of Gaussians. This makes it difficult to control the scene in ways that reflect the underlying dynamic structure, where the number of independent…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yunchao Zhang , Guandao Yang , Leonidas Guibas , Yanchao Yang

3D Gaussian Splatting (3DGS) has garnered significant attention due to its superior scene representation fidelity and real-time rendering performance, especially for dynamic 3D scene reconstruction (\textit{i.e.}, 4D reconstruction).…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Henan Wang , Hanxin Zhu , Xinliang Gong , Tianyu He , Xin Li , Zhibo Chen

Gaussian splatting has emerged as a powerful tool for high-fidelity reconstruction of dynamic scenes. However, existing methods primarily rely on implicit motion representations, such as encoding motions into neural networks or per-Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Xinyu Zhang , Haonan Chang , Yuhan Liu , Abdeslam Boularias