English
Related papers

Related papers: 4DSTR: Advancing Generative 4D Gaussians with Spat…

200 papers

In recent years, the increasing demand for dynamic 3D assets in design and gaming applications has given rise to powerful generative pipelines capable of synthesizing high-quality 4D objects. Previous methods generally rely on score…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Qi Sun , Zhiyang Guo , Ziyu Wan , Jing Nathan Yan , Shengming Yin , Wengang Zhou , Jing Liao , Houqiang Li

In this work, we introduce a novel approach for creating controllable dynamics in 3D-generated Gaussians using casually captured reference videos. Our method transfers the motion of objects from reference videos to a variety of generated 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Zhoujie Fu , Jiacheng Wei , Wenhao Shen , Chaoyue Song , Xiaofeng Yang , Fayao Liu , Xulei Yang , Guosheng Lin

Combining 3D Gaussian splatting with Simultaneous Localization and Mapping (SLAM) has gained popularity as it enables continuous 3D environment reconstruction during motion. However, existing methods struggle in dynamic environments,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Yangfan Zhao , Hanwei Zhang , Ke Huang , Qiufeng Wang , Zhenzhou Shao , Dengyu Wu

Reconstructing urban scenes is challenging due to their complex geometries and the presence of potentially dynamic objects. 3D Gaussian Splatting (3DGS)-based methods have shown strong performance, but existing approaches often incorporate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Ziwen Li , Jiaxin Huang , Runnan Chen , Yunlong Che , Yandong Guo , Tongliang Liu , Fakhri Karray , Mingming Gong

4D mesh generation has recently emerged as a powerful paradigm for recovering dynamic 3D structure from videos, but existing methods remain slow, computationally expensive, and difficult to scale to longer sequences. We introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Dvir Samuel , Yuval Atzmon , Gal Chechik , Yoni Kasten

3D Gaussian Splatting (3DGS) has become one of the most influential works in the past year. Due to its efficient and high-quality novel view synthesis capabilities, it has been widely adopted in many research fields and applications.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Glenn Grubert , Florian Barthel , Anna Hilsmann , Peter Eisert

The emergence of 3D Gaussian Splatting (3DGS) has significantly advanced Novel View Synthesis (NVS) through explicit scene representation, enabling real-time photorealistic rendering. However, existing approaches manifest two critical…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Zheng Zhou , Yu-Jie Xiong , Jia-Chen Zhang , Chun-Ming Xia , Xihe Qiu , Hongjian Zhan

4D Gaussian Splatting has emerged as a new paradigm for dynamic scene representation, enabling real-time rendering of scenes with complex motions. However, it faces a major challenge of storage overhead, as millions of Gaussians are…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Minseo Lee , Byeonghyeon Lee , Lucas Yunkyu Lee , Eunsoo Lee , Sangmin Kim , Seunghyeon Song , Joo Chan Lee , Jong Hwan Ko , Jaesik Park , Eunbyung Park

We present Free4D, a novel tuning-free framework for 4D scene generation from a single image. Existing methods either focus on object-level generation, making scene-level generation infeasible, or rely on large-scale multi-view video…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Tianqi Liu , Zihao Huang , Zhaoxi Chen , Guangcong Wang , Shoukang Hu , Liao Shen , Huiqiang Sun , Zhiguo Cao , Wei Li , Ziwei Liu

4D generation, or dynamic 3D content generation, integrates spatial, temporal, and view dimensions to model realistic dynamic scenes, playing a foundational role in advancing world models and physical AI. However, maintaining long-chain…

Graphics · Computer Science 2026-04-01 Yuanbin Man , Ying Huang , Zhile Ren , Miao Yin

We present Stable Video 4D 2.0 (SV4D 2.0), a multi-view video diffusion model for dynamic 3D asset generation. Compared to its predecessor SV4D, SV4D 2.0 is more robust to occlusions and large motion, generalizes better to real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Chun-Han Yao , Yiming Xie , Vikram Voleti , Huaizu Jiang , Varun Jampani

3D Gaussian Splatting (3DGS) enables high-fidelity real-time rendering, a key requirement for immersive applications. However, the extension of 3DGS to dynamic scenes remains limitations on the substantial data volume of dense Gaussians and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Jiayu Yang , Weijian Su , Songqian Zhang , Yuqi Han , Jinli Suo , Qiang Zhang

Generating dynamic 4D objects from sparse inputs is difficult because it demands joint preservation of appearance and motion coherence across views and time while suppressing artifacts and temporal drift. We hypothesize that the view…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Su Sun , Cheng Zhao , Himangi Mittal , Gaurav Mittal , Rohith Kukkala , Yingjie Victor Chen , Mei Chen

Gaussian Splatting (GS) is a popular approach for 3D reconstruction, mostly due to its ability to converge reasonably fast, faithfully represent the scene and render (novel) views in a fast fashion. However, it suffers from large storage…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Anil Armagan , Albert Saà-Garriga , Bruno Manganelli , Kyuwon Kim , M. Kerim Yucel

We present Inst4DGS, an instance-decomposed 4D Gaussian Splatting (4DGS) approach with long-horizon per-Gaussian trajectories. While dynamic 4DGS has advanced rapidly, instance-decomposed 4DGS remains underexplored, largely due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yonghan Lee , Dinesh Manocha

Synthesizing consistent and photorealistic 3D scenes is an open problem in computer vision. Video diffusion models generate impressive videos but cannot directly synthesize 3D representations, i.e., lack 3D consistency in the generated…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Katja Schwarz , Norman Mueller , Peter Kontschieder

Recent advancements in 3D Gaussian Splatting(3DGS) have significantly improved semantic scene understanding, enabling natural language queries to localize objects within a scene. However, existing methods primarily focus on embedding…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Xihan Wang , Dianyi Yang , Yu Gao , Yufeng Yue , Yi Yang , Mengyin Fu

Recently, the generation of dynamic 3D objects from a video has shown impressive results. Existing methods directly optimize Gaussians using whole information in frames. However, when dynamic regions are interwoven with static regions…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Liying Yang , Chen Liu , Zhenwei Zhu , Ajian Liu , Hui Ma , Jian Nong , Yanyan Liang

High-fidelity reconstruction of dynamic scenes is an important yet challenging problem. While recent 4D Gaussian Splatting (4DGS) has demonstrated the ability to model temporal dynamics, it couples Gaussian motion and geometric attributes…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yi Zhang , Yulei Kang , Jiangxin Sun , Beihao Xia , Jisheng Dang , Jian-Fang Hu

We tackle the challenge of generating dynamic 4D scenes from monocular, multi-object videos with heavy occlusions, and introduce GenMOJO, a novel approach that integrates rendering-based deformable 3D Gaussian optimization with generative…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Wen-Hsuan Chu , Lei Ke , Jianmeng Liu , Mingxiao Huo , Pavel Tokmakov , Katerina Fragkiadaki