English
Related papers

Related papers: GS-DiT: Advancing Video Generation with Pseudo 4D …

200 papers

Reconstructing 3D scenes using 3D Gaussian Splatting (3DGS) from sparse views is an ill-posed problem due to insufficient information, often resulting in noticeable artifacts. While recent approaches have sought to leverage generative…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Xingyilang Yin , Qi Zhang , Jiahao Chang , Ying Feng , Qingnan Fan , Xi Yang , Chi-Man Pun , Huaqi Zhang , Xiaodong Cun

Creating controllable 3D human portraits from casual smartphone videos is highly desirable due to their immense value in AR/VR applications. The recent development of 3D Gaussian Splatting (3DGS) has shown improvements in rendering quality…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Alfredo Rivero , ShahRukh Athar , Zhixin Shu , Dimitris Samaras

The recent development of 3D Gaussian Splatting (3DGS) has led to great interest in 4D dynamic spatial reconstruction. Existing approaches mainly rely on full-length multi-view videos, while there has been limited exploration of online…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Zhening Liu , Yingdong Hu , Xinjie Zhang , Rui Song , Jiawei Shao , Zehong Lin , Jun Zhang

3D Gaussian Splatting (3DGS) has emerged as an efficient and high-fidelity paradigm for novel view synthesis. To adapt 3DGS for dynamic content, deformable 3DGS incorporates temporally deformable primitives with learnable latent embeddings…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Mufan Liu , Qi Yang , He Huang , Wenjie Huang , Zhenlong Yuan , Zhu Li , Yiling Xu

Current 4D Gaussian frameworks for dynamic scene reconstruction deliver impressive visual fidelity and rendering speed, however, the inherent trade-off between storage costs and the ability to characterize complex physical motions…

Graphics · Computer Science 2025-07-11 Wei Yao , Shuzhao Xie , Letian Li , Weixiang Zhang , Zhixin Lai , Shiqi Dai , Ke Zhang , Zhi Wang

Free-viewpoint video (FVV) enables immersive viewing experiences by allowing users to view scenes from arbitrary perspectives. As a prominent reconstruction technique for FVV generation, 4D Gaussian Splatting (4DGS) models dynamic scenes…

Graphics · Computer Science 2025-12-25 Zhe Wang , Jinghang Li , Yifei Zhu

The advent of 3D Gaussian splatting (3DGS) has significantly enhanced the quality of volumetric video representation. Meanwhile, in contrast to conventional volumetric video, 3DGS video poses significant challenges for streaming due to its…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Han Gong , Qiyue Li , Zhi Liu , Hao Zhou , Peng Yuan Zhou , Zhu Li , Jie Li

Recent Diffusion Transformers (DiTs) have shown impressive capabilities in generating high-quality single-modality content, including images, videos, and audio. However, it is still under-explored whether the transformer-based diffuser can…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Kai Wang , Shijian Deng , Jing Shi , Dimitrios Hatzinakos , Yapeng Tian

Point tracking aims to localize corresponding points across video frames, serving as a fundamental task for 4D reconstruction, robotics, and video editing. Existing methods commonly rely on shallow convolutional backbones such as ResNet…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Soowon Son , Honggyu An , Chaehyun Kim , Hyunah Ko , Jisu Nam , Dahyun Chung , Siyoon Jin , Jung Yi , Jaewon Min , Junhwa Hur , Seungryong Kim

3D Gaussian Splatting (3DGS) has demonstrated impressive novel view synthesis results while advancing real-time rendering performance. However, it relies heavily on the quality of the initial point cloud, resulting in blurring and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Zheng Zhang , Wenbo Hu , Yixing Lao , Tong He , Hengshuang Zhao

Generating 4D scenes from a single-view video is inherently ill-posed: a single viewpoint lacks the information needed to recover a complete, dynamic scene with full coverage. Existing methods are typically limited to monocular videos,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Tingxi Chen , Ke Hao , Yabo Chen , Zhengxue Cheng , Rong Xie , Li Song , Haibin Huang , Chi Zhang , Xuelong Li

Multi-view video reconstruction plays a vital role in computer vision, enabling applications in film production, virtual reality, and motion analysis. While recent advances such as 4D Gaussian Splatting (4DGS) have demonstrated impressive…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Zhixin Xu , Hengyu Zhou , Yuan Liu , Wenhan Xue , Hao Pan , Wenping Wang , Bin Wang

The dominant 3D Gaussian splatting (3DGS) acceleration methods fail to properly regulate the number of Gaussians during training, causing redundant computational time overhead. In this paper, we propose FastGS, a novel, simple, and general…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Shiwei Ren , Tianci Wen , Yongchun Fang , Biao Lu

Diffusion-based 2D virtual try-on (VTON) techniques have recently demonstrated strong performance, while the development of 3D VTON has largely lagged behind. Despite recent advances in text-guided 3D scene editing, integrating 2D VTON into…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yukang Cao , Masoud Hadi , Liang Pan , Ziwei Liu

Reconstructing dynamic 3D scenes from 2D images and generating diverse views over time is challenging due to scene complexity and temporal dynamics. Despite advancements in neural implicit models, limitations persist: (i) Inadequate Scene…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Zeyu Yang , Hongye Yang , Zijie Pan , Li Zhang

3D Gaussian Splatting (3DGS) has substantial potential for enabling photorealistic Free-Viewpoint Video (FVV) experiences. However, the vast number of Gaussians and their associated attributes poses significant challenges for storage and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Qiang Hu , Zihan Zheng , Houqiang Zhong , Sihua Fu , Li Song , XiaoyunZhang , Guangtao Zhai , Yanfeng Wang

Neural implicit representations, including Neural Distance Fields and Neural Radiance Fields, have demonstrated significant capabilities for reconstructing surfaces with complicated geometry and topology, and generating novel views of a…

Graphics · Computer Science 2024-02-08 Lin Gao , Jie Yang , Bo-Tao Zhang , Jia-Mu Sun , Yu-Jie Yuan , Hongbo Fu , Yu-Kun Lai

The advancement of 4D (i.e., sequential 3D) generation opens up new possibilities for lifelike experiences in various applications, where users can explore dynamic objects or characters from any viewpoint. Meanwhile, video generative models…

Graphics · Computer Science 2025-04-08 Yikai Wang , Guangce Liu , Xinzhou Wang , Zilong Chen , Jiafang Li , Xin Liang , Fuchun Sun , Jun Zhu

Dynamic scene reconstruction poses a persistent challenge in 3D vision. Deformable 3D Gaussian Splatting has emerged as an effective method for this task, offering real-time rendering and high visual fidelity. This approach decomposes a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Bing He , Yunuo Chen , Guo Lu , Qi Wang , Qunshan Gu , Rong Xie , Li Song , Wenjun Zhang

Generating realistic 3D objects from single-view images requires natural appearance, 3D consistency, and the ability to capture multiple plausible interpretations of unseen regions. Existing approaches often rely on fine-tuning pretrained…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Pufan Li , Bi'an Du , Wei Hu