English

FAST-GS: Frequency Aware Space-time Gaussian Splatting for Photorealistic Dynamic Novel View Synthesis

Computer Vision and Pattern Recognition 2026-08-03 v1 Artificial Intelligence

Abstract

4D Gaussian Splatting (4DGS) excels in dynamic 3D reconstruction and real-time novel view synthesis via efficient 4D Gaussian representations and parallelizable rendering. However, existing 4DGS approaches rely on a single polynomial to model motion, which limits performance in complex dynamic scenes where high-frequency motion components are prevalent, and fails to ensure long-term stability due to cumulative trajectory drift. To address these issues, we propose a Fourier Motion Modeling module: this paradigm decomposes motion into frequency-based sinusoidal components, capturing both low-frequency global trajectories and high-frequency local details to model complex motion patterns accurately. It retains the real-time rendering capability of 4DGS while improving complex motion fitting and long-term coherence. Additionally, we integrate a motion-aware regularization strategy into the loss function: it uses frequency-dependent weights to suppress high-frequency jitter while preserving low-frequency motion coherence. Extensive experiments on N3V and Google Immersive datasets from multiple scenarios demonstrate the effectiveness of our method.

Keywords

Cite

@article{arxiv.2608.01958,
  title  = {FAST-GS: Frequency Aware Space-time Gaussian Splatting for Photorealistic Dynamic Novel View Synthesis},
  author = {Zhengyang Zhang and Ziyu Lu and PengCheng Li and Hongbo Duan and Yi Liu and Pengting Luo and Peiyu Zhuang and Xinghui Li and Shaohua Ma},
  journal= {arXiv preprint arXiv:2608.01958},
  year   = {2026}
}

Comments

accepted by ICASSP2026