English

4D Driving Scene Generation With Stereo Forcing

Computer Vision and Pattern Recognition 2025-09-25 v1

Abstract

Current generative models struggle to synthesize dynamic 4D driving scenes that simultaneously support temporal extrapolation and spatial novel view synthesis (NVS) without per-scene optimization. Bridging generation and novel view synthesis remains a major challenge. We present PhiGenesis, a unified framework for 4D scene generation that extends video generation techniques with geometric and temporal consistency. Given multi-view image sequences and camera parameters, PhiGenesis produces temporally continuous 4D Gaussian splatting representations along target 3D trajectories. In its first stage, PhiGenesis leverages a pre-trained video VAE with a novel range-view adapter to enable feed-forward 4D reconstruction from multi-view images. This architecture supports single-frame or video inputs and outputs complete 4D scenes including geometry, semantics, and motion. In the second stage, PhiGenesis introduces a geometric-guided video diffusion model, using rendered historical 4D scenes as priors to generate future views conditioned on trajectories. To address geometric exposure bias in novel views, we propose Stereo Forcing, a novel conditioning strategy that integrates geometric uncertainty during denoising. This method enhances temporal coherence by dynamically adjusting generative influence based on uncertainty-aware perturbations. Our experimental results demonstrate that our method achieves state-of-the-art performance in both appearance and geometric reconstruction, temporal generation and novel view synthesis (NVS) tasks, while simultaneously delivering competitive performance in downstream evaluations. Homepage is at \href{https://jiangxb98.github.io/PhiGensis}{PhiGensis}.

Keywords

Cite

@article{arxiv.2509.20251,
  title  = {4D Driving Scene Generation With Stereo Forcing},
  author = {Hao Lu and Zhuang Ma and Guangfeng Jiang and Wenhang Ge and Bohan Li and Yuzhan Cai and Wenzhao Zheng and Yunpeng Zhang and Yingcong Chen},
  journal= {arXiv preprint arXiv:2509.20251},
  year   = {2025}
}
R2 v1 2026-07-01T05:54:23.690Z