English

Structural Energy-Guided Sampling for View-Consistent Text-to-3D

Computer Vision and Pattern Recognition 2025-08-26 v1

Abstract

Text-to-3D generation often suffers from the Janus problem, where objects look correct from the front but collapse into duplicated or distorted geometry from other angles. We attribute this failure to viewpoint bias in 2D diffusion priors, which propagates into 3D optimization. To address this, we propose Structural Energy-Guided Sampling (SEGS), a training-free, plug-and-play framework that enforces multi-view consistency entirely at sampling time. SEGS defines a structural energy in a PCA subspace of intermediate U-Net features and injects its gradients into the denoising trajectory, steering geometry toward the intended viewpoint while preserving appearance fidelity. Integrated seamlessly into SDS/VSD pipelines, SEGS significantly reduces Janus artifacts, achieving improved geometric alignment and viewpoint consistency without retraining or weight modification.

Keywords

Cite

@article{arxiv.2508.16917,
  title  = {Structural Energy-Guided Sampling for View-Consistent Text-to-3D},
  author = {Qing Zhang and Jinguang Tong and Jie Hong and Jing Zhang and Xuesong Li},
  journal= {arXiv preprint arXiv:2508.16917},
  year   = {2025}
}
R2 v1 2026-07-01T05:02:41.504Z