English

Text-Driven 3D Indoor Scene Synthesis in Non-Manhattan Environments

Artificial Intelligence 2026-07-02 v1 Computer Vision and Pattern Recognition

Abstract

Large Language Models (LLMs) have demonstrated remarkable capabilities in 3D indoor synthesis for Manhattan environments. However, existing methods often fail to capture plausible object layout patterns in non-Manhattan settings, primarily because they struggle to model non-orthogonal spatial relationships, leading to high geometric violations and low physical fidelity. To address this challenge, we propose SPG-Layout, a novel text-driven framework designed to generate physically plausible indoor scenes within complex non-Manhattan environments. Specifically, we first utilize statistical priors of object distributions to guide the training process, enhancing environmental understanding and fidelity. Furthermore, mirroring human design workflows, we adopt a hierarchical layout strategy that prioritizes the placement of large objects, thereby substantially minimizing layout violations. By synergizing these components, SPG-Layout achieves a balanced optimization of semantic realism and physical plausibility. To evaluate performance in these complex settings, we constructed a new benchmark comprising 500 diverse non-Manhattan environments. Extensive experiments demonstrate that SPG-Layout consistently and significantly outperforms existing methods across both Manhattan and non-Manhattan environments. The code will be publicly released.

Cite

@article{arxiv.2607.02407,
  title  = {Text-Driven 3D Indoor Scene Synthesis in Non-Manhattan Environments},
  author = {Xianhui Meng and Zirui Song and Yuchen Zhang and Li Zhang and Yongxuan Lv and Xiuying Chen and Kun Wang and Yan Luo and Kai Chen and Hangjun Ye and Long Chen and Jun Liu and Xiaoshuai Hao},
  journal= {arXiv preprint arXiv:2607.02407},
  year   = {2026}
}