English

MANSION: Multi-floor lANguage-to-3D Scene generatIOn for loNg-horizon tasks

Computer Vision and Pattern Recognition 2026-03-13 v1 Artificial Intelligence Robotics

Abstract

Real-world robotic tasks are long-horizon and often span multiple floors, demanding rich spatial reasoning. However, existing embodied benchmarks are largely confined to single-floor in-house environments, failing to reflect the complexity of real-world tasks. We introduce MANSION, the first language-driven framework for generating building-scale, multi-floor 3D environments. Being aware of vertical structural constraints, MANSION generates realistic, navigable whole-building structures with diverse, human-friendly scenes, enabling the development and evaluation of cross-floor long-horizon tasks. Building on this framework, we release MansionWorld, a dataset of over 1,000 diverse buildings ranging from hospitals to offices, alongside a Task-Semantic Scene Editing Agent that customizes these environments using open-vocabulary commands to meet specific user needs. Benchmarking reveals that state-of-the-art agents degrade sharply in our settings, establishing MANSION as a critical testbed for the next generation of spatial reasoning and planning.

Keywords

Cite

@article{arxiv.2603.11554,
  title  = {MANSION: Multi-floor lANguage-to-3D Scene generatIOn for loNg-horizon tasks},
  author = {Lirong Che and Shuo Wen and Shan Huang and Chuang Wang and Yuzhe Yang and Gregory Dudek and Xueqian Wang and Jian Su},
  journal= {arXiv preprint arXiv:2603.11554},
  year   = {2026}
}