English

Tokenization Allows Multimodal Large Language Models to Understand, Generate and Edit Architectural Floor Plans

Computer Vision and Pattern Recognition 2026-03-13 v1 Artificial Intelligence

Abstract

Architectural floor plan design demands joint reasoning over geometry, semantics, and spatial hierarchy, which remains a major challenge for current AI systems. Although recent diffusion and language models improve visual fidelity, they still struggle with coherent spatial reasoning and controllable generation. We present HouseMind, a multimodal large language model that unifies floor plan understanding, generation, and editing in one framework. We introduce discrete room-instance tokens to construct a unified vocabulary that bridges layouts and symbolic reasoning. With multimodal alignment and instruction tuning, the model synthesizes coherent, controllable layouts from text instructions. Experiments show how the framework achieves superior geometric validity and controllability while remaining efficient and locally deployable.

Keywords

Cite

@article{arxiv.2603.11640,
  title  = {Tokenization Allows Multimodal Large Language Models to Understand, Generate and Edit Architectural Floor Plans},
  author = {Sizhong Qin and Ramon Elias Weber and Xinzheng Lu},
  journal= {arXiv preprint arXiv:2603.11640},
  year   = {2026}
}

Comments

20 pages, 9 figures. Accepted to CVPR 2026

R2 v1 2026-07-01T11:16:08.090Z