English

COMPASS: Grounding Composition-Intent Guidance in Unified Multimodal Models

Artificial Intelligence 2026-06-27 v1

Abstract

Composition is a high-level visual intent that governs where subjects are placed and how a scene is organized, yet current unified multimodal models remain unreliable at fine-grained composition recognition and struggle to turn such intent into controllable generation. We present COMPASS, the first unified multimodal framework that grounds composition-intent control in a single system spanning both composition perception and composition-guided generation, with a shared expert token τc\tau_c as the central intent anchor. On the perception side, COMPASS injects composition expertise into an MoE backbone in a minimally invasive manner and distills the inferred intent into τc\tau_c. On the generation side, COMPASS reuses τc\tau_c as a global conditioning signal that steers the denoising trajectory, effectively converting passive composition analysis into explicit layout control. To support systematic instruction-following composition learning and evaluation at scale, we construct Comp-11, a large-scale dataset with an 11-class taxonomy and reasoning-augmented annotations. Extensive experiments show that COMPASS substantially improves category-level composition understanding and delivers more composition-consistent, prompt-faithful generation than strong baselines.

Cite

@article{arxiv.2606.28696,
  title  = {COMPASS: Grounding Composition-Intent Guidance in Unified Multimodal Models},
  author = {Ziqi Zhou and Weize Quan and Mining Tan and Zhihan Chen and Dandan Zheng and Jingdong Chen and Jun Zhou and Weiming Dong and Dong-Ming Yan},
  journal= {arXiv preprint arXiv:2606.28696},
  year   = {2026}
}