English

Ar2Can: An Architect and an Artist Leveraging a Canvas for Multi-Human Generation

Computer Vision and Pattern Recognition 2026-04-02 v3

Abstract

Despite recent advances in personalized image generation, existing models consistently fail to produce reliable multi-human scenes, often merging or losing facial identity. We present Ar2Can, a novel two-stage framework that disentangles spatial planning from identity rendering for multi-human generation. The Architect predicts structured layouts, specifying where each person should appear. The Artist then synthesizes photorealistic images, guided by a spatially-grounded face matching reward that combines Hungarian spatial alignment with identity similarity. This approach ensures faces are rendered at correct locations and faithfully preserve reference identities. We develop two Architect variants, seamlessly integrated with our diffusion-based Artist model. This is optimized via Group Relative Policy Optimization (GRPO) using compositional rewards for count accuracy, image quality, and identity matching. Evaluated on the MultiHuman-Testbench, Ar2Can achieves substantial improvements in both count accuracy and identity preservation, while maintaining high perceptual quality. Notably, our method achieves these results using primarily synthetic data, without requiring real multi-human images. Project page: https://qualcomm-ai-research.github.io/ar2can/.

Keywords

Cite

@article{arxiv.2511.22690,
  title  = {Ar2Can: An Architect and an Artist Leveraging a Canvas for Multi-Human Generation},
  author = {Shubhankar Borse and Phuc Pham and Farzad Farhadzadeh and Seokeon Choi and Phong Ha Nguyen and Anh Tuan Tran and Sungrack Yun and Munawar Hayat and Fatih Porikli},
  journal= {arXiv preprint arXiv:2511.22690},
  year   = {2026}
}

Comments

Accepted to CVPR 2026