English

DEIG: Detail-Enhanced Instance Generation with Fine-Grained Semantic Control

Computer Vision and Pattern Recognition 2026-02-23 v1

Abstract

Multi-Instance Generation has advanced significantly in spatial placement and attribute binding. However, existing approaches still face challenges in fine-grained semantic understanding, particularly when dealing with complex textual descriptions. To overcome these limitations, we propose DEIG, a novel framework for fine-grained and controllable multi-instance generation. DEIG integrates an Instance Detail Extractor (IDE) that transforms text encoder embeddings into compact, instance-aware representations, and a Detail Fusion Module (DFM) that applies instance-based masked attention to prevent attribute leakage across instances. These components enable DEIG to generate visually coherent multi-instance scenes that precisely match rich, localized textual descriptions. To support fine-grained supervision, we construct a high-quality dataset with detailed, compositional instance captions generated by VLMs. We also introduce DEIG-Bench, a new benchmark with region-level annotations and multi-attribute prompts for both humans and objects. Experiments demonstrate that DEIG consistently outperforms existing approaches across multiple benchmarks in spatial consistency, semantic accuracy, and compositional generalization. Moreover, DEIG functions as a plug-and-play module, making it easily integrable into standard diffusion-based pipelines.

Keywords

Cite

@article{arxiv.2602.18282,
  title  = {DEIG: Detail-Enhanced Instance Generation with Fine-Grained Semantic Control},
  author = {Shiyan Du and Conghan Yue and Xinyu Cheng and Dongyu Zhang},
  journal= {arXiv preprint arXiv:2602.18282},
  year   = {2026}
}

Comments

Accepted by AAAI 2026

R2 v1 2026-07-01T10:44:17.852Z