Conditional image synthesis from layout has recently attracted much interest. Previous approaches condition the generator on object locations as well as class labels but lack fine-grained control over the diverse appearance aspects of individual objects. Gaining control over the image generation process is fundamental to build practical applications with a user-friendly interface. In this paper, we propose a method for attribute controlled image synthesis from layout which allows to specify the appearance of individual objects without affecting the rest of the image. We extend a state-of-the-art approach for layout-to-image generation to additionally condition individual objects on attributes. We create and experiment on a synthetic, as well as the challenging Visual Genome dataset. Our qualitative and quantitative results show that our method can successfully control the fine-grained details of individual objects when modelling complex scenes with multiple objects. Source code, dataset and pre-trained models are publicly available (https://github.com/stanifrolov/AttrLostGAN).
@article{arxiv.2103.13722,
title = {AttrLostGAN: Attribute Controlled Image Synthesis from Reconfigurable Layout and Style},
author = {Stanislav Frolov and Avneesh Sharma and Jörn Hees and Tushar Karayil and Federico Raue and Andreas Dengel},
journal= {arXiv preprint arXiv:2103.13722},
year = {2021}
}
Comments
Accepted to GCPR 2021. Link to code: https://github.com/stanifrolov/AttrLostGAN