Key to automatically generate natural scene images is to properly arrange among various spatial elements, especially in the depth direction. To this end, we introduce a novel depth structure preserving scene image generation network (DSP-GAN), which favors a hierarchical and heterogeneous architecture, for the purpose of depth structure preserving scene generation. The main trunk of the proposed infrastructure is built on a Hawkes point process that models the spatial dependency between different depth layers. Within each layer generative adversarial sub-networks are trained collaboratively to generate realistic scene components, conditioned on the layer information produced by the point process. We experiment our model on a sub-set of SUNdataset with annotated scene images and demonstrate that our models are capable of generating depth-realistic natural scene image.
@article{arxiv.1706.00212,
title = {Depth Structure Preserving Scene Image Generation},
author = {Wendong Zhang and Bingbing Ni and Yichao Yan and Jingwei Xu and Xiaokang Yang},
journal= {arXiv preprint arXiv:1706.00212},
year = {2017}
}
Comments
There is an error in the first paragraph in Section 4.4. Actually, we train and test another new CGAN model with the input in our model to evaluate the improvements. This error can lead readers misunderstand the improvements of our model and make the comparison unfair. Therefore, we request to withdraw the current submission and will submit a final version later