English

ReGO: Reference-Guided Outpainting for Scenery Image

Computer Vision and Pattern Recognition 2022-08-09 v4

Abstract

We aim to tackle the challenging yet practical scenery image outpainting task in this work. Recently, generative adversarial learning has significantly advanced the image outpainting by producing semantic consistent content for the given image. However, the existing methods always suffer from the blurry texture and the artifacts of the generative part, making the overall outpainting results lack authenticity. To overcome the weakness, this work investigates a principle way to synthesize texture-rich results by borrowing pixels from its neighbors (i.e., reference images), named \textbf{Re}ference-\textbf{G}uided \textbf{O}utpainting (ReGO). Particularly, the ReGO designs an Adaptive Content Selection (ACS) module to transfer the pixel of reference images for texture compensating of the target one. To prevent the style of the generated part from being affected by the reference images, a style ranking loss is further proposed to augment the ReGO to synthesize style-consistent results. Extensive experiments on two popular benchmarks, NS6K \cite{yangzx} and NS8K \cite{wang}, well demonstrate the effectiveness of our ReGO. Our code will be made public available.

Keywords

Cite

@article{arxiv.2106.10601,
  title  = {ReGO: Reference-Guided Outpainting for Scenery Image},
  author = {Yaxiong Wang and Yunchao Wei and Xueming Qian and Li Zhu and Yi Yang},
  journal= {arXiv preprint arXiv:2106.10601},
  year   = {2022}
}

Comments

Image outpainting, 12 pages, submitted to IEEE TIP

R2 v1 2026-06-24T03:23:38.315Z