We introduce a simple and versatile framework for image-to-image translation. We unearth the importance of normalization layers, and provide a carefully designed two-stream generative model with newly proposed feature transformations in a coarse-to-fine fashion. This allows multi-scale semantic structure information and style representation to be effectively captured and fused by the network, permitting our method to scale to various tasks in both unsupervised and supervised settings. No additional constraints (e.g., cycle consistency) are needed, contributing to a very clean and simple method. Multi-modal image synthesis with arbitrary style control is made possible. A systematic study compares the proposed method with several state-of-the-art task-specific baselines, verifying its effectiveness in both perceptual quality and quantitative evaluations.
@article{arxiv.2007.12072,
title = {TSIT: A Simple and Versatile Framework for Image-to-Image Translation},
author = {Liming Jiang and Changxu Zhang and Mingyang Huang and Chunxiao Liu and Jianping Shi and Chen Change Loy},
journal= {arXiv preprint arXiv:2007.12072},
year = {2020}
}
Comments
ECCV 2020 (Spotlight). Table 2 is updated. GitHub: https://github.com/EndlessSora/TSIT