English

Unpaired Image-to-Image Translation via Neural Schr\"odinger Bridge

Computer Vision and Pattern Recognition 2024-03-05 v3 Artificial Intelligence Machine Learning Machine Learning

Abstract

Diffusion models are a powerful class of generative models which simulate stochastic differential equations (SDEs) to generate data from noise. While diffusion models have achieved remarkable progress, they have limitations in unpaired image-to-image (I2I) translation tasks due to the Gaussian prior assumption. Schr\"{o}dinger Bridge (SB), which learns an SDE to translate between two arbitrary distributions, have risen as an attractive solution to this problem. Yet, to our best knowledge, none of SB models so far have been successful at unpaired translation between high-resolution images. In this work, we propose Unpaired Neural Schr\"{o}dinger Bridge (UNSB), which expresses the SB problem as a sequence of adversarial learning problems. This allows us to incorporate advanced discriminators and regularization to learn a SB between unpaired data. We show that UNSB is scalable and successfully solves various unpaired I2I translation tasks. Code: \url{https://github.com/cyclomon/UNSB}

Keywords

Cite

@article{arxiv.2305.15086,
  title  = {Unpaired Image-to-Image Translation via Neural Schr\"odinger Bridge},
  author = {Beomsu Kim and Gihyun Kwon and Kwanyoung Kim and Jong Chul Ye},
  journal= {arXiv preprint arXiv:2305.15086},
  year   = {2024}
}

Comments

ICLR 2024