English

WeditGAN: Few-Shot Image Generation via Latent Space Relocation

Computer Vision and Pattern Recognition 2024-01-17 v3

Abstract

In few-shot image generation, directly training GAN models on just a handful of images faces the risk of overfitting. A popular solution is to transfer the models pretrained on large source domains to small target ones. In this work, we introduce WeditGAN, which realizes model transfer by editing the intermediate latent codes ww in StyleGANs with learned constant offsets (Δw\Delta w), discovering and constructing target latent spaces via simply relocating the distribution of source latent spaces. The established one-to-one mapping between latent spaces can naturally prevents mode collapse and overfitting. Besides, we also propose variants of WeditGAN to further enhance the relocation process by regularizing the direction or finetuning the intensity of Δw\Delta w. Experiments on a collection of widely used source/target datasets manifest the capability of WeditGAN in generating realistic and diverse images, which is simple yet highly effective in the research area of few-shot image generation. Codes are available at https://github.com/Ldhlwh/WeditGAN.

Keywords

Cite

@article{arxiv.2305.06671,
  title  = {WeditGAN: Few-Shot Image Generation via Latent Space Relocation},
  author = {Yuxuan Duan and Li Niu and Yan Hong and Liqing Zhang},
  journal= {arXiv preprint arXiv:2305.06671},
  year   = {2024}
}

Comments

AAAI 2024, see Appendix for update notes of this version

R2 v1 2026-06-28T10:31:50.698Z