English

DEGAS: Differentiable Efficient Generator Search

Computer Vision and Pattern Recognition 2021-01-01 v3 Machine Learning

Abstract

Network architecture search (NAS) achieves state-of-the-art results in various tasks such as classification and semantic segmentation. Recently, a reinforcement learning-based approach has been proposed for Generative Adversarial Networks (GANs) search. In this work, we propose an alternative strategy for GAN search by using a method called DEGAS (Differentiable Efficient GenerAtor Search), which focuses on efficiently finding the generator in the GAN. Our search algorithm is inspired by the differential architecture search strategy and the Global Latent Optimization (GLO) procedure. This leads to both an efficient and stable GAN search. After the generator architecture is found, it can be plugged into any existing framework for GAN training. For CTGAN, which we use in this work, the new model outperforms the original inception score results by 0.25 for CIFAR-10 and 0.77 for STL. It also gets better results than the RL based GAN search methods in shorter search time.

Keywords

Cite

@article{arxiv.1912.00606,
  title  = {DEGAS: Differentiable Efficient Generator Search},
  author = {Sivan Doveh and Raja Giryes},
  journal= {arXiv preprint arXiv:1912.00606},
  year   = {2021}
}

Comments

appeared at NeurIPS 2019, Meta-Learning Workshop

R2 v1 2026-06-23T12:32:44.133Z