English
Related papers

Related papers: GANs Can Play Lottery Tickets Too

200 papers

Transfer learning leverages feature representations of deep neural networks (DNNs) pretrained on source tasks with rich data to empower effective finetuning on downstream tasks. However, the pretrained models are often prohibitively large…

Machine Learning · Computer Science 2025-01-07 Yonggan Fu , Ye Yuan , Shang Wu , Jiayi Yuan , Yingyan Celine Lin

Generative Adversarial Networks (GANs) are a powerful framework for deep generative modeling. Posed as a two-player minimax problem, GANs are typically trained end-to-end on real-valued data and can be used to train a generator of…

Machine Learning · Statistics 2017-11-15 Anirudh Goyal , Nan Rosemary Ke , Alex Lamb , R Devon Hjelm , Chris Pal , Joelle Pineau , Yoshua Bengio

We introduce the Probabilistic Generative Adversarial Network (PGAN), a new GAN variant based on a new kind of objective function. The central idea is to integrate a probabilistic model (a Gaussian Mixture Model, in our case) into the GAN…

Machine Learning · Computer Science 2017-08-08 Hamid Eghbal-zadeh , Gerhard Widmer

I present IGAN (Inferent Generative Adversarial Networks), a neural architecture that learns both a generative and an inference model on a complex high dimensional data distribution, i.e. a bidirectional mapping between data samples and a…

Machine Learning · Computer Science 2024-09-04 Luc Vignaud

Generative adversarial networks (GANs) have given us a great tool to fit implicit generative models to data. Implicit distributions are ones we can sample from easily, and take derivatives of samples with respect to model parameters. These…

Machine Learning · Statistics 2017-02-28 Ferenc Huszár

We investigate how generative adversarial nets (GANs) can help semi-supervised learning on graphs. We first provide insights on working principles of adversarial learning over graphs and then present GraphSGAN, a novel approach to…

Social and Information Networks · Computer Science 2018-09-05 Ming Ding , Jie Tang , Jie Zhang

Auto-encoding generative adversarial networks (GANs) combine the standard GAN algorithm, which discriminates between real and model-generated data, with a reconstruction loss given by an auto-encoder. Such models aim to prevent mode…

Machine Learning · Statistics 2017-10-24 Mihaela Rosca , Balaji Lakshminarayanan , David Warde-Farley , Shakir Mohamed

Generative Adversarial Networks (GANs) have made significant progress in enhancing the quality of image synthesis. Recent methods frequently leverage pretrained networks to calculate perceptual losses or utilize pretrained feature spaces.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Geonhui Son , Jeong Ryong Lee , Dosik Hwang

In this paper, we present a simple approach to train Generative Adversarial Networks (GANs) in order to avoid a \textit {mode collapse} issue. Implicit models such as GANs tend to generate better samples compared to explicit models that are…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Seyed Mehdi Iranmanesh , Nasser M. Nasrabadi

Discovering a high-performing sparse network within a massive neural network is advantageous for deploying them on devices with limited storage, such as mobile phones. Additionally, model explainability is essential to fostering trust in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Shantanu Ghosh , Kayhan Batmanghelich

Generative adversarial networks (GANs) while being very versatile in realistic image synthesis, still are sensitive to the input distribution. Given a set of data that has an imbalance in the distribution, the networks are susceptible to…

Computer Vision and Pattern Recognition · Computer Science 2018-02-05 Shashank Sharma , Vinay P. Namboodiri

Generative adversarial networks (GANs) can synthesize high-quality (HQ) images, and GAN inversion is a technique that discovers how to invert given images back to latent space. While existing methods perform on StyleGAN inversion, they have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Cheng Yu , Wenmin Wang , Roberto Bugiolacchi

As a revolutionary generative paradigm of deep learning, generative adversarial networks (GANs) have been widely applied in various fields to synthesize realistic data. However, it is challenging for conventional GANs to synthesize raw…

Signal Processing · Electrical Eng. & Systems 2023-06-27 Weidong Wang , Jiancheng An , Hongshu Liao , Lu Gan , Chau Yuen

Though recent research has achieved remarkable progress in generating realistic images with generative adversarial networks (GANs), the lack of training stability is still a lingering concern of most GANs, especially on high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Runmin Wu , Kunyao Zhang , Lijun Wang , Yue Wang , Pingping Zhang , Huchuan Lu , Yizhou Yu

Generative Adversarial Networks have surprising ability for generating sharp and realistic images, though they are known to suffer from the so-called mode collapse problem. In this paper, we propose a new GAN variant called Mixture Density…

Machine Learning · Computer Science 2018-11-30 Hamid Eghbal-zadeh , Werner Zellinger , Gerhard Widmer

Generative adversarial networks (GANs) are neural networks that learn data distributions through adversarial training. In intensive studies, recent GANs have shown promising results for reproducing training images. However, in spite of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Takuhiro Kaneko , Tatsuya Harada

Generative adversarial networks (GANs) are often billed as "universal distribution learners", but precisely what distributions they can represent and learn is still an open question. Heavy-tailed distributions are prevalent in many…

Machine Learning · Computer Science 2021-01-25 Todd Huster , Jeremy E. J. Cohen , Zinan Lin , Kevin Chan , Charles Kamhoua , Nandi Leslie , Cho-Yu Jason Chiang , Vyas Sekar

Reliable training of generative adversarial networks (GANs) typically require massive datasets in order to model complicated distributions. However, in several applications, training samples obey invariances that are \textit{a priori}…

The lottery ticket hypothesis (LTH) has attracted attention because it can explain why over-parameterized models often show high generalization ability. It is known that when we use iterative magnitude pruning (IMP), which is an algorithm…

Machine Learning · Computer Science 2022-09-29 Keitaro Sakamoto , Issei Sato

In recent years, deep neural networks have been utilized in a wide variety of applications including image generation. In particular, generative adversarial networks (GANs) are able to produce highly realistic pictures as part of tasks such…

Image and Video Processing · Electrical Eng. & Systems 2020-04-20 Hyunsuk Ko , Dae Yeol Lee , Seunghyun Cho , Alan C. Bovik