English
Related papers

Related papers: New Perspective on Progressive GANs Distillation f…

200 papers

Generative Adversarial Networks (GANs) are powerful generative models that achieved strong results, mainly in the image domain. However, the training of GANs is not trivial, presenting some challenges tackled by different strategies.…

Neural and Evolutionary Computing · Computer Science 2021-02-26 Victor Costa , Nuno Lourenço , João Correia , Penousal Machado

This paper proposes an effective probability density distillation (PDD) algorithm for WaveNet-based parallel waveform generation (PWG) systems. Recently proposed teacher-student frameworks in the PWG system have successfully achieved a…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-29 Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

Generative Adversarial Networks (GANs) are powerful models able to synthesize data samples closely resembling the distribution of real data, yet the diversity of those generated samples is limited due to the so-called mode collapse…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Jan Dubiński , Kamil Deja , Sandro Wenzel , Przemysław Rokita , Tomasz Trzciński

We develop a novel method for training of GANs for unsupervised and class conditional generation of images, called Linear Discriminant GAN (LD-GAN). The discriminator of an LD-GAN is trained to maximize the linear separability between…

Machine Learning · Statistics 2017-07-26 Zhun Sun , Mete Ozay , Takayuki Okatani

Generative Adversarial Networks (GANs), as a framework for estimating generative models via an adversarial process, have attracted huge attention and have proven to be powerful in a variety of tasks. However, training GANs is well known for…

Machine Learning · Computer Science 2017-11-09 Zi-Yi Dou

Generative Adversarial Networks (GANs) have been shown to produce realistically looking synthetic images with remarkable success, yet their performance seems less impressive when the training set is highly diverse. In order to provide a…

Machine Learning · Computer Science 2018-08-31 Matan Ben-Yosef , Daphna Weinshall

In this paper, we propose to use a Conditional Generative Adversarial Network (CGAN) for distilling (i.e. transferring) knowledge from sensor data and enhancing low-resolution target detection. In unconstrained surveillance settings, sensor…

Image and Video Processing · Electrical Eng. & Systems 2018-07-23 Siddharth Roheda , Benjamin S. Riggan , Hamid Krim , Liyi Dai

Anomaly detection is a classical problem where the aim is to detect anomalous data that do not belong to the normal data distribution. Current state-of-the-art methods for anomaly detection on complex high-dimensional data are based on the…

Machine Learning · Computer Science 2019-04-03 Cuong Phuc Ngo , Amadeus Aristo Winarto , Connie Kou Khor Li , Sojeong Park , Farhan Akram , Hwee Kuan Lee

Diffusion distillation is a widely used technique to reduce the sampling cost of diffusion models, yet it often requires extensive training, and the student performance tends to be degraded. Recent studies show that incorporating a GAN…

Machine Learning · Computer Science 2025-06-12 Bowen Zheng , Tianming Yang

The compression of Generative Adversarial Networks (GANs) has lately drawn attention, due to the increasing demand for deploying GANs into mobile devices for numerous applications such as image translation, enhancement and editing. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yonggan Fu , Wuyang Chen , Haotao Wang , Haoran Li , Yingyan Celine Lin , Zhangyang Wang

StyleGAN family is one of the most popular Generative Adversarial Networks (GANs) for unconditional generation. Despite its impressive performance, its high demand on storage and computation impedes their deployment on resource-constrained…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Guodong Xu , Yuenan Hou , Ziwei Liu , Chen Change Loy

When formulated as an unsupervised learning problem, anomaly detection often requires a model to learn the distribution of normal data. Previous works apply Generative Adversarial Networks (GANs) to anomaly detection tasks and show good…

Machine Learning · Computer Science 2021-06-15 Xu Han , Xiaohui Chen , Li-Ping Liu

In this paper, we address the challenge of compressing generative adversarial networks (GANs) for deployment in resource-constrained environments by proposing two novel methodologies: Distribution Matching for Efficient compression (DiME)…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Sangyeop Yeo , Yoojin Jang , Jaejun Yoo

Identifying anomalies refers to detecting samples that do not resemble the training data distribution. Many generative models have been used to find anomalies, and among them, generative adversarial network (GAN)-based approaches are…

Machine Learning · Computer Science 2022-01-03 Laya Rafiee Sevyeri , Thomas Fevens

Bayesian neural networks (BNNs) allow us to reason about uncertainty in a principled way. Stochastic Gradient Langevin Dynamics (SGLD) enables efficient BNN learning by drawing samples from the BNN posterior using mini-batches. However,…

Machine Learning · Computer Science 2018-06-28 Kuan-Chieh Wang , Paul Vicol , James Lucas , Li Gu , Roger Grosse , Richard Zemel

A Generative Adversarial Network (GAN) with generator $G$ trained to model the prior of images has been shown to perform better than sparsity-based regularizers in ill-posed inverse problems. Here, we propose a new method of deploying a…

Machine Learning · Computer Science 2019-10-25 Ankit Raj , Yuqi Li , Yoram Bresler

Since its invention, Generative adversarial networks (GANs) have shown outstanding results in many applications. Generative Adversarial Networks are powerful yet, resource-hungry deep-learning models. Their main difference from ordinary…

Machine Learning · Computer Science 2021-08-17 Dina Tantawy , Mohamed Zahran , Amr Wassal

Generative adversarial networks (GANs) have shown promise for various problems including anomaly detection. When anomaly detection is performed using GAN models that learn only the features of normal data samples, data that are not similar…

Machine Learning · Computer Science 2020-12-23 Teguh Budianto , Tomohiro Nakai , Kazunori Imoto , Takahiro Takimoto , Kosuke Haruki

Engineering design tasks often require synthesizing new designs that meet desired performance requirements. The conventional design process, which requires iterative optimization and performance evaluation, is slow and dependent on initial…

Machine Learning · Computer Science 2021-06-08 Amin Heyrani Nobari , Wei Chen , Faez Ahmed

Auto-encoding generative adversarial networks (GANs) combine the standard GAN algorithm, which discriminates between real and model-generated data, with a reconstruction loss given by an auto-encoder. Such models aim to prevent mode…

Machine Learning · Statistics 2017-10-24 Mihaela Rosca , Balaji Lakshminarayanan , David Warde-Farley , Shakir Mohamed