English
Related papers

Related papers: Evaluating Post-Training Compression in GANs using…

200 papers

We propose a unified signal compression framework that uses a generative adversarial network (GAN) to compress heterogeneous signals. The compressed signal is represented as a latent vector and fed into a generator network that is trained…

Signal Processing · Electrical Eng. & Systems 2021-09-24 Bowen Liu , Changwoo Lee , Ang Cao , Hun-Seok Kim

Generative adversarial networks (GANs) are highly effective unsupervised learning frameworks that can generate very sharp data, even for data such as images with complex, highly multimodal distributions. However GANs are known to be very…

Machine Learning · Statistics 2017-12-05 Sitao Xiang , Hao Li

We propose a unified compression framework that uses generative adversarial networks (GAN) to compress image and speech signals. The compressed signal is represented by a latent vector fed into a generator network which is trained to…

Signal Processing · Electrical Eng. & Systems 2019-12-10 Bowen Liu , Ang Cao , Hun-seok Kim

In this paper, we present a simple approach to train Generative Adversarial Networks (GANs) in order to avoid a \textit {mode collapse} issue. Implicit models such as GANs tend to generate better samples compared to explicit models that are…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Seyed Mehdi Iranmanesh , Nasser M. Nasrabadi

Locality-sensitive hashing (LSH) is an effective randomized technique widely used in many machine learning tasks. The cost of hashing is proportional to data dimensions, and thus often the performance bottleneck when dimensionality is high…

Machine Learning · Computer Science 2023-09-28 Zongyuan Tan , Hongya Wang , Bo Xu , Minjie Luo , Ming Du

Unsupervised learning of generative models has seen tremendous progress over recent years, in particular due to generative adversarial networks (GANs), variational autoencoders, and flow-based models. GANs have dramatically improved sample…

Computer Vision and Pattern Recognition · Computer Science 2020-01-06 Thomas Lucas , Konstantin Shmelkov , Karteek Alahari , Cordelia Schmid , Jakob Verbeek

Generative adversarial networks (GANs) have shown remarkable success in generating realistic data from some predefined prior distribution (e.g., Gaussian noises). However, such prior distribution is often independent of real data and thus…

Machine Learning · Computer Science 2020-08-04 Jiezhang Cao , Yong Guo , Qingyao Wu , Chunhua Shen , Junzhou Huang , Mingkui Tan

Training generative adversarial networks (GANs) with limited real image data generally results in deteriorated performance and collapsed models. To conquer this challenge, we are inspired by the latest observation, that one can discover…

Machine Learning · Computer Science 2021-10-26 Tianlong Chen , Yu Cheng , Zhe Gan , Jingjing Liu , Zhangyang Wang

Generative adversarial networks (GANs) are a powerful approach to unsupervised learning. They have achieved state-of-the-art performance in the image domain. However, GANs are limited in two ways. They often learn distributions with low…

Machine Learning · Statistics 2019-10-11 Adji B. Dieng , Francisco J. R. Ruiz , David M. Blei , Michalis K. Titsias

Conditional Generative Adversarial Networks (cGANs) have enabled controllable image synthesis for many vision and graphics applications. However, recent cGANs are 1-2 orders of magnitude more compute-intensive than modern recognition CNNs.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Muyang Li , Ji Lin , Yaoyao Ding , Zhijian Liu , Jun-Yan Zhu , Song Han

Generative Adversarial Networks (GAN) training process, in most cases, apply Uniform or Gaussian sampling methods in the latent space, which probably spends most of the computation on examples that can be properly handled and easy to…

Machine Learning · Computer Science 2022-12-19 Shiyu Yi , Donglin Zhan , Wenqing Zhang , Denglin Jiang , Kang An , Hao Wang

Generative adversarial networks (GANs) have been successfully used for considerable computer vision tasks, especially the image-to-image translation. However, generators in these networks are of complicated architectures with large number…

Computer Vision and Pattern Recognition · Computer Science 2019-07-26 Han Shu , Yunhe Wang , Xu Jia , Kai Han , Hanting Chen , Chunjing Xu , Qi Tian , Chang Xu

Generative Adversarial Networks (GANs) have achieved huge success in generating high-fidelity images, however, they suffer from low efficiency due to tremendous computational cost and bulky memory usage. Recent efforts on compression GANs…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Qing Jin , Jian Ren , Oliver J. Woodford , Jiazhuo Wang , Geng Yuan , Yanzhi Wang , Sergey Tulyakov

Generative Adversarial Networks (GANs) are powerful models able to synthesize data samples closely resembling the distribution of real data, yet the diversity of those generated samples is limited due to the so-called mode collapse…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Jan Dubiński , Kamil Deja , Sandro Wenzel , Przemysław Rokita , Tomasz Trzciński

Significant advances in deep learning have led to more widely used and precise neural network-based generative models such as Generative Adversarial Networks (GANs). We introduce a post-hoc correction to deep generative models to further…

High Energy Physics - Phenomenology · Physics 2020-12-30 Sascha Diefenbacher , Engin Eren , Gregor Kasieczka , Anatolii Korol , Benjamin Nachman , David Shih

We introduce Kernel Density Discrimination GAN (KDD GAN), a novel method for generative adversarial learning. KDD GAN formulates the training as a likelihood ratio optimization problem where the data distributions are written explicitly via…

Machine Learning · Computer Science 2021-07-14 Abdelhak Lemkhenter , Adam Bielski , Alp Eren Sari , Paolo Favaro

Generative adversarial networks (GANs) have been extremely effective in approximating complex distributions of high-dimensional, input data samples, and substantial progress has been made in understanding and improving GAN performance in…

Machine Learning · Computer Science 2018-05-01 Daniel Jiwoong Im , He Ma , Graham Taylor , Kristin Branson

We extensively study how to combine Generative Adversarial Networks and learned compression to obtain a state-of-the-art generative lossy compression system. In particular, we investigate normalization layers, generator and discriminator…

Image and Video Processing · Electrical Eng. & Systems 2020-10-26 Fabian Mentzer , George Toderici , Michael Tschannen , Eirikur Agustsson

The efficient implementation of large language models (LLMs) is crucial for deployment on resource-constrained devices. Low-rank tensor compression techniques, such as tensor-train (TT) networks, have been widely studied for…

Computation and Language · Computer Science 2025-10-14 Ryan Solgi , Kai Zhen , Rupak Vignesh Swaminathan , Nathan Susanj , Athanasios Mouchtaris , Siegfried Kunzmann , Zheng Zhang

Generative Adversarial Networks (GANs) have achieved remarkable results in the task of generating realistic natural images. In most successful applications, GAN models share two common aspects: solving a challenging saddle point…

Machine Learning · Statistics 2019-05-21 Piotr Bojanowski , Armand Joulin , David Lopez-Paz , Arthur Szlam