English
Related papers

Related papers: Online Multi-Granularity Distillation for GAN Comp…

200 papers

This paper proposes an effective probability density distillation (PDD) algorithm for WaveNet-based parallel waveform generation (PWG) systems. Recently proposed teacher-student frameworks in the PWG system have successfully achieved a…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-29 Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

Recently, significant progress has been made in learned image and video compression. In particular the usage of Generative Adversarial Networks has lead to impressive results in the low bit rate regime. However, the model size remains an…

Image and Video Processing · Electrical Eng. & Systems 2022-01-11 Leonhard Helminger , Roberto Azevedo , Abdelaziz Djelouah , Markus Gross , Christopher Schroers

Albeit with varying degrees of progress in the field of Semi-Supervised Semantic Segmentation, most of its recent successes are involved in unwieldy models and the lightweight solution is still not yet explored. We find that existing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Jie Qin , Jie Wu , Ming Li , Xuefeng Xiao , Min Zheng , Xingang Wang

In recent years, generative adversarial networks (GANs) have been an actively studied topic and shown to successfully produce high-quality realistic images in various domains. The controllable synthesis ability of GAN generators suggests…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Yu Yang , Xiaotian Cheng , Chang Liu , Hakan Bilen , Xiangyang Ji

Face image translation has made notable progress in recent years. However, when training on limited data, the performance of existing approaches significantly declines. Although some studies have attempted to tackle this problem, they…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Ruoyu Zhao , Mingrui Zhu , Xiaoyu Wang , Nannan Wang

One-class novelty detection is to identify anomalous instances that do not conform to the expected normal instances. In this paper, the Generative Adversarial Networks (GANs) based on encoder-decoder-encoder pipeline are used for detection…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Zhiwei Zhang , Shifeng Chen , Lei Sun

Generative Adversarial Networks have surprising ability for generating sharp and realistic images, though they are known to suffer from the so-called mode collapse problem. In this paper, we propose a new GAN variant called Mixture Density…

Machine Learning · Computer Science 2018-11-30 Hamid Eghbal-zadeh , Werner Zellinger , Gerhard Widmer

In this paper, we propose to use a Conditional Generative Adversarial Network (CGAN) for distilling (i.e. transferring) knowledge from sensor data and enhancing low-resolution target detection. In unconstrained surveillance settings, sensor…

Image and Video Processing · Electrical Eng. & Systems 2018-07-23 Siddharth Roheda , Benjamin S. Riggan , Hamid Krim , Liyi Dai

In this paper, we present a simple approach to train Generative Adversarial Networks (GANs) in order to avoid a \textit {mode collapse} issue. Implicit models such as GANs tend to generate better samples compared to explicit models that are…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Seyed Mehdi Iranmanesh , Nasser M. Nasrabadi

Generative adversarial networks (GANs), e.g., StyleGAN2, play a vital role in various image generation and synthesis tasks, yet their notoriously high computational cost hinders their efficient deployment on edge devices. Directly applying…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Yuchen Liu , Zhixin Shu , Yijun Li , Zhe Lin , Federico Perazzi , S. Y. Kung

Generative adversarial networks (GANs) have gained increasing popularity in various computer vision applications, and recently start to be deployed to resource-constrained mobile devices. Similar to other deep models, state-of-the-art GANs…

Machine Learning · Computer Science 2020-08-26 Haotao Wang , Shupeng Gui , Haichuan Yang , Ji Liu , Zhangyang Wang

Generative adversarial networks (GANs) have achieved remarkable progress in recent years, but the continuously growing scale of models makes them challenging to deploy widely in practical applications. In particular, for real-time…

Machine Learning · Computer Science 2021-03-19 Liang Hou , Zehuan Yuan , Lei Huang , Huawei Shen , Xueqi Cheng , Changhu Wang

One highly promising direction for enabling flexible real-time on-device image editing is utilizing data distillation by leveraging large-scale text-to-image diffusion models to generate paired datasets used for training generative…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yifan Gong , Zheng Zhan , Qing Jin , Yanyu Li , Yerlan Idelbayev , Xian Liu , Andrey Zharkov , Kfir Aberman , Sergey Tulyakov , Yanzhi Wang , Jian Ren

We propose MAD-GAN, an intuitive generalization to the Generative Adversarial Networks (GANs) and its conditional variants to address the well known problem of mode collapse. First, MAD-GAN is a multi-agent GAN architecture incorporating…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Arnab Ghosh , Viveka Kulharia , Vinay Namboodiri , Philip H. S. Torr , Puneet K. Dokania

Generative Adversarial Network (GAN) and its variants exhibit state-of-the-art performance in the class of generative models. To capture higher-dimensional distributions, the common learning procedure requires high computational complexity…

Machine Learning · Computer Science 2018-04-02 Xingwei Cao , Xuyang Zhao , Qibin Zhao

Generative adversarial networks (GANs) have an enormous potential impact on digital content creation, e.g., photo-realistic digital avatars, semantic content editing, and quality enhancement of speech and images. However, the performance of…

Artificial Intelligence · Computer Science 2021-09-01 Pavel Andreev , Alexander Fritzler , Dmitry Vetrov

In recent years, the use of Generative Adversarial Networks (GANs) has become very popular in generative image modeling. While style-based GAN architectures yield state-of-the-art results in high-fidelity image synthesis, computationally,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Sergei Belousov

One of the major breakthroughs in deep learning over the past five years has been the Generative Adversarial Network (GAN), a neural network-based generative model which aims to mimic some underlying distribution given a dataset of samples.…

Machine Learning · Computer Science 2020-06-23 Yeojoon Youn , Neil Thistlethwaite , Sang Keun Choe , Jacob Abernethy

Recently, generative adversarial networks (GANs) have shown promising performance in generating realistic images. However, they often struggle in learning complex underlying modalities in a given dataset, resulting in poor-quality generated…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 David Keetae Park , Seungjoo Yoo , Hyojin Bahng , Jaegul Choo , Noseong Park

Learning disentangled representation of data without supervision is an important step towards improving the interpretability of generative models. Despite recent advances in disentangled representation learning, existing approaches often…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Wonkwang Lee , Donggyun Kim , Seunghoon Hong , Honglak Lee