English
Related papers

Related papers: TextKD-GAN: Text Generation using KnowledgeDistill…

200 papers

Knowledge distillation has been widely used to produce portable and efficient neural networks which can be well applied on edge devices for computer vision tasks. However, almost all top-performing knowledge distillation methods need to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Haoran Zhao , Xin Sun , Junyu Dong , Hui Yu , Huiyu Zhou

Generative Adversarial Networks (GANs) have achieved huge success in generating high-fidelity images, however, they suffer from low efficiency due to tremendous computational cost and bulky memory usage. Recent efforts on compression GANs…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Qing Jin , Jian Ren , Oliver J. Woodford , Jiazhuo Wang , Geng Yuan , Yanzhi Wang , Sergey Tulyakov

The recent success of Generative Adversarial Networks (GAN) is a result of their ability to generate high quality images from a latent vector space. An important application is the generation of images from a text description, where the…

Machine Learning · Computer Science 2019-05-17 Hamid Eghbal-zadeh , Lukas Fischer , Thomas Hoch

Generative adversarial networks have seen rapid development in recent years and have led to remarkable improvements in generative modelling of images. However, their application in the audio domain has received limited attention, and…

This paper describes a method for using Generative Adversarial Networks to learn distributed representations of natural language documents. We propose a model that is based on the recently proposed Energy-Based GAN, but instead uses a…

Machine Learning · Computer Science 2016-12-30 John Glover

In this paper, we introduce Logic Tensor Network-Enhanced Generative Adversarial Network (LTN-GAN), a novel framework that enhances Generative Adversarial Networks (GANs) by incorporating Logic Tensor Networks (LTNs) to enforce…

Machine Learning · Computer Science 2026-01-08 Nijesh Upreti , Vaishak Belle

Generative Adversarial Networks have been crucial in the developments made in unsupervised learning in recent times. Exemplars of image synthesis from text or other images, these networks have shown remarkable improvements over conventional…

Machine Learning · Computer Science 2019-09-02 Rohan Akut , Sumukh Marathe , Rucha Apte , Ishan Joshi , Siddhivinayak Kulkarni

This paper proposes a content relationship distillation (CRD) to tackle the over-parameterized generative adversarial networks (GANs) for the serviceability in cutting-edge devices. In contrast to traditional instance-level distillation, we…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Lizhou You , Mingbao Lin , Tie Hu , Fei Chao , Rongrong Ji

In the years since Goodfellow et al. introduced Generative Adversarial Networks (GANs), there has been an explosion in the breadth and quality of generative model applications. Despite this work, GANs still have a long way to go before they…

Machine Learning · Computer Science 2020-04-14 Conor Lazarou

StyleGAN family is one of the most popular Generative Adversarial Networks (GANs) for unconditional generation. Despite its impressive performance, its high demand on storage and computation impedes their deployment on resource-constrained…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Guodong Xu , Yuenan Hou , Ziwei Liu , Chen Change Loy

Generative adversarial networks (GANs) have been shown to produce realistic samples from high-dimensional distributions, but training them is considered hard. A possible explanation for training instabilities is the inherent imbalance…

Machine Learning · Statistics 2018-07-12 Mehdi S. M. Sajjadi , Giambattista Parascandolo , Arash Mehrjou , Bernhard Schölkopf

In this paper, we propose a generative model which learns the relationship between language and human action in order to generate a human action sequence given a sentence describing human behavior. The proposed generative model is a…

Machine Learning · Computer Science 2017-10-25 Hyemin Ahn , Timothy Ha , Yunho Choi , Hwiyeon Yoo , Songhwai Oh

Generative adversarial networks (GANs) are pairs of artificial neural networks that are trained one against each other. The outputs from a generator are mixed with the real-world inputs to the discriminator and both networks are trained…

Neural and Evolutionary Computing · Computer Science 2020-06-11 Andrei Kucharavy , El Mahdi El Mhamdi , Rachid Guerraoui

Generative adversarial networks (GANs) learn to synthesise new samples from a high-dimensional distribution by passing samples drawn from a latent space through a generative network. When the high-dimensional distribution describes images…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Antonia Creswell , Anil Anthony Bharath

A generative adversarial network (GAN) has been a representative backbone model in generative artificial intelligence (AI) because of its powerful performance in capturing intricate data-generating processes. However, the GAN training is…

Machine Learning · Statistics 2025-08-21 Jinwon Sohn , Qifan Song

Generative adversarial networks (GANs) are a recent approach to train generative models of data, which have been shown to work particularly well on image data. In the current paper we introduce a new model for texture synthesis based on GAN…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Nikolay Jetchev , Urs Bergmann , Roland Vollgraf

Generative adversarial networks (GANs) implicitly learn the probability distribution of a dataset and can draw samples from the distribution. This paper presents, Tabular GAN (TGAN), a generative adversarial network which can generate…

Machine Learning · Computer Science 2018-11-29 Lei Xu , Kalyan Veeramachaneni

The generative adversarial network (GAN) framework has emerged as a powerful tool for various image and video synthesis tasks, allowing the synthesis of visual content in an unconditional or input-conditional manner. It has enabled the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Ming-Yu Liu , Xun Huang , Jiahui Yu , Ting-Chun Wang , Arun Mallya

Training regimes based on Maximum Likelihood Estimation (MLE) suffer from known limitations, often leading to poorly generated text sequences. At the root of these limitations is the mismatch between training and inference, i.e. the…

Computation and Language · Computer Science 2020-06-09 Thomas Scialom , Paul-Alexis Dray , Sylvain Lamprier , Benjamin Piwowarski , Jacopo Staiano

Deep learning methods have recently achieved great empirical success on machine translation, dialogue response generation, summarization, and other text generation tasks. At a high level, the technique has been to train end-to-end neural…

Computation and Language · Computer Science 2017-11-28 Ziang Xie