English
Related papers

Related papers: TextKD-GAN: Text Generation using KnowledgeDistill…

200 papers

Graph neural networks (GNNs) have been widely used in modeling graph structured data, owing to its impressive performance in a wide range of practical applications. Recently, knowledge distillation (KD) for GNNs has enabled remarkable…

Machine Learning · Computer Science 2022-06-17 Yuanxin Zhuang , Lingjuan Lyu , Chuan Shi , Carl Yang , Lichao Sun

Generative Adversarial Networks (GANs) achieve excellent performance in generative tasks, such as image super-resolution, but their computational requirements make difficult their deployment on resource-constrained devices. While knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Nikolaos Kaparinos , Vasileios Mezaris

GANs have been shown to perform exceedingly well on tasks pertaining to image generation and style transfer. In the field of language modelling, word embeddings such as GLoVe and word2vec are state-of-the-art methods for applying neural…

Computation and Language · Computer Science 2020-05-19 Afroz Ahamad

One-class novelty detection is to identify anomalous instances that do not conform to the expected normal instances. In this paper, the Generative Adversarial Networks (GANs) based on encoder-decoder-encoder pipeline are used for detection…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Zhiwei Zhang , Shifeng Chen , Lei Sun

One of the most significant challenges in statistical signal processing and machine learning is how to obtain a generative model that can produce samples of large-scale data distribution, such as images and speeches. Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Pegah Salehi , Abdolah Chalechale , Maryam Taghizadeh

The author-specific word usage is a vital feature to let readers perceive the writing style of the author. In this work, a personalized sentence generation method based on generative adversarial networks (GANs) is proposed to cope with this…

Computation and Language · Computer Science 2019-04-23 Chenhan Yuan , Yi-Chin Huang

Deep learning models for speech rely on large datasets, presenting computational challenges. Yet, performance hinges on training data size. Dataset Distillation (DD) aims to learn a smaller dataset without much performance degradation when…

Generative adversarial nets (GAN) has been successfully introduced for generating text to alleviate the exposure bias. However, discriminators in these models only evaluate the entire sequence, which causes feedback sparsity and mode…

Machine Learning · Computer Science 2019-05-31 Xingyuan Chen , Yanzhe Li , Peng Jin , Jiuhua Zhang , Xinyu Dai , Jiajun Chen , Gang Song

Generative Adversarial Networks (GANs) have gathered a lot of attention from the computer vision community, yielding impressive results for image generation. Advances in the adversarial generation of natural language from noise however are…

Computation and Language · Computer Science 2017-06-01 Sai Rajeswar , Sandeep Subramanian , Francis Dutil , Christopher Pal , Aaron Courville

Bayesian neural networks (BNNs) allow us to reason about uncertainty in a principled way. Stochastic Gradient Langevin Dynamics (SGLD) enables efficient BNN learning by drawing samples from the BNN posterior using mini-batches. However,…

Machine Learning · Computer Science 2018-06-28 Kuan-Chieh Wang , Paul Vicol , James Lucas , Li Gu , Roger Grosse , Richard Zemel

Pre-trained models have achieved remarkable success in natural language processing (NLP). However, existing pre-training methods underutilize the benefits of language understanding for generation. Inspired by the idea of Generative…

Computation and Language · Computer Science 2023-05-10 Jian Yang , Shuming Ma , Li Dong , Shaohan Huang , Haoyang Huang , Yuwei Yin , Dongdong Zhang , Liqun Yang , Furu Wei , Zhoujun Li

Conventional Generative Adversarial Networks (GANs) for text generation tend to have issues of reward sparsity and mode collapse that affect the quality and diversity of generated samples. To address the issues, we propose a novel…

Computation and Language · Computer Science 2020-02-13 Wangchunshu Zhou , Tao Ge , Ke Xu , Furu Wei , Ming Zhou

Converting text descriptions into images using Generative Adversarial Networks has become a popular research area. Visually appealing images have been generated successfully in recent years. Inspired by these studies, we investigated the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Azmi Can Özgen , Hazım Kemal Ekenel

This paper presents a new Text-to-Image generation model, named Distribution Regularization Generative Adversarial Network (DR-GAN), to generate images from text descriptions from improved distribution learning. In DR-GAN, we introduce two…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Hongchen Tan , Xiuping Liu , Baocai Yin , Xin Li

Generative adversarial nets (GANs) have been successfully applied to the artificial generation of image data. In terms of text data, much has been done on the artificial generation of natural language from a single corpus. We consider…

Computation and Language · Computer Science 2017-12-27 Baiyang Wang , Diego Klabjan

Generative Adversarial Networks (GANs) have gained a lot of attention from machine learning community due to their ability to learn and mimic an input data distribution. GANs consist of a discriminator and a generator working in tandem…

Computation and Language · Computer Science 2018-06-19 Saurabh Sahu , Rahul Gupta , Carol Espy-Wilson

Neural text generation models are often autoregressive language models or seq2seq models. These models generate text by sampling words sequentially, with each word conditioned on the previous word, and are state-of-the-art for several…

Machine Learning · Statistics 2018-03-02 William Fedus , Ian Goodfellow , Andrew M. Dai

Generative Adversarial Networks (GANs) have shown immense potential in fields such as text and image generation. Only very recently attempts to exploit GANs to statistical-mechanics models have been reported. Here we quantitatively test…

Statistical Mechanics · Physics 2024-05-07 Daniele Lanzoni , Olivier Pierre-Louis , Francesco Montalenti

Generating images from natural language is one of the primary applications of recent conditional generative models. Besides testing our ability to model conditional, highly dimensional distributions, text to image synthesis has many…

Computer Vision and Pattern Recognition · Computer Science 2018-05-03 Cristian Bodnar

We present a self-attention based bilingual adversarial text generator (B-GAN) which can learn to generate text from the encoder representation of an unsupervised neural machine translation system. B-GAN is able to generate a distributed…

Computation and Language · Computer Science 2020-11-12 Ahmad Rashid , Alan Do-Omri , Md. Akmal Haidar , Qun Liu , Mehdi Rezagholizadeh