中文
相关论文

相关论文: TextKD-GAN: Text Generation using KnowledgeDistill…

200 篇论文

Graph neural networks (GNNs) have been widely used in modeling graph structured data, owing to its impressive performance in a wide range of practical applications. Recently, knowledge distillation (KD) for GNNs has enabled remarkable…

机器学习 · 计算机科学 2022-06-17 Yuanxin Zhuang , Lingjuan Lyu , Chuan Shi , Carl Yang , Lichao Sun

Generative Adversarial Networks (GANs) achieve excellent performance in generative tasks, such as image super-resolution, but their computational requirements make difficult their deployment on resource-constrained devices. While knowledge…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Nikolaos Kaparinos , Vasileios Mezaris

GANs have been shown to perform exceedingly well on tasks pertaining to image generation and style transfer. In the field of language modelling, word embeddings such as GLoVe and word2vec are state-of-the-art methods for applying neural…

计算与语言 · 计算机科学 2020-05-19 Afroz Ahamad

One-class novelty detection is to identify anomalous instances that do not conform to the expected normal instances. In this paper, the Generative Adversarial Networks (GANs) based on encoder-decoder-encoder pipeline are used for detection…

计算机视觉与模式识别 · 计算机科学 2021-07-27 Zhiwei Zhang , Shifeng Chen , Lei Sun

One of the most significant challenges in statistical signal processing and machine learning is how to obtain a generative model that can produce samples of large-scale data distribution, such as images and speeches. Generative Adversarial…

计算机视觉与模式识别 · 计算机科学 2020-05-28 Pegah Salehi , Abdolah Chalechale , Maryam Taghizadeh

The author-specific word usage is a vital feature to let readers perceive the writing style of the author. In this work, a personalized sentence generation method based on generative adversarial networks (GANs) is proposed to cope with this…

计算与语言 · 计算机科学 2019-04-23 Chenhan Yuan , Yi-Chin Huang

Deep learning models for speech rely on large datasets, presenting computational challenges. Yet, performance hinges on training data size. Dataset Distillation (DD) aims to learn a smaller dataset without much performance degradation when…

Generative adversarial nets (GAN) has been successfully introduced for generating text to alleviate the exposure bias. However, discriminators in these models only evaluate the entire sequence, which causes feedback sparsity and mode…

机器学习 · 计算机科学 2019-05-31 Xingyuan Chen , Yanzhe Li , Peng Jin , Jiuhua Zhang , Xinyu Dai , Jiajun Chen , Gang Song

Generative Adversarial Networks (GANs) have gathered a lot of attention from the computer vision community, yielding impressive results for image generation. Advances in the adversarial generation of natural language from noise however are…

计算与语言 · 计算机科学 2017-06-01 Sai Rajeswar , Sandeep Subramanian , Francis Dutil , Christopher Pal , Aaron Courville

Bayesian neural networks (BNNs) allow us to reason about uncertainty in a principled way. Stochastic Gradient Langevin Dynamics (SGLD) enables efficient BNN learning by drawing samples from the BNN posterior using mini-batches. However,…

机器学习 · 计算机科学 2018-06-28 Kuan-Chieh Wang , Paul Vicol , James Lucas , Li Gu , Roger Grosse , Richard Zemel

Pre-trained models have achieved remarkable success in natural language processing (NLP). However, existing pre-training methods underutilize the benefits of language understanding for generation. Inspired by the idea of Generative…

计算与语言 · 计算机科学 2023-05-10 Jian Yang , Shuming Ma , Li Dong , Shaohan Huang , Haoyang Huang , Yuwei Yin , Dongdong Zhang , Liqun Yang , Furu Wei , Zhoujun Li

Conventional Generative Adversarial Networks (GANs) for text generation tend to have issues of reward sparsity and mode collapse that affect the quality and diversity of generated samples. To address the issues, we propose a novel…

计算与语言 · 计算机科学 2020-02-13 Wangchunshu Zhou , Tao Ge , Ke Xu , Furu Wei , Ming Zhou

Converting text descriptions into images using Generative Adversarial Networks has become a popular research area. Visually appealing images have been generated successfully in recent years. Inspired by these studies, we investigated the…

计算机视觉与模式识别 · 计算机科学 2020-07-10 Azmi Can Özgen , Hazım Kemal Ekenel

This paper presents a new Text-to-Image generation model, named Distribution Regularization Generative Adversarial Network (DR-GAN), to generate images from text descriptions from improved distribution learning. In DR-GAN, we introduce two…

计算机视觉与模式识别 · 计算机科学 2022-04-19 Hongchen Tan , Xiuping Liu , Baocai Yin , Xin Li

Generative adversarial nets (GANs) have been successfully applied to the artificial generation of image data. In terms of text data, much has been done on the artificial generation of natural language from a single corpus. We consider…

计算与语言 · 计算机科学 2017-12-27 Baiyang Wang , Diego Klabjan

Generative Adversarial Networks (GANs) have gained a lot of attention from machine learning community due to their ability to learn and mimic an input data distribution. GANs consist of a discriminator and a generator working in tandem…

计算与语言 · 计算机科学 2018-06-19 Saurabh Sahu , Rahul Gupta , Carol Espy-Wilson

Neural text generation models are often autoregressive language models or seq2seq models. These models generate text by sampling words sequentially, with each word conditioned on the previous word, and are state-of-the-art for several…

机器学习 · 统计学 2018-03-02 William Fedus , Ian Goodfellow , Andrew M. Dai

Generative Adversarial Networks (GANs) have shown immense potential in fields such as text and image generation. Only very recently attempts to exploit GANs to statistical-mechanics models have been reported. Here we quantitatively test…

统计力学 · 物理学 2024-05-07 Daniele Lanzoni , Olivier Pierre-Louis , Francesco Montalenti

Generating images from natural language is one of the primary applications of recent conditional generative models. Besides testing our ability to model conditional, highly dimensional distributions, text to image synthesis has many…

计算机视觉与模式识别 · 计算机科学 2018-05-03 Cristian Bodnar

We present a self-attention based bilingual adversarial text generator (B-GAN) which can learn to generate text from the encoder representation of an unsupervised neural machine translation system. B-GAN is able to generate a distributed…

计算与语言 · 计算机科学 2020-11-12 Ahmad Rashid , Alan Do-Omri , Md. Akmal Haidar , Qun Liu , Mehdi Rezagholizadeh