English
Related papers

Related papers: GanLM: Encoder-Decoder Pre-training with an Auxili…

200 papers

Machine learning models, especially neural network (NN) classifiers, are widely used in many applications including natural language processing, computer vision and cybersecurity. They provide high accuracy under the assumption of…

Machine Learning · Computer Science 2019-03-08 Guanxiong Liu , Issa Khalil , Abdallah Khreishah

Generative networks are fundamentally different in their aim and methods compared to CNNs for classification, segmentation, or object detection. They have initially not been meant to be an image analysis tool, but to produce naturally…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Markus Wenzel

In recent years, research on image generation methods has been developing fast. The auto-encoding variational Bayes method (VAEs) was proposed in 2013, which uses variational inference to learn a latent space from the image database and…

Computer Vision and Pattern Recognition · Computer Science 2018-07-12 Guoqiang Zhong , Wei Gao , Yongbin Liu , Youzhao Yang

Generative models have made significant progress in the tasks of modeling complex data distributions such as natural images. The introduction of Generative Adversarial Networks (GANs) and auto-encoders lead to the possibility of training on…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Tobias Hinz , Stefan Wermter

Generative adversarial networks (GANs) are emerging machine learning models for generating synthesized data similar to real data by jointly training a generator and a discriminator. In many applications, data and computational resources are…

Machine Learning · Computer Science 2021-07-20 Jinke Ren , Chonghe Liu , Guanding Yu , Dongning Guo

We introduce generative adversarial models in which the discriminator is replaced by a calibrated (non-differentiable) classifier repeatedly enhanced by domain relevant features. The role of the classifier is to prove that the actual and…

Machine Learning · Computer Science 2019-10-08 Shahar Harel , Meir Maor , Amir Ronen

Recent advancements in Natural Language Processing (NLP) have impacted numerous sub-fields such as natural language generation, natural language inference, question answering, and more. However, in the field of question generation, the…

Computation and Language · Computer Science 2024-09-30 Devrim Cavusoglu , Secil Sen , Ulas Sert

Paraphrase generation is an important and challenging natural language processing (NLP) task. In this work, we propose a deep generative model to generate paraphrase with diversity. Our model is based on an encoder-decoder architecture. An…

Computation and Language · Computer Science 2019-10-01 Zhecheng An , Sicong Liu

Generative adversarial networks (GANs) provide an algorithmic framework for constructing generative models with several appealing properties: they do not require a likelihood function to be specified, only a generating procedure; they…

Machine Learning · Statistics 2017-02-28 Shakir Mohamed , Balaji Lakshminarayanan

This paper describes a method for using Generative Adversarial Networks to learn distributed representations of natural language documents. We propose a model that is based on the recently proposed Energy-Based GAN, but instead uses a…

Machine Learning · Computer Science 2016-12-30 John Glover

This paper proposes an encoder-decoder architecture grounded on Generative Adversarial Networks (GANs), that generates a sequence of activities and their timestamps in an end-to-end way. GANs work well with differentiable data such as…

Machine Learning · Computer Science 2020-10-20 Farbod Taymouri , Marcello La Rosa

Generative adversarial networks (GANs)successfully generate high quality data by learning amapping from a latent vector to the data. Various studies assert that the latent space of a GAN is semanticallymeaningful and can be utilized for…

Computer Vision and Pattern Recognition · Computer Science 2020-03-06 Duhyeon Bang , Seoungyoon Kang , Hyunjung Shim

Classical parametric speech coding techniques provide a compact representation for speech signals. This affords a very low transmission rate but with a reduced perceptual quality of the reconstructed signals. Recently, autoregressive deep…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-02 Ahmed Mustafa , Arijit Biswas , Christian Bergler , Julia Schottenhamml , Andreas Maier

Pre-trained language models have been successfully used in response generation for open-domain dialogue. Four main frameworks have been proposed: (1) Transformer-ED using Transformer encoder and decoder separately for source and target…

Computation and Language · Computer Science 2020-10-27 Yan Zeng , Jian-Yun Nie

We propose a generative adversarial network (GAN)-based decoder for quantum topological codes and apply it to enhance a quantum teleportation protocol under depolarizing noise. By constructing and training the GAN's generator and…

Quantum Physics · Physics 2025-11-07 Jiaxin Li , Zhimin Wang , Alberto Ferrara , Yongjian Gu , Rosario Lo Franco

It is still a challenging task to learn a neural text generation model under the framework of generative adversarial networks (GANs) since the entire training process is not differentiable. The existing training strategies either suffer…

Computation and Language · Computer Science 2023-07-25 Liping Yuan , Jiehang Zeng , Xiaoqing Zheng

Pretraining DNA language models (DNALMs) on the full human genome is resource-intensive, yet often considered necessary for strong downstream performance. Inspired by recent findings in NLP and long-context modeling, we explore an…

Genomics · Quantitative Biology 2025-06-24 Sohan Mupparapu , Parameswari Krishnamurthy , Ratish Puduppully

This study focused on efficient text generation using generative adversarial networks (GAN). Assuming that the goal is to generate a paragraph of a user-defined topic and sentimental tendency, conventionally the whole network has to be…

Computation and Language · Computer Science 2020-06-23 Chenhan Yuan , Yi-chin Huang , Cheng-Hung Tsai

In recent years, Generative Adversarial Networks (GANs) have become a hot topic among researchers and engineers that work with deep learning. It has been a ground-breaking technique which can generate new pieces of content of data in a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Parthak Mehta , Sarthak Mishra , Nikhil Chouhan , Neel Pethani , Ishani Saha

Pre-trained speech language models such as HuBERT and WavLM leverage unlabeled speech data for self-supervised learning and offer powerful representations for numerous downstream tasks. Despite the success of these models, their high…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-24 Yingying Gao , Shilei Zhang , Chao Deng , Junlan Feng