English
Related papers

Related papers: Weak Supervision Enhanced Generative Network for Q…

200 papers

A machine learning model was developed to automatically generate questions from Wikipedia passages using transformers, an attention-based model eschewing the paradigm of existing recurrent neural networks (RNNs). The model was trained on…

Computation and Language · Computer Science 2019-09-17 Kettip Kriangchaivech , Artit Wangperawong

Deep neural networks are gaining increasing popularity for the classic text classification task, due to their strong expressive power and less requirement for feature engineering. Despite such attractiveness, neural text classification…

Information Retrieval · Computer Science 2018-09-13 Yu Meng , Jiaming Shen , Chao Zhang , Jiawei Han

We present a novel natural language generation system for spoken dialogue systems capable of entraining (adapting) to users' way of speaking, providing contextually appropriate responses. The generator is based on recurrent neural networks…

Computation and Language · Computer Science 2017-09-18 Ondřej Dušek , Filip Jurčíček

An intelligent dialogue system in a multi-turn setting should not only generate the responses which are of good quality, but it should also generate the responses which can lead to long-term success of the dialogue. Although, the current…

Computation and Language · Computer Science 2023-01-12 Anant Khandelwal

Deep generative models provide powerful tools for distributions over complicated manifolds, such as those of natural images. But many of these methods, including generative adversarial networks (GANs), can be difficult to train, in part…

Machine Learning · Statistics 2017-11-08 Akash Srivastava , Lazar Valkov , Chris Russell , Michael U. Gutmann , Charles Sutton

Semantic segmentation has been a long standing challenging task in computer vision. It aims at assigning a label to each image pixel and needs significant number of pixellevel annotated data, which is often unavailable. To address this…

Computer Vision and Pattern Recognition · Computer Science 2017-03-29 Nasim Souly , Concetto Spampinato , Mubarak Shah

Automatic question generation aims at the generation of questions from a context, with the corresponding answers being sub-spans of the given passage. Whereas, most of the methods mostly rely on heuristic rules to generate questions, more…

Computation and Language · Computer Science 2019-11-07 Tassilo Klein , Moin Nabi

Generative models for open domain question answering have proven to be competitive, without resorting to external knowledge. While promising, this approach requires to use models with billions of parameters, which are expensive to train and…

Computation and Language · Computer Science 2021-02-04 Gautier Izacard , Edouard Grave

Scarcity of training data for task-oriented dialogue systems is a well known problem that is usually tackled with costly and time-consuming manual data annotation. An alternative solution is to rely on automatic text generation which,…

Computation and Language · Computer Science 2020-11-05 Stéphane d'Ascoli , Alice Coucke , Francesco Caltagirone , Alexandre Caulier , Marc Lelarge

Existing text generation methods tend to produce repeated and "boring" expressions. To tackle this problem, we propose a new text generation model, called Diversity-Promoting Generative Adversarial Network (DP-GAN). The proposed model…

Computation and Language · Computer Science 2018-08-22 Jingjing Xu , Xuancheng Ren , Junyang Lin , Xu Sun

A natural image usually conveys rich semantic content and can be viewed from different angles. Existing image description methods are largely restricted by small sets of biased visual paragraph annotations, and fail to cover rich underlying…

Computer Vision and Pattern Recognition · Computer Science 2017-03-27 Xiaodan Liang , Zhiting Hu , Hao Zhang , Chuang Gan , Eric P. Xing

Extracting appropriate features to represent a corpus is an important task for textual mining. Previous attention based work usually enhance feature at the lexical level, which lacks the exploration of feature augmentation at the sentence…

Computation and Language · Computer Science 2018-12-14 Longxuan Ma , Pengfei Wang , Lei Zhang

As a new way of training generative models, Generative Adversarial Nets (GAN) that uses a discriminative model to guide the training of the generative model has enjoyed considerable success in generating real-valued data. However, it has…

Machine Learning · Computer Science 2017-08-28 Lantao Yu , Weinan Zhang , Jun Wang , Yong Yu

Natural question generation (QG) aims to generate questions from a passage and an answer. Previous works on QG either (i) ignore the rich structure information hidden in text, (ii) solely rely on cross-entropy loss that leads to issues like…

Computation and Language · Computer Science 2020-08-28 Yu Chen , Lingfei Wu , Mohammed J. Zaki

We present a self-attention based bilingual adversarial text generator (B-GAN) which can learn to generate text from the encoder representation of an unsupervised neural machine translation system. B-GAN is able to generate a distributed…

Computation and Language · Computer Science 2020-11-12 Ahmad Rashid , Alan Do-Omri , Md. Akmal Haidar , Qun Liu , Mehdi Rezagholizadeh

Lexically constrained sentence generation allows the incorporation of prior knowledge such as lexical constraints into the output. This technique has been applied to machine translation, and dialog response generation. Previous work usually…

Computation and Language · Computer Science 2021-09-14 Xingwei He , Victor O. K. Li

This paper argues that generating output tokens is more effective than using pooled representations for prediction tasks because token-level generation retains more mutual information. Since LLMs are trained on massive text corpora using…

This paper presents a systematic survey on recent development of neural text generation models. Specifically, we start from recurrent neural network language models with the traditional maximum likelihood estimation training scheme and…

Computation and Language · Computer Science 2018-03-21 Sidi Lu , Yaoming Zhu , Weinan Zhang , Jun Wang , Yong Yu

Recent question generation (QG) approaches often utilize the sequence-to-sequence framework (Seq2Seq) to optimize the log-likelihood of ground-truth questions using teacher forcing. However, this training objective is inconsistent with…

Computation and Language · Computer Science 2020-11-03 Yuxi Xie , Liangming Pan , Dongzhe Wang , Min-Yen Kan , Yansong Feng

I-vector based text-independent speaker verification (SV) systems often have poor performance with short utterances, as the biased phonetic distribution in a short utterance makes the extracted i-vector unreliable. This paper proposes an…

Audio and Speech Processing · Electrical Eng. & Systems 2018-04-03 Jiacen Zhang , Nakamasa Inoue , Koichi Shinoda