English
Related papers

Related papers: Neural Headline Generation with Sentence-wise Opti…

200 papers

Headline generation is a special type of text summarization task. While the amount of available training data for this task is almost unlimited, it still remains challenging, as learning to generate headlines for news articles implies that…

Computation and Language · Computer Science 2019-01-24 Daniil Gavrilov , Pavel Kalaidin , Valentin Malykh

We introduce recurrent neural network grammars, probabilistic models of sentences with explicit phrase structure. We explain efficient inference procedures that allow application to both parsing and language modeling. Experiments show that…

Computation and Language · Computer Science 2016-10-13 Chris Dyer , Adhiguna Kuncoro , Miguel Ballesteros , Noah A. Smith

We propose a two-stage neural model to tackle question generation from documents. First, our model estimates the probability that word sequences in a document are ones that a human would pick when selecting candidate answers by training a…

Computation and Language · Computer Science 2018-05-31 Sandeep Subramanian , Tong Wang , Xingdi Yuan , Saizheng Zhang , Yoshua Bengio , Adam Trischler

Story generation is an important natural language processing task that aims to generate coherent stories automatically. While the use of neural networks has proven effective in improving story generation, how to learn to generate an…

Computation and Language · Computer Science 2019-12-09 Gang Chen , Yang Liu , Huanbo Luan , Meng Zhang , Qun Liu , Maosong Sun

Neural-based end-to-end approaches to natural language generation (NLG) from structured data or knowledge are data-hungry, making their adoption for real-world applications difficult with limited data. In this work, we propose the new task…

Computation and Language · Computer Science 2020-04-21 Zhiyu Chen , Harini Eavani , Wenhu Chen , Yinyin Liu , William Yang Wang

We study the problem of generating keyphrases that summarize the key points for a given document. While sequence-to-sequence (seq2seq) models have achieved remarkable performance on this task (Meng et al., 2017), model training often relies…

Computation and Language · Computer Science 2019-09-09 Hai Ye , Lu Wang

Recent neural models have shown significant progress on the problem of generating short descriptive texts conditioned on a small number of database records. In this work, we suggest a slightly more difficult data-to-text generation task,…

Computation and Language · Computer Science 2017-07-26 Sam Wiseman , Stuart M. Shieber , Alexander M. Rush

Neural language model-based approaches to automated story generation suffer from two important limitations. First, language model-based story generators generally do not work toward a given goal or ending. Second, they often lose coherence…

Computation and Language · Computer Science 2021-12-08 Louis Castricato , Spencer Frazier , Jonathan Balloch , Nitya Tarakad , Mark Riedl

Outline generation aims to reveal the internal structure of a document by identifying underlying chapter relationships and generating corresponding chapter summaries. Although existing deep learning methods and large models perform well on…

Artificial Intelligence · Computer Science 2024-12-03 Yan Yan , Yuanchi Ma

We explore story generation: creative systems that can build coherent and fluent passages of text about a topic. We collect a large dataset of 300K human-written stories paired with writing prompts from an online forum. Our dataset enables…

Computation and Language · Computer Science 2018-05-15 Angela Fan , Mike Lewis , Yann Dauphin

Neural network based approaches to automated story plot generation attempt to learn how to generate novel plots from a corpus of natural language plot summaries. Prior work has shown that a semantic abstraction of sentences called events…

Computation and Language · Computer Science 2023-01-19 Prithviraj Ammanabrolu , Ethan Tien , Wesley Cheung , Zhaochen Luo , William Ma , Lara J. Martin , Mark O. Riedl

Recurrent Neural Networks can be trained to produce sequences of tokens given some input, as exemplified by recent results in machine translation and image captioning. The current approach to training them consists of maximizing the…

Machine Learning · Computer Science 2015-09-24 Samy Bengio , Oriol Vinyals , Navdeep Jaitly , Noam Shazeer

Recent approaches to data-to-text generation have adopted the very successful encoder-decoder architecture or variants thereof. These models generate text which is fluent (but often imprecise) and perform quite poorly at selecting…

Computation and Language · Computer Science 2021-02-05 Ratish Puduppully , Mirella Lapata

In order to reveal the rationale behind model predictions, many works have exploited providing explanations in various forms. Recently, to further guarantee readability, more and more works turn to generate sentence-level human language…

Computation and Language · Computer Science 2023-02-22 Yan Liu , Xiaokang Chen , Qi Dai

Chinese word segmentation has entered the deep learning era which greatly reduces the hassle of feature engineering. Recently, some researchers attempted to treat it as character-level translation, which further simplified model designing,…

Computation and Language · Computer Science 2022-10-12 Pinzhen Chen , Kenneth Heafield

News headline generation is an essential problem of text summarization because it is constrained, well-defined, and is still hard to solve. Models with a limited vocabulary can not solve it well, as new named entities can appear regularly…

Computation and Language · Computer Science 2020-05-06 Ilya Gusev

Neural language models are often trained with maximum likelihood estimation (MLE), where the next word is generated conditioned on the ground-truth word tokens. During testing, however, the model is instead conditioned on previously…

Computation and Language · Computer Science 2020-10-14 Guoyin Wang , Chunyuan Li , Jianqiao Li , Hao Fu , Yuh-Chen Lin , Liqun Chen , Yizhe Zhang , Chenyang Tao , Ruiyi Zhang , Wenlin Wang , Dinghan Shen , Qian Yang , Lawrence Carin

Recent language models, especially those based on recurrent neural networks (RNNs), make it possible to generate natural language from a learned probability. Language generation has wide applications including machine translation,…

Computation and Language · Computer Science 2016-01-05 Lili Mou , Rui Yan , Ge Li , Lu Zhang , Zhi Jin

Likelihood training and maximization-based decoding result in dull and repetitive generated texts even when using powerful language models (Holtzman et al., 2019). Adding a loss function for regularization was shown to improve text…

Computation and Language · Computer Science 2021-01-13 Evgeny Lagutin , Daniil Gavrilov , Pavel Kalaidin

This paper explores the task of translating natural language queries into regular expressions which embody their meaning. In contrast to prior work, the proposed neural model does not utilize domain-specific crafting, learning to translate…

Computation and Language · Computer Science 2016-08-11 Nicholas Locascio , Karthik Narasimhan , Eduardo DeLeon , Nate Kushman , Regina Barzilay