English
Related papers

Related papers: SummaRuNNer: A Recurrent Neural Network based Sequ…

200 papers

Headline generation for spoken content is important since spoken content is difficult to be shown on the screen and browsed by the user. It is a special type of abstractive summarization, for which the summaries are generated word by word…

Computation and Language · Computer Science 2016-12-28 Lang-Chi Yu , Hung-yi Lee , Lin-shan Lee

We propose a new model for unsupervised document embedding. Leading existing approaches either require complex inference or use recurrent neural networks (RNN) that are difficult to parallelize. We take a different route and develop a…

Computation and Language · Computer Science 2018-02-21 Chundi Liu , Shunan Zhao , Maksims Volkovs

Recurrent Neural Networks (RNN) are known as powerful models for handling sequential data, and especially widely utilized in various natural language processing tasks. In this paper, we propose Contextual Recurrent Units (CRU) for enhancing…

Computation and Language · Computer Science 2019-11-15 Yiming Cui , Wei-Nan Zhang , Wanxiang Che , Ting Liu , Zhipeng Chen , Shijin Wang , Guoping Hu

Neural summarization models suffer from the fixed-size input limitation: if text length surpasses the model's maximal number of input tokens, some document content (possibly summary-relevant) gets truncated Independently summarizing windows…

Computation and Language · Computer Science 2020-04-08 Leon Schüller , Florian Wilhelm , Nico Kreiling , Goran Glavaš

We introduce segmental recurrent neural networks (SRNNs) which define, given an input sequence, a joint probability distribution over segmentations of the input and labelings of the segments. Representations of the input segments (i.e.,…

Computation and Language · Computer Science 2016-03-03 Lingpeng Kong , Chris Dyer , Noah A. Smith

With the abundance of automatic meeting transcripts, meeting summarization is of great interest to both participants and other parties. Traditional methods of summarizing meetings depend on complex multi-step pipelines that make joint…

Computation and Language · Computer Science 2020-09-22 Chenguang Zhu , Ruochen Xu , Michael Zeng , Xuedong Huang

The predictive learning of spatiotemporal sequences aims to generate future images by learning from the historical context, where the visual dynamics are believed to have modular structures that can be learned with compositional subsystems.…

Machine Learning · Computer Science 2022-04-12 Yunbo Wang , Haixu Wu , Jianjin Zhang , Zhifeng Gao , Jianmin Wang , Philip S. Yu , Mingsheng Long

Knowledge tracing---where a machine models the knowledge of a student as they interact with coursework---is a well established problem in computer supported education. Though effectively modeling student knowledge would have high…

Artificial Intelligence · Computer Science 2015-06-22 Chris Piech , Jonathan Spencer , Jonathan Huang , Surya Ganguli , Mehran Sahami , Leonidas Guibas , Jascha Sohl-Dickstein

Modeling the structure of coherent texts is a key NLP problem. The task of coherently organizing a given set of sentences has been commonly used to build and evaluate models that understand such structure. We propose an end-to-end…

Computation and Language · Computer Science 2017-12-25 Lajanugen Logeswaran , Honglak Lee , Dragomir Radev

To simultaneously capture syntax and global semantics from a text corpus, we propose a new larger-context recurrent neural network (RNN) based language model, which extracts recurrent hierarchical semantic structure via a dynamic deep topic…

Computation and Language · Computer Science 2020-06-30 Dandan Guo , Bo Chen , Ruiying Lu , Mingyuan Zhou

Text classification is a fundamental task in natural language processing (NLP). Several recent studies show the success of deep learning on text processing. Convolutional neural network (CNN), as a popular deep learning model, has shown…

Computation and Language · Computer Science 2023-01-30 Ali Jarrahi , Ramin Mousa , Leila Safari

Summarization of long sequences into a concise statement is a core problem in natural language processing, requiring non-trivial understanding of the input. Based on the promising results of graph neural networks on highly structured data,…

Machine Learning · Computer Science 2021-02-04 Patrick Fernandes , Miltiadis Allamanis , Marc Brockschmidt

Abstractive summarization typically relies on large collections of paired articles and summaries. However, in many cases, parallel data is scarce and costly to obtain. We develop an abstractive summarization system that relies only on large…

Computation and Language · Computer Science 2020-03-04 Nikola I. Nikolov , Richard H. R. Hahnloser

We develop an abstractive summarization framework independent of labeled data for multiple heterogeneous documents. Unlike existing multi-document summarization methods, our framework processes documents telling different stories instead of…

Computation and Language · Computer Science 2022-05-03 Ning Wang , Han Liu , Diego Klabjan

Pre-trained and fine-tuned news summarizers are expected to generalize to news articles unseen in the fine-tuning (training) phase. However, these articles often contain specifics, such as new events and people, a summarizer could not learn…

Computation and Language · Computer Science 2022-04-19 Arthur Bražinskas , Mengwen Liu , Ramesh Nallapati , Sujith Ravi , Markus Dreyer

The exponential growth of textual data has created a crucial need for tools that assist users in extracting meaningful insights. Traditional document summarization approaches often fail to meet individual user requirements and lack…

Information Retrieval · Computer Science 2023-07-13 Samira Ghodratnama , Amin Beheshti , Mehrdad Zakershahrak

Video summarisation can be posed as the task of extracting important parts of a video in order to create an informative summary of what occurred in the video. In this paper we introduce SummaryNet as a supervised learning framework for…

Computer Vision and Pattern Recognition · Computer Science 2020-02-24 Ziyad Jappie , David Torpey , Turgay Celik

In this paper, we develop a neural summarization model which can effectively process multiple input documents and distill Transformer architecture with the ability to encode documents in a hierarchical manner. We represent cross-document…

Computation and Language · Computer Science 2019-05-31 Yang Liu , Mirella Lapata

The key to the text classification task is language representation and important information extraction, and there are many related studies. In recent years, the research on graph neural network (GNN) in text classification has gradually…

Computation and Language · Computer Science 2022-09-16 Shuai Hua , Xinxin Li , Yunpeng Jing , Qunfeng Liu

This work proposes Recurrent Neural Network (RNN) models to predict structured 'image situations' -- actions and noun entities fulfilling semantic roles related to the action. In contrast to prior work relying on Conditional Random Fields…

Computer Vision and Pattern Recognition · Computer Science 2017-08-07 Arun Mallya , Svetlana Lazebnik