English
Related papers

Related papers: Neural Sequence-to-Sequence Modeling with Attentio…

200 papers

A critical point of multi-document summarization (MDS) is to learn the relations among various documents. In this paper, we propose a novel abstractive MDS model, in which we represent multiple documents as a heterogeneous graph, taking…

Computation and Language · Computer Science 2021-10-22 Peng Cui , Le Hu

Sequence-to-sequence (seq2seq) neural models have been actively investigated for abstractive summarization. Nevertheless, existing neural abstractive systems frequently generate factually incorrect summaries and are vulnerable to…

Computation and Language · Computer Science 2018-10-16 Lisa Fan , Dong Yu , Lu Wang

Inspired by how humans summarize long documents, we propose an accurate and fast summarization model that first selects salient sentences and then rewrites them abstractively (i.e., compresses and paraphrases) to generate a concise overall…

Computation and Language · Computer Science 2018-05-29 Yen-Chun Chen , Mohit Bansal

Text summarization aims to compress a textual document to a short summary while keeping salient information. Extractive approaches are widely used in text summarization because of their fluency and efficiency. However, most of existing…

Computation and Language · Computer Science 2020-10-14 Peng Cui , Le Hu , Yuanchao Liu

Neural abstractive summarization models have led to promising results in summarizing relatively short documents. We propose the first model for abstractive summarization of single, longer-form documents (e.g., research papers). Our approach…

Computation and Language · Computer Science 2018-05-23 Arman Cohan , Franck Dernoncourt , Doo Soon Kim , Trung Bui , Seokhwan Kim , Walter Chang , Nazli Goharian

Attention mechanism plays a dominant role in the sequence generation models and has been used to improve the performance of machine translation and abstractive text summarization. Different from neural machine translation, in the task of…

Computation and Language · Computer Science 2020-04-09 Piji Li , Lidong Bing , Zhongyu Wei , Wai Lam

Specifically focusing on the landscape of abstractive text summarization, as opposed to extractive techniques, this survey presents a comprehensive overview, delving into state-of-the-art techniques, prevailing challenges, and prospective…

Computation and Language · Computer Science 2024-09-05 Hassan Shakil , Ahmad Farooq , Jugal Kalita

Attentional, RNN-based encoder-decoder models for abstractive summarization have achieved good performance on short input and output sequences. For longer documents and summaries however these models often include repetitive and incoherent…

Computation and Language · Computer Science 2017-11-15 Romain Paulus , Caiming Xiong , Richard Socher

Text summarization aims to extract essential information from a piece of text and transform the text into a concise version. Existing unsupervised abstractive summarization models leverage recurrent neural networks framework while the…

Computation and Language · Computer Science 2020-10-20 Ziyi Yang , Chenguang Zhu , Robert Gmyr , Michael Zeng , Xuedong Huang , Eric Darve

We propose a new deep neural network model and its training scheme for text classification. Our model Sequence-to-convolution Neural Networks(Seq2CNN) consists of two blocks: Sequential Block that summarizes input texts and Convolution…

Computation and Language · Computer Science 2020-06-04 Taehoon Kim , Jihoon Yang

Text summarization and text simplification are two major ways to simplify the text for poor readers, including children, non-native speakers, and the functionally illiterate. Text summarization is to produce a brief summary of the main…

Computation and Language · Computer Science 2017-10-09 Shuming Ma , Xu Sun

Abstractive summarization is the process of generating novel sentences based on the information extracted from the original text document while retaining the context. Due to abstractive summarization's underlying complexities, most of the…

Computation and Language · Computer Science 2020-12-18 Prithwiraj Bhattacharjee , Avi Mallick , Md Saiful Islam , Marium-E-Jannat

Abstractive document summarization is usually modeled as a sequence-to-sequence (Seq2Seq) learning problem. Unfortunately, training large Seq2Seq based summarization models on limited supervised summarization data is challenging. This paper…

Computation and Language · Computer Science 2020-10-13 Yanyan Zou , Xingxing Zhang , Wei Lu , Furu Wei , Ming Zhou

Speech-to-text (S2T) summarization is a time-saving technique for filtering and keeping up with the broadcast news uploaded online on a daily basis. The rise of large language models from deep learning with impressive text generation…

Computation and Language · Computer Science 2023-06-12 Raul Monteiro , Diogo Pernes

Text summarization aims to generate a headline or a short summary consisting of the major information of the source text. Recent studies employ the sequence-to-sequence framework to encode the input with a neural network and generate…

Computation and Language · Computer Science 2020-03-26 Haiyang Xu , Yahao He , Kun Han , Junwen Chen , Xiangang Li

Abstractive summarization for long-document or multi-document remains challenging for the Seq2Seq architecture, as Seq2Seq is not good at analyzing long-distance relations in text. In this paper, we present BASS, a novel framework for…

Computation and Language · Computer Science 2021-05-26 Wenhao Wu , Wei Li , Xinyan Xiao , Jiachen Liu , Ziqiang Cao , Sujian Li , Hua Wu , Haifeng Wang

Speech summarization, which generates a text summary from speech, can be achieved by combining automatic speech recognition (ASR) and text summarization (TS). With this cascade approach, we can exploit state-of-the-art models and large…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-17 Takatomo Kano , Atsunori Ogawa , Marc Delcroix , Shinji Watanabe

Text summarization (TS) is a natural language processing (NLP) subtask pertaining to the automatic formulation of a concise and coherent summary that covers the major concepts and topics from one or multiple documents. Recent advancements…

Computation and Language · Computer Science 2023-11-15 Nikolaos Giarelis , Charalampos Mastrokostas , Nikos Karacapilidis

Speech summarization is typically performed by using a cascade of speech recognition and text summarization models. End-to-end modeling of speech summarization models is challenging due to memory and compute constraints arising from long…

Computation and Language · Computer Science 2022-01-26 Roshan Sharma , Shruti Palaskar , Alan W Black , Florian Metze

Sequence-to-sequence models provide a viable new approach to generative summarization, allowing models that are no longer limited to simply selecting and recombining sentences from the original text. However, these models have three…

Computation and Language · Computer Science 2021-08-19 Tianyang Xu , Chunyun Zhang