English
Related papers

Related papers: Abstractive Text Summarization Using Sequence-to-S…

200 papers

Automatically generating accurate summaries from clinical reports could save a clinician's time, improve summary coverage, and reduce errors. We propose a sequence-to-sequence abstractive summarization model augmented with domain-specific…

Computation and Language · Computer Science 2019-05-16 Sean MacAvaney , Sajad Sotudeh , Arman Cohan , Nazli Goharian , Ish Talati , Ross W. Filice

Attention mechanism plays a dominant role in the sequence generation models and has been used to improve the performance of machine translation and abstractive text summarization. Different from neural machine translation, in the task of…

Computation and Language · Computer Science 2020-04-09 Piji Li , Lidong Bing , Zhongyu Wei , Wai Lam

Most prior work in the sequence-to-sequence paradigm focused on datasets with input sequence lengths in the hundreds of tokens due to the computational constraints of common RNN and Transformer architectures. In this paper, we study…

Computation and Language · Computer Science 2020-06-20 Yao Zhao , Mohammad Saleh , Peter J. Liu

Copy mechanism allows sequence-to-sequence models to choose words from the input and put them directly into the output, which is finding increasing use in abstractive summarization. However, since there is no explicit delimiter in Chinese…

Computation and Language · Computer Science 2021-12-22 Boyan Wan , Mishal Sohail

As an attempt to combine extractive and abstractive summarization, Sentence Rewriting models adopt the strategy of extracting salient sentences from a document first and then paraphrasing the selected ones to generate a summary. However,…

Computation and Language · Computer Science 2019-09-27 Sanghwan Bae , Taeuk Kim , Jihoon Kim , Sang-goo Lee

Automatic Text Summarization (ATS) is becoming relevant with the growth of textual data; however, with the popularization of public large-scale datasets, some recent machine learning approaches have focused on dense models and architectures…

Computation and Language · Computer Science 2023-03-07 Vinícius Camargo da Silva , João Paulo Papa , Kelton Augusto Pontara da Costa

This paper proposes a text summarization approach for factual reports using a deep learning model. This approach consists of three phases: feature extraction, feature enhancement, and summary generation, which work together to assimilate…

Computation and Language · Computer Science 2019-01-10 Sukriti Verma , Vagisha Nidhi

We propose a new deep neural network model and its training scheme for text classification. Our model Sequence-to-convolution Neural Networks(Seq2CNN) consists of two blocks: Sequential Block that summarizes input texts and Convolution…

Computation and Language · Computer Science 2020-06-04 Taehoon Kim , Jihoon Yang

Text Summarization is the task of condensing long text into just a handful of sentences. Many approaches have been proposed for this task, some of the very first were building statistical models (Extractive Methods) capable of selecting…

Computation and Language · Computer Science 2020-04-02 Amr M. Zaki , Mahmoud I. Khalil , Hazem M. Abbas

Creating abstractive summaries from meeting transcripts has proven to be challenging due to the limited amount of labeled data available for training neural network models. Moreover, Transformer-based architectures have proven to beat…

Computation and Language · Computer Science 2021-08-16 Nima Sadri , Bohan Zhang , Bihan Liu

Despite the success of the neural sequence-to-sequence model for abstractive text summarization, it has a few shortcomings, such as repeating inaccurate factual details and tending to repeat themselves. We propose a hybrid pointer generator…

Computation and Language · Computer Science 2021-12-30 Nobel Dhar , Gaurob Saha , Prithwiraj Bhattacharjee , Avi Mallick , Md Saiful Islam

End-to-end automatic speech recognition (ASR) models, including both attention-based models and the recurrent neural network transducer (RNN-T), have shown superior performance compared to conventional systems. However, previous studies…

Modeling the structure of coherent texts is a key NLP problem. The task of coherently organizing a given set of sentences has been commonly used to build and evaluate models that understand such structure. We propose an end-to-end…

Computation and Language · Computer Science 2017-12-25 Lajanugen Logeswaran , Honglak Lee , Dragomir Radev

A major proportion of a text summary includes important entities found in the original text. These entities build up the topic of the summary. Moreover, they hold commonsense information once they are linked to a knowledge base. Based on…

Computation and Language · Computer Science 2018-06-15 Reinald Kim Amplayo , Seonjae Lim , Seung-won Hwang

This study aimed to leverage graph information, particularly Rhetorical Structure Theory (RST) and Co-reference (Coref) graphs, to enhance the performance of our baseline summarization models. Specifically, we experimented with a Graph…

Computation and Language · Computer Science 2026-04-07 Mohammadreza Ardestani , Yllias Chali

We propose an abstraction-based multi-document summarization framework that can construct new sentences by exploring more fine-grained syntactic units than sentences, namely, noun/verb phrases. Different from existing abstraction-based…

Computation and Language · Computer Science 2015-06-08 Lidong Bing , Piji Li , Yi Liao , Wai Lam , Weiwei Guo , Rebecca J. Passonneau

Existing models based on artificial neural networks (ANNs) for sentence classification often do not incorporate the context in which sentences appear, and classify sentences individually. However, traditional sentence classification…

Computation and Language · Computer Science 2016-12-16 Franck Dernoncourt , Ji Young Lee , Peter Szolovits

The amount of text data available online is increasing at a very fast pace hence text summarization has become essential. Most of the modern recommender and text classification systems require going through a huge amount of data. Manually…

Computation and Language · Computer Science 2021-08-03 Anushka Gupta , Diksha Chugh , Anjum , Rahul Katarya

Query Focused Summarization (QFS) has been addressed mostly using extractive methods. Such methods, however, produce text which suffers from low coherence. We investigate how abstractive methods can be applied to QFS, to overcome such…

Computation and Language · Computer Science 2018-01-26 Tal Baumel , Matan Eyal , Michael Elhadad

Bidirectional Encoder Representations from Transformers (BERT) represents the latest incarnation of pretrained language models which have recently advanced a wide range of natural language processing tasks. In this paper, we showcase how…

Computation and Language · Computer Science 2019-09-06 Yang Liu , Mirella Lapata