English
Related papers

Related papers: Abstractive Text Summarization Using Sequence-to-S…

200 papers

Recent neural sequence to sequence models have provided feasible solutions for abstractive summarization. However, such models are still hard to tackle long text dependency in the summarization task. A high-quality summarization system…

Computation and Language · Computer Science 2019-12-25 Pengcheng Liao , Chuang Zhang , Xiaojun Chen , Xiaofei Zhou

Steady progress has been made in abstractive summarization with attention-based sequence-to-sequence learning models. In this paper, we propose a new decoder where the output summary is generated by conditioning on both the input text and…

Machine Learning · Computer Science 2019-08-21 Melissa Ailem , Bowen Zhang , Fei Sha

A quality abstractive summary should not only copy salient source texts as summaries but should also tend to generate new conceptual words to express concrete details. Inspired by the popular pointer generator sequence-to-sequence model,…

Computation and Language · Computer Science 2019-10-21 Wang Wenbo , Gao Yang , Huang Heyan , Zhou Yuxiang

Abstractive Text Summarization is the process of constructing semantically relevant shorter sentences which captures the essence of the overall meaning of the source text. It is actually difficult and very time consuming for humans to…

Computation and Language · Computer Science 2021-01-19 Mohan Bharath B , Aravindh Gowtham B , Akhil M

Specifically focusing on the landscape of abstractive text summarization, as opposed to extractive techniques, this survey presents a comprehensive overview, delving into state-of-the-art techniques, prevailing challenges, and prospective…

Computation and Language · Computer Science 2024-09-05 Hassan Shakil , Ahmad Farooq , Jugal Kalita

Summarization based on text extraction is inherently limited, but generation-style abstractive methods have proven challenging to build. In this work, we propose a fully data-driven approach to abstractive sentence summarization. Our method…

Computation and Language · Computer Science 2015-09-04 Alexander M. Rush , Sumit Chopra , Jason Weston

Abstractive text summarization aims at compressing the information of a long source document into a rephrased, condensed summary. Despite advances in modeling techniques, abstractive summarization models still suffer from several key…

Computation and Language · Computer Science 2021-02-17 Vidhisha Balachandran , Artidoro Pagnoni , Jay Yoon Lee , Dheeraj Rajagopal , Jaime Carbonell , Yulia Tsvetkov

In this paper, we present a denoising sequence-to-sequence (seq2seq) autoencoder via contrastive learning for abstractive text summarization. Our model adopts a standard Transformer-based architecture with a multi-layer bi-directional…

Computation and Language · Computer Science 2021-08-30 Chujie Zheng , Kunpeng Zhang , Harry Jiannan Wang , Ling Fan , Zhe Wang

In this work, we study abstractive text summarization by exploring different models such as LSTM-encoder-decoder with attention, pointer-generator networks, coverage mechanisms, and transformers. Upon extensive and careful hyperparameter…

Computation and Language · Computer Science 2019-12-13 Soheil Esmaeilzadeh , Gao Xian Peh , Angela Xu

Recent Transformer-based summarization models have provided a promising approach to abstractive summarization. They go beyond sentence selection and extractive strategies to deal with more complicated tasks such as novel word generation and…

Computation and Language · Computer Science 2023-02-09 Sajad Sotudeh , Hanieh Deilamsalehy , Franck Dernoncourt , Nazli Goharian

This paper tackles the reduction of redundant repeating generation that is often observed in RNN-based encoder-decoder models. Our basic idea is to jointly estimate the upper-bound frequency of each target vocabulary in the encoder and…

Computation and Language · Computer Science 2017-02-15 Jun Suzuki , Masaaki Nagata

In this paper, we present a model for generating summaries of text documents with respect to a query. This is known as query-based summarization. We adapt an existing dataset of news article summaries for the task and train a…

Computation and Language · Computer Science 2017-12-19 Johan Hasselqvist , Niklas Helmertz , Mikael Kågebäck

Neural network-based methods for abstractive summarization produce outputs that are more fluent than other techniques, but which can be poor at content selection. This work proposes a simple technique for addressing this issue: use a…

Computation and Language · Computer Science 2018-10-10 Sebastian Gehrmann , Yuntian Deng , Alexander M. Rush

Pre-trained sequence-to-sequence (seq-to-seq) models have significantly improved the accuracy of several language generation tasks, including abstractive summarization. Although the fluency of abstractive summarization has been greatly…

Computation and Language · Computer Science 2020-03-31 Itsumi Saito , Kyosuke Nishida , Kosuke Nishida , Junji Tomita

We describe an attentive encoder that combines tree-structured recursive neural networks and sequential recurrent neural networks for modelling sentence pairs. Since existing attentive models exert attention on the sequential structure, we…

Computation and Language · Computer Science 2016-10-11 Yao Zhou , Cong Liu , Yan Pan

Sequence-to-sequence (seq2seq) neural models have been actively investigated for abstractive summarization. Nevertheless, existing neural abstractive systems frequently generate factually incorrect summaries and are vulnerable to…

Computation and Language · Computer Science 2018-10-16 Lisa Fan , Dong Yu , Lu Wang

Attention-based neural abstractive summarization systems equipped with copy mechanisms have shown promising results. Despite this success, it has been noticed that such a system generates a summary by mostly, if not entirely, copying over…

Computation and Language · Computer Science 2018-03-21 Noah Weber , Leena Shekhar , Niranjan Balasubramanian , Kyunghyun Cho

We present two novel and contrasting Recurrent Neural Network (RNN) based architectures for extractive summarization of documents. The Classifier based architecture sequentially accepts or rejects each sentence in the original document…

Computation and Language · Computer Science 2017-01-05 Ramesh Nallapati , Bowen Zhou , Mingbo Ma

We study the problem of generating abstractive summaries for opinionated text. We propose an attention-based neural network model that is able to absorb information from multiple text units to construct informative, concise, and fluent…

Computation and Language · Computer Science 2016-06-10 Lu Wang , Wang Ling

Text summarization aims to compress a textual document to a short summary while keeping salient information. Extractive approaches are widely used in text summarization because of their fluency and efficiency. However, most of existing…

Computation and Language · Computer Science 2020-10-14 Peng Cui , Le Hu , Yuanchao Liu