English
Related papers

Related papers: Enhancing Coherence of Extractive Summarization wi…

200 papers

In this paper, we propose a deep learning approach to tackle the automatic summarization tasks by incorporating topic information into the convolutional sequence-to-sequence (ConvS2S) model and using self-critical sequence training (SCST)…

Computation and Language · Computer Science 2020-07-28 Li Wang , Junlin Yao , Yunzhe Tao , Li Zhong , Wei Liu , Qiang Du

We investigate a new training paradigm for extractive summarization. Traditionally, human abstracts are used to derive goldstandard labels for extraction units. However, the labels are often inaccurate, because human abstracts and source…

Computation and Language · Computer Science 2018-06-22 Kristjan Arumae , Fei Liu

This paper proposes an approach to cross-language sentence selection in a low-resource setting. It uses data augmentation and negative sampling techniques on noisy parallel sentence data to directly learn a cross-lingual embedding-based…

Computation and Language · Computer Science 2021-06-07 Yanda Chen , Chris Kedzie , Suraj Nair , Petra Galuščáková , Rui Zhang , Douglas W. Oard , Kathleen McKeown

This paper explores the effect of using multitask learning for abstractive summarization in the context of small training corpora. In particular, we incorporate four different tasks (extractive summarization, language modeling, concept…

Computation and Language · Computer Science 2021-09-20 Ahmed Magooda , Mohamed Elaraby , Diane Litman

Extractive summaries are usually presented as lists of sentences with no expected cohesion between them and with plenty of redundant information if not accounted for. In this paper, we investigate the trade-offs incurred when aiming to…

Computation and Language · Computer Science 2024-06-07 Ronald Cardenas , Matthias Galle , Shay B. Cohen

Sentences produced by abstractive summarization systems can be ungrammatical and fail to preserve the original meanings, despite being locally fluent. In this paper we propose to remedy this problem by jointly generating a sentence and its…

Computation and Language · Computer Science 2019-11-26 Kaiqiang Song , Logan Lebanoff , Qipeng Guo , Xipeng Qiu , Xiangyang Xue , Chen Li , Dong Yu , Fei Liu

Abstractive text summarization is the task of compressing and rewriting a long document into a short summary while maintaining saliency, directed logical entailment, and non-redundancy. In this work, we address these three important aspects…

Computation and Language · Computer Science 2018-05-30 Ramakanth Pasunuru , Mohit Bansal

Cross-lingual text summarization aims at generating a document summary in one language given input in another language. It is a practically important but under-explored task, primarily due to the dearth of available data. Existing methods…

Computation and Language · Computer Science 2020-06-30 Zi-Yi Dou , Sachin Kumar , Yulia Tsvetkov

Pre-trained sequence-to-sequence (seq-to-seq) models have significantly improved the accuracy of several language generation tasks, including abstractive summarization. Although the fluency of abstractive summarization has been greatly…

Computation and Language · Computer Science 2020-03-31 Itsumi Saito , Kyosuke Nishida , Kosuke Nishida , Junji Tomita

Abstractive text summarization is a highly difficult problem, and the sequence-to-sequence model has shown success in improving the performance on the task. However, the generated summaries are often inconsistent with the source content in…

Computation and Language · Computer Science 2018-05-11 Bingzhen Wei , Xuancheng Ren , Xu Sun , Yi Zhang , Xiaoyan Cai , Qi Su

The recent advance in neural network architecture and training algorithms have shown the effectiveness of representation learning. The neural network-based models generate better representation than the traditional ones. They have the…

Computation and Language · Computer Science 2018-05-29 Kamal Al-Sabahi , Zhang Zuping , Mohammed Nadher

Sentence fusion is the task of joining related sentences into coherent text. Current training and evaluation schemes for this task are based on single reference ground-truths and do not account for valid fusion variants. We show that this…

Computation and Language · Computer Science 2020-10-07 Eyal Ben-David , Orgad Keller , Eric Malmi , Idan Szpektor , Roi Reichart

Extractive summarization aims at selecting a set of indicative sentences from a source document as a summary that can express the major theme of the document. A general consensus on extractive summarization is that both relevance and…

Computation and Language · Computer Science 2016-01-21 Kuan-Yu Chen , Shih-Hung Liu , Berlin Chen , Hsin-Min Wang

In recent times, extracting valuable information from large text is making significant progress. Especially in the current era of social media, people expect quick bites of information. Automatic text summarization seeks to tackle this by…

Computation and Language · Computer Science 2024-10-23 Sindhu Nair , Y. S. Rao , Radha Shankarmani

Summarization is a way to represent same information in concise way with equal sense. This can be categorized in two type Abstractive and Extractive type. Our work is focused around Extractive summarization. A generic approach to extractive…

Information Retrieval · Computer Science 2017-05-19 Chandra Shekhar Yadav , Aditi Sharan

In this paper, we investigate the use of discourse-aware rewards with reinforcement learning to guide a model to generate long, coherent text. In particular, we propose to learn neural rewards to model cross-sentence ordering as a means to…

Computation and Language · Computer Science 2018-05-11 Antoine Bosselut , Asli Celikyilmaz , Xiaodong He , Jianfeng Gao , Po-Sen Huang , Yejin Choi

This paper proposes a new model for extracting an interpretable sentence embedding by introducing self-attention. Instead of using a vector, we use a 2-D matrix to represent the embedding, with each row of the matrix attending on a…

Computation and Language · Computer Science 2017-03-10 Zhouhan Lin , Minwei Feng , Cicero Nogueira dos Santos , Mo Yu , Bing Xiang , Bowen Zhou , Yoshua Bengio

Sequence discriminative training is a great tool to improve the performance of an automatic speech recognition system. It does, however, necessitate a sum over all possible word sequences, which is intractable to compute in practice.…

Computation and Language · Computer Science 2022-04-22 Nils-Philipp Wynands , Wilfried Michel , Jan Rosendahl , Ralf Schlüter , Hermann Ney

Neural models trained with large amount of parallel data have achieved impressive performance in abstractive summarization tasks. However, large-scale parallel corpora are expensive and challenging to construct. In this work, we introduce a…

Computation and Language · Computer Science 2022-01-17 Mengsay Loem , Sho Takase , Masahiro Kaneko , Naoaki Okazaki

A commonly observed problem with the state-of-the art abstractive summarization models is that the generated summaries can be factually inconsistent with the input documents. The fact that automatic summarization may produce…