English
Related papers

Related papers: An Automated Length-Aware Quality Metric for Summa…

200 papers

A commonly observed problem with the state-of-the art abstractive summarization models is that the generated summaries can be factually inconsistent with the input documents. The fact that automatic summarization may produce…

A desirable property of a reference-based evaluation metric that measures the content quality of a summary is that it should estimate how much information that summary has in common with a reference. Traditional text overlap based metrics…

Computation and Language · Computer Science 2021-07-28 Daniel Deutsch , Tania Bedrax-Weiss , Dan Roth

Single document summarization is the task of producing a shorter version of a document while preserving its principal information content. In this paper we conceptualize extractive summarization as a sentence ranking task and propose a…

Computation and Language · Computer Science 2018-04-17 Shashi Narayan , Shay B. Cohen , Mirella Lapata

Many computer scientists use the aggregated answers of online workers to represent ground truth. Prior work has shown that aggregation methods such as majority voting are effective for measuring relatively objective features. For subjective…

Computation and Language · Computer Science 2021-04-06 Jiele Wu , Chau-Wai Wong , Xinyan Zhao , Xianpeng Liu

Manual evaluation is essential to judge progress on automatic text summarization. However, we conduct a survey on recent summarization system papers that reveals little agreement on how to perform such evaluation studies. We conduct two…

Computation and Language · Computer Science 2021-01-28 Julius Steen , Katja Markert

Text summarization aims at compressing long documents into a shorter form that conveys the most important parts of the original document. Despite increased interest in the community and notable research effort, progress on benchmark…

Computation and Language · Computer Science 2019-08-27 Wojciech Kryściński , Nitish Shirish Keskar , Bryan McCann , Caiming Xiong , Richard Socher

Generating an abstract from a collection of documents is a desirable capability for many real-world applications. However, abstractive approaches to multi-document summarization have not been thoroughly investigated. This paper studies the…

Computation and Language · Computer Science 2018-06-15 Kexin Liao , Logan Lebanoff , Fei Liu

Current abstractive summarization systems present important weaknesses which prevent their deployment in real-world applications, such as the omission of relevant information and the generation of factual inconsistencies (also known as…

Computation and Language · Computer Science 2022-11-08 Diogo Pernes , Afonso Mendes , André F. T. Martins

Recent advances in summarization research focus on improving summary quality across multiple criteria, such as completeness, conciseness, and faithfulness, by jointly optimizing these dimensions. However, these efforts largely overlook the…

Computation and Language · Computer Science 2026-04-21 Hongye Liu , Liang Ding , Ricardo Henao

Opinion summarization is the task of automatically generating summaries for a set of reviews about a specific target (e.g., a movie or a product). Since the number of reviews for each target can be prohibitively large, neural network-based…

Computation and Language · Computer Science 2021-01-25 Reinald Kim Amplayo , Mirella Lapata

Summarizing texts is not a straightforward task. Before even considering text summarization, one should determine what kind of summary is expected. How much should the information be compressed? Is it relevant to reformulate or should the…

Computation and Language · Computer Science 2020-07-16 Paul Tardy , David Janiszek , Yannick Estève , Vincent Nguyen

In a world of proliferating data, the ability to rapidly summarize text is growing in importance. Automatic summarization of text can be thought of as a sequence to sequence problem. Another area of natural language processing that solves a…

Computation and Language · Computer Science 2018-10-23 Jacob Krantz , Jugal Kalita

Modern speech processing systems rely on self-attention. Unfortunately, token mixing with self-attention takes quadratic time in the length of the speech utterance, slowing down inference and training and increasing memory consumption.…

Computation and Language · Computer Science 2024-07-12 Titouan Parcollet , Rogier van Dalen , Shucong Zhang , Sourav Bhattacharya

The task of automatic text summarization produces a concise and fluent text summary while preserving key information and overall meaning. Recent approaches to document-level summarization have seen significant improvements in recent years…

Computation and Language · Computer Science 2022-12-07 Gonçalo Raposo , Afonso Raposo , Ana Sofia Carmo

Topic-controllable summarization is an emerging research area with a wide range of potential applications. However, existing approaches suffer from significant limitations. For example, the majority of existing methods built upon recurrent…

Computation and Language · Computer Science 2024-04-18 Tatiana Passali , Grigorios Tsoumakas

The evaluation of abstractive summarization models typically uses test data that is identically distributed as training data. In real-world practice, documents to be summarized may contain input noise caused by text extraction artifacts or…

Computation and Language · Computer Science 2023-12-05 Kundan Krishna , Yao Zhao , Jie Ren , Balaji Lakshminarayanan , Jiaming Luo , Mohammad Saleh , Peter J. Liu

Text summarization models are often trained to produce summaries that meet human quality requirements. However, the existing evaluation metrics for summary text are only rough proxies for summary quality, suffering from low correlation with…

Computation and Language · Computer Science 2022-07-12 Wuhang Lin , Shasha Li , Chen Zhang , Bin Ji , Jie Yu , Jun Ma , Zibo Yi

Many applications of text generation such as summarization benefit from accurately controlling the text length. Existing approaches on length-controlled summarization either result in degraded performance or can only control the length…

Computation and Language · Computer Science 2023-05-10 Lesly Miculicich , Yujia Xie , Song Wang , Pengcheng He

Our task is to generate an effective summary for a given document with specific realtime requirements. We use the softplus function to enhance keyword rankings to favor important sentences, based on which we present a number of…

Information Retrieval · Computer Science 2017-10-03 Liqun Shao , Hao Zhang , Ming Jia , Jie Wang

An abstract must not change the meaning of the original text. A single most effective way to achieve that is to increase the amount of copying while still allowing for text abstraction. Human editors can usually exercise control over…

Computation and Language · Computer Science 2019-11-26 Kaiqiang Song , Bingqing Wang , Zhe Feng , Liu Ren , Fei Liu