English
Related papers

Related papers: Question Answering as an Automatic Evaluation Metr…

200 papers

Summarizing lengthy documents is a common and essential task in our daily lives. Although recent advancements in neural summarization models can assist in crafting general-purpose summaries, human writers often have specific requirements…

Computation and Language · Computer Science 2023-06-06 Yujia Xie , Xun Wang , Si-Qing Chen , Wayne Xiong , Pengcheng He

Abstractive summarization has been studied using neural sequence transduction methods with datasets of large, paired document-summary examples. However, such datasets are rare and the models trained from them do not generalize to other…

Computation and Language · Computer Science 2019-05-24 Eric Chu , Peter J. Liu

Deep learning has led to significant improvement in text summarization with various methods investigated and improved ROUGE scores reported over the years. However, gaps still exist between summaries produced by automatic summarizers and…

Computation and Language · Computer Science 2020-10-12 Dandan Huang , Leyang Cui , Sen Yang , Guangsheng Bao , Kun Wang , Jun Xie , Yue Zhang

Reinforcement learning with evaluation metrics as rewards is widely used to enhance specific capabilities of language models. However, for tasks such as factually consistent summarisation, existing metrics remain underdeveloped, limiting…

Computation and Language · Computer Science 2026-05-27 Yuxuan Ye , Raul Santos-Rodriguez , Edwin Simpson

In this paper, we propose two automated text processing frameworks specifically designed to analyze online reviews. The objective of the first framework is to summarize the reviews dataset by extracting essential sentence. This is performed…

Computation and Language · Computer Science 2020-04-22 Xiangpeng Wan , Hakim Ghazzai , Yehia Massoud

Like humans, document summarization models can interpret a document's contents in a number of ways. Unfortunately, the neural models of today are largely black boxes that provide little explanation of how or why they generated a summary in…

Computation and Language · Computer Science 2020-12-15 Wang Haonan , Gao Yang , Bai Yu , Mirella Lapata , Huang Heyan

Aspect-based summarization aims to generate summaries tailored to specific aspects, addressing the resource constraints and limited generalizability of traditional summarization approaches. Recently, large language models have shown promise…

Computation and Language · Computer Science 2025-04-18 Yichao Feng , Shuai Zhao , Yueqiu Li , Luwei Xiao , Xiaobao Wu , Anh Tuan Luu

Automatic text summarization (ATS) has recently achieved impressive performance thanks to recent advances in deep learning and the availability of large-scale corpora. To make the summarization results more faithful, this paper presents an…

Computation and Language · Computer Science 2019-10-15 Shengluan Hou , Ruqian Lu

Opinion summarization is the task of automatically creating summaries that reflect subjective information expressed in multiple documents, such as product reviews. While the majority of previous work has focused on the extractive setting,…

Computation and Language · Computer Science 2020-04-21 Arthur Bražinskas , Mirella Lapata , Ivan Titov

Commonly adopted metrics for extractive summarization focus on lexical overlap at the token level. In this paper, we present a facet-aware evaluation setup for better assessment of the information coverage in extracted summaries.…

Computation and Language · Computer Science 2020-05-01 Yuning Mao , Liyuan Liu , Qi Zhu , Xiang Ren , Jiawei Han

Automatically evaluating the coherence of summaries is of great significance both to enable cost-efficient summarizer evaluation and as a tool for improving coherence by selecting high-scoring candidate summaries. While many different…

Computation and Language · Computer Science 2022-09-16 Julius Steen , Katja Markert

Text summarization has a wide range of applications in many scenarios. The evaluation of the quality of the generated text is a complex problem. A big challenge to language evaluation is that there is a clear divergence between existing…

Computation and Language · Computer Science 2023-09-20 Ning Wu , Ming Gong , Linjun Shou , Shining Liang , Daxin Jiang

The internet increased the amount of information available. However, the reading and understanding of this information are costly tasks. In this scenario, the Natural Language Processing (NLP) applications enable very important solutions,…

Computation and Language · Computer Science 2016-02-08 Elvys Linhares Pontes

In neural abstractive summarization field, conventional sequence-to-sequence based models often suffer from summarizing the wrong aspect of the document with respect to the main aspect. To tackle this problem, we propose the task of…

Computation and Language · Computer Science 2018-12-14 Shen Gao , Xiuying Chen , Piji Li , Zhaochun Ren , Lidong Bing , Dongyan Zhao , Rui Yan

An abstract must not change the meaning of the original text. A single most effective way to achieve that is to increase the amount of copying while still allowing for text abstraction. Human editors can usually exercise control over…

Computation and Language · Computer Science 2019-11-26 Kaiqiang Song , Bingqing Wang , Zhe Feng , Liu Ren , Fei Liu

Automatic Text Summarization strategies have been successfully employed to digest text collections and extract its essential content. Usually, summaries are generated using textual corpora that belongs to the same domain area where the…

Computation and Language · Computer Science 2018-07-03 Vinicius Woloszyn , Guilherme Medeiros Machado , Leandro Krug Wives , José Palazzo Moreira de Oliveira

Recently, compressive text summarisation offers a balance between the conciseness issue of extractive summarisation and the factual hallucination issue of abstractive summarisation. However, most existing compressive summarisation methods…

Computation and Language · Computer Science 2023-06-07 Peggy Tang , Junbin Gao , Lei Zhang , Zhiyong Wang

Paraphrasing is the task of expressing an essential idea or meaning in different words. But how different should the words be in order to be considered an acceptable paraphrase? And can we exclusively use automated metrics to evaluate the…

Computation and Language · Computer Science 2023-07-28 Anna Moskvina , Bhushan Kotnis , Chris Catacata , Michael Janz , Nasrin Saef

The task of automatic text summarization produces a concise and fluent text summary while preserving key information and overall meaning. Recent approaches to document-level summarization have seen significant improvements in recent years…

Computation and Language · Computer Science 2022-12-07 Gonçalo Raposo , Afonso Raposo , Ana Sofia Carmo

Headline generation is a special type of text summarization task. While the amount of available training data for this task is almost unlimited, it still remains challenging, as learning to generate headlines for news articles implies that…

Computation and Language · Computer Science 2019-01-24 Daniil Gavrilov , Pavel Kalaidin , Valentin Malykh