中文
相关论文

相关论文: Question Answering as an Automatic Evaluation Metr…

200 篇论文

In text summarization, evaluating the efficacy of automatic metrics without human judgments has become recently popular. One exemplar work concludes that automatic metrics strongly disagree when ranking high-scoring summaries. In this…

计算与语言 · 计算机科学 2020-11-10 Manik Bhandari , Pranav Gour , Atabak Ashfaq , Pengfei Liu

Text summarizing is a critical Natural Language Processing (NLP) task with applications ranging from information retrieval to content generation. Large Language Models (LLMs) have shown remarkable promise in generating fluent abstractive…

计算与语言 · 计算机科学 2025-03-03 Colleen Gilhuly , Haleh Shahzad

Evaluation of text summarization approaches have been mostly based on metrics that measure similarities of system generated summaries with a set of human written gold-standard summaries. The most widely used metric in summarization…

计算与语言 · 计算机科学 2016-04-05 Arman Cohan , Nazli Goharian

Text summarization condenses a text to a shorter version while retaining the important informations. Abstractive summarization is a recent development that generates new phrases, rather than simply copying or rephrasing sentences within the…

计算与语言 · 计算机科学 2018-02-06 André Cibils , Claudiu Musat , Andreea Hossman , Michael Baeriswyl

Neural abstractive summarization models are prone to generate content inconsistent with the source document, i.e. unfaithful. Existing automatic metrics do not capture such mistakes effectively. We tackle the problem of evaluating…

计算与语言 · 计算机科学 2020-10-13 Esin Durmus , He He , Mona Diab

Automatic text summarization, the automated process of shortening a text while reserving the main ideas of the document(s), is a critical research area in natural language processing. The aim of this literature review is to survey the…

计算与语言 · 计算机科学 2018-04-13 Yue Dong

The development of methods to deal with the informative contents of the text units in the matching process is a major challenge in automatic summary evaluation systems that use fixed n-gram matching. The limitation causes inaccurate…

计算与语言 · 计算机科学 2015-05-26 Fatma Elghannam , Tarek El-Shishtawy

Entity summarization aims at creating brief but informative descriptions of entities from knowledge graphs. While previous work mostly focused on traditional techniques such as clustering algorithms and graph models, we ask how to apply…

计算与语言 · 计算机科学 2020-05-27 Dongjun Wei , Yaxin Liu , Fuqing Zhu , Liangjun Zang , Wei Zhou , Jizhong Han , Songlin Hu

Neural network-based methods for abstractive summarization produce outputs that are more fluent than other techniques, but which can be poor at content selection. This work proposes a simple technique for addressing this issue: use a…

计算与语言 · 计算机科学 2018-10-10 Sebastian Gehrmann , Yuntian Deng , Alexander M. Rush

Highlighting while reading is a natural behavior for people to track salient content of a document. It would be desirable to teach an extractive summarizer to do the same. However, a major obstacle to the development of a supervised…

计算与语言 · 计算机科学 2019-04-05 Kristjan Arumae , Fei Liu

Evaluating text summarization has been a challenging task in natural language processing (NLP). Automatic metrics which heavily rely on reference summaries are not suitable in many situations, while human evaluation is time-consuming and…

计算与语言 · 计算机科学 2024-07-02 Huyen Nguyen , Haihua Chen , Lavanya Pobbathi , Junhua Ding

There has been substantial progress in summarization research enabled by the availability of novel, often large-scale, datasets and recent advances on neural network-based approaches. However, manual evaluation of the system generated…

计算与语言 · 计算机科学 2019-06-05 Hardy , Shashi Narayan , Andreas Vlachos

By harnessing pre-trained language models, summarization models had rapid progress recently. However, the models are mainly assessed by automatic evaluation metrics such as ROUGE. Although ROUGE is known for having a positive correlation…

计算与语言 · 计算机科学 2021-06-03 Wonjin Yoon , Yoon Sun Yeo , Minbyul Jeong , Bong-Jun Yi , Jaewoo Kang

Opinion summarization sets itself apart from other types of summarization tasks due to its distinctive focus on aspects and sentiments. Although certain automated evaluation methods like ROUGE have gained popularity, we have found them to…

计算与语言 · 计算机科学 2023-11-14 Yuchen Shen , Xiaojun Wan

Automatic summarisation is a popular approach to reduce a document to its main arguments. Recent research in the area has focused on neural approaches to summarisation, which can be very data-hungry. However, few large datasets exist and…

计算与语言 · 计算机科学 2017-06-14 Ed Collins , Isabelle Augenstein , Sebastian Riedel

Automatic summarization is the process of shortening a set of textual data computationally, to create a subset (a summary) that represents the most important pieces of information in the original text. Existing summarization methods can be…

计算与语言 · 计算机科学 2022-04-21 Meng Cao

We study the problem of generating abstractive summaries for opinionated text. We propose an attention-based neural network model that is able to absorb information from multiple text units to construct informative, concise, and fluent…

计算与语言 · 计算机科学 2016-06-10 Lu Wang , Wang Ling

Language Models (LMs) have revolutionized natural language processing, enabling high-quality text generation through prompting and in-context learning. However, models often struggle with long-context summarization due to positional biases,…

计算与语言 · 计算机科学 2025-09-23 Neelabh Sinha

Abstractive text summarization is the task of compressing and rewriting a long document into a short summary while maintaining saliency, directed logical entailment, and non-redundancy. In this work, we address these three important aspects…

计算与语言 · 计算机科学 2018-05-30 Ramakanth Pasunuru , Mohit Bansal

Current neural network-based methods to the problem of document summarisation struggle when applied to datasets containing large inputs. In this paper we propose a new approach to the challenge of content-selection when dealing with…

计算与语言 · 计算机科学 2025-05-07 Maciej Zembrzuski , Saad Mahamood