中文
相关论文

相关论文: Improving Factual Consistency in Summarization wit…

200 篇论文

The topic of summarization evaluation has recently attracted a surge of attention due to the rapid development of abstractive summarization systems. However, the formulation of the task is rather ambiguous, neither the linguistic nor the…

计算与语言 · 计算机科学 2022-11-01 Yanzhu Guo , Chloé Clavel , Moussa Kamal Eddine , Michalis Vazirgiannis

Factual inconsistencies in generated summaries severely limit the practical applications of abstractive dialogue summarization. Although significant progress has been achieved by using pre-trained models, substantial amounts of hallucinated…

Modern summarization models generate highly fluent but often factually unreliable outputs. This motivated a surge of metrics attempting to measure the factuality of automatically generated summaries. Due to the lack of common benchmarks,…

计算与语言 · 计算机科学 2021-07-27 Artidoro Pagnoni , Vidhisha Balachandran , Yulia Tsvetkov

In recent times, extracting valuable information from large text is making significant progress. Especially in the current era of social media, people expect quick bites of information. Automatic text summarization seeks to tackle this by…

计算与语言 · 计算机科学 2024-10-23 Sindhu Nair , Y. S. Rao , Radha Shankarmani

Dialogue summarization aims to generate a summary that indicates the key points of a given dialogue. In this work, we propose an end-to-end neural model for dialogue summarization with two novel modules, namely, the \emph{supporting…

计算与语言 · 计算机科学 2021-08-04 Wang Chen , Piji Li , Hou Pong Chan , Irwin King

Document summarization condenses a long document into a short version with salient information and accurate semantic descriptions. The main issue is how to make the output summary semantically consistent with the input document. To reach…

计算与语言 · 计算机科学 2022-04-01 Mingyang Song , Liping Jing

Evaluating the factual consistency of abstractive text summarization remains a significant challenge, particularly for long documents, where conventional metrics struggle with input length limitations and long-range dependencies. In this…

计算与语言 · 计算机科学 2026-04-30 Zain Muhammad Mujahid , Dustin Wright , Isabelle Augenstein

Improving the quality of model-generated summaries, especially factuality, the accuracy of a summary with respect to its source content, remains a challenge. While reranking could select the optimal output from multiple generated…

计算与语言 · 计算机科学 2026-05-29 Riza Setiawan Soetedjo , Yusuke Sakai , Hidetaka Kamigaito , Jingun Kwon , Manabu Okumura , Taro Watanabe

The World Wide Web has become a popular source for gathering information and news. Multimodal information, e.g., enriching text with photos, is typically used to convey the news more effectively or to attract attention. Photo content can…

计算与语言 · 计算机科学 2020-10-26 Eric Müller-Budack , Jonas Theiner , Sebastian Diering , Maximilian Idahl , Ralph Ewerth

Automated simplification models aim to make input texts more readable. Such methods have the potential to make complex information accessible to a wider audience, e.g., providing access to recent medical literature which might otherwise be…

计算与语言 · 计算机科学 2022-04-18 Ashwin Devaraj , William Sheffield , Byron C. Wallace , Junyi Jessy Li

Abstractive text summarization aims to shorten long text documents into a human readable form that contains the most important facts from the original document. However, the level of actual abstraction as measured by novel phrases that do…

计算与语言 · 计算机科学 2018-08-27 Wojciech Kryściński , Romain Paulus , Caiming Xiong , Richard Socher

Through the advent of pre-trained language models, there have been notable advancements in abstractive summarization systems. Simultaneously, a considerable number of novel methods for evaluating factual consistency in abstractive…

计算与语言 · 计算机科学 2024-10-03 Joonho Yang , Seunghyun Yoon , Byeongjeong Kim , Hwanhee Lee

A major proportion of a text summary includes important entities found in the original text. These entities build up the topic of the summary. Moreover, they hold commonsense information once they are linked to a knowledge base. Based on…

计算与语言 · 计算机科学 2018-06-15 Reinald Kim Amplayo , Seonjae Lim , Seung-won Hwang

Text summarization is crucial for mitigating information overload across domains like journalism, medicine, and business. This research evaluates summarization performance across 17 large language models (OpenAI, Google, Anthropic,…

计算与语言 · 计算机科学 2025-04-08 Anantharaman Janakiraman , Behnaz Ghoraani

Grounded text generation systems often generate text that contains factual inconsistencies, hindering their real-world applicability. Automatic factual consistency evaluation may help alleviate this limitation by accelerating evaluation…

Despite recent improvements in abstractive summarization, most current approaches generate summaries that are not factually consistent with the source document, severely restricting their trust and usage in real-world applications. Recent…

计算与语言 · 计算机科学 2022-07-20 Leonardo F. R. Ribeiro , Mengwen Liu , Iryna Gurevych , Markus Dreyer , Mohit Bansal

Neural abstractive summarization models are able to generate summaries which have high overlap with human references. However, existing models are not optimized for factual correctness, a critical metric in real-world applications. In this…

计算与语言 · 计算机科学 2020-04-29 Yuhao Zhang , Derek Merck , Emily Bao Tsai , Christopher D. Manning , Curtis P. Langlotz

Abstractive summarization models are typically pre-trained on large amounts of generic texts, then fine-tuned on tens or hundreds of thousands of annotated samples. However, in opinion summarization, large annotated datasets of reviews…

计算与语言 · 计算机科学 2022-05-12 Arthur Bražinskas , Ramesh Nallapati , Mohit Bansal , Markus Dreyer

Abstractive text summarization is integral to the Big Data era, which demands advanced methods to turn voluminous and often long text data into concise but coherent and informative summaries for efficient human consumption. Despite…

计算与语言 · 计算机科学 2025-10-08 Jianbin Shen , Christy Jie Liang , Junyu Xuan

Current pre-trained models applied to summarization are prone to factual inconsistencies which either misrepresent the source text or introduce extraneous information. Thus, comparing the factual consistency of summaries is necessary as we…