English
Related papers

Related papers: LongDocFACTScore: Evaluating the Factuality of Lon…

200 papers

This paper presents the Long Context and Form Output (LCFO) benchmark, a novel evaluation framework for assessing gradual summarization and summary expansion capabilities across diverse domains. LCFO consists of long input documents (5k…

Automatic document summarization aims to produce a concise summary covering the input document's salient information. Within a report document, the salient information can be scattered in the textual and non-textual content. However,…

Computation and Language · Computer Science 2023-02-09 Shuaiqi Liu , Jiannong Cao , Ruosong Yang , Zhiyuan Wen

FActScore has gained popularity as a metric to estimate the factuality of long-form texts generated by Large Language Models (LLMs) in English. However, there has not been any work in studying the behavior of FActScore in other languages.…

Computation and Language · Computer Science 2024-07-01 Kim Trong Vu , Michael Krumdick , Varshini Reddy , Franck Dernoncourt , Viet Dac Lai

Long-form factuality evaluation assesses the ability of models to generate accurate, comprehensive responses to short prompts. Existing benchmarks often lack human verification, leading to potential quality issues. To address this…

Computation and Language · Computer Science 2025-08-04 Mingda Chen , Yang Li , Xilun Chen , Adina Williams , Gargi Ghosh , Scott Yih

Automatic abstractive summaries are found to often distort or fabricate facts in the article. This inconsistency between summary and original text has seriously impacted its applicability. We propose a fact-aware summarization model FASum…

Computation and Language · Computer Science 2021-03-16 Chenguang Zhu , William Hinthorn , Ruochen Xu , Qingkai Zeng , Michael Zeng , Xuedong Huang , Meng Jiang

The performance of text summarization has been greatly boosted by pre-trained language models. A main concern of existing methods is that most generated summaries are not factually inconsistent with their source documents. To alleviate the…

Computation and Language · Computer Science 2023-04-14 Zheheng Luo , Qianqian Xie , Sophia Ananiadou

Summarization evaluation remains an open research problem: current metrics such as ROUGE are known to be limited and to correlate poorly with human judgments. To alleviate this issue, recent work has proposed evaluation metrics which rely…

Computation and Language · Computer Science 2021-04-12 Thomas Scialom , Paul-Alexis Dray , Patrick Gallinari , Sylvain Lamprier , Benjamin Piwowarski , Jacopo Staiano , Alex Wang

Evaluating the factuality of long-form large language model (LLM)-generated text is an important challenge. Recently there has been a surge of interest in factuality evaluation for English, but little is known about the factuality…

Computation and Language · Computer Science 2024-10-04 Sheikh Shafayat , Eunsu Kim , Juhyun Oh , Alice Oh

Evaluating text summarization has been a challenging task in natural language processing (NLP). Automatic metrics which heavily rely on reference summaries are not suitable in many situations, while human evaluation is time-consuming and…

Computation and Language · Computer Science 2024-07-02 Huyen Nguyen , Haihua Chen , Lavanya Pobbathi , Junhua Ding

This paper proposes a medical text summarization method based on LongFormer, aimed at addressing the challenges faced by existing models when processing long medical texts. Traditional summarization methods are often limited by short-term…

Computation and Language · Computer Science 2025-03-11 Dan Sun , Jacky He , Hanlu Zhang , Zhen Qi , Hongye Zheng , Xiaokai Wang

Automated simplification models aim to make input texts more readable. Such methods have the potential to make complex information accessible to a wider audience, e.g., providing access to recent medical literature which might otherwise be…

Computation and Language · Computer Science 2022-04-18 Ashwin Devaraj , William Sheffield , Byron C. Wallace , Junyi Jessy Li

A key challenge for abstractive summarization is ensuring factual consistency of the generated summary with respect to the original document. For example, state-of-the-art models trained on existing datasets exhibit entity hallucination,…

Computation and Language · Computer Science 2021-02-19 Feng Nan , Ramesh Nallapati , Zhiguo Wang , Cicero Nogueira dos Santos , Henghui Zhu , Dejiao Zhang , Kathleen McKeown , Bing Xiang

The increased use of large language models (LLMs) across a variety of real-world applications calls for mechanisms to verify the factual accuracy of their outputs. Difficulties lie in assessing the factuality of free-form responses in open…

Computation and Language · Computer Science 2025-10-30 Yuxia Wang , Minghan Wang , Hasan Iqbal , Georgi Georgiev , Jiahui Geng , Preslav Nakov

Neural models for abstractive summarization tend to generate output that is fluent and well-formed but lacks semantic faithfulness, or factuality, with respect to the input documents. In this paper, we analyze the tradeoff between…

Computation and Language · Computer Science 2023-04-26 Markus Dreyer , Mengwen Liu , Feng Nan , Sandeep Atluri , Sujith Ravi

Current pre-trained models applied to summarization are prone to factual inconsistencies which either misrepresent the source text or introduce extraneous information. Thus, comparing the factual consistency of summaries is necessary as we…

Computation and Language · Computer Science 2022-07-12 Xiangru Tang , Alexander Fabbri , Haoran Li , Ziming Mao , Griffin Thomas Adams , Borui Wang , Asli Celikyilmaz , Yashar Mehdad , Dragomir Radev

While neural language models can generate text with remarkable fluency and coherence, controlling for factual correctness in generation remains an open research question. This major discrepancy between the surface-level fluency and the…

Computation and Language · Computer Science 2021-06-08 Saadia Gabriel , Asli Celikyilmaz , Rahul Jha , Yejin Choi , Jianfeng Gao

Improving factual consistency in abstractive summarization has been a focus of current research. One promising approach is the post-editing method. However, previous works have yet to make sufficient use of factual factors in summaries and…

Computation and Language · Computer Science 2024-02-14 Yiyang Li , Lei Li , Dingxin Hu , Xueyi Hao , Marina Litvak , Natalia Vanetik , Yanquan Zhou

Despite the recent progress in language generation models, their outputs may not always meet user expectations. In this work, we study whether informational feedback in natural language can be leveraged to improve generation quality and…

Computation and Language · Computer Science 2023-10-17 Yixin Liu , Budhaditya Deb , Milagro Teruel , Aaron Halfaker , Dragomir Radev , Ahmed H. Awadallah

Practical applications of abstractive summarization models are limited by frequent factual inconsistencies with respect to their input. Existing automatic evaluation metrics for summarization are largely insensitive to such errors. We…

Computation and Language · Computer Science 2020-04-10 Alex Wang , Kyunghyun Cho , Mike Lewis

Abstractive text summarization aims to shorten long text documents into a human readable form that contains the most important facts from the original document. However, the level of actual abstraction as measured by novel phrases that do…

Computation and Language · Computer Science 2018-08-27 Wojciech Kryściński , Romain Paulus , Caiming Xiong , Richard Socher