English
Related papers

Related papers: Evaluating the Factual Consistency of Abstractive …

200 papers

Despite the recent advances in abstractive summarization systems, it is still difficult to determine whether a generated summary is factual consistent with the source text. To this end, the latest approach is to train a factual consistency…

Computation and Language · Computer Science 2022-05-05 Hwanhee Lee , Kang Min Yoo , Joonsuk Park , Hwaran Lee , Kyomin Jung

A commonly observed problem with the state-of-the art abstractive summarization models is that the generated summaries can be factually inconsistent with the input documents. The fact that automatic summarization may produce…

Pre-trained neural abstractive summarization systems have dominated extractive strategies on news summarization performance, at least in terms of ROUGE. However, system-generated abstractive summaries often face the pitfall of factual…

Computation and Language · Computer Science 2020-10-07 Yue Dong , Shuohang Wang , Zhe Gan , Yu Cheng , Jackie Chi Kit Cheung , Jingjing Liu

Despite significant progress has been achieved in text summarization, factual inconsistency in generated summaries still severely limits its practical applications. Among the key factors to ensure factual consistency, a reliable automatic…

Computation and Language · Computer Science 2021-09-09 Yuexiang Xie , Fei Sun , Yang Deng , Yaliang Li , Bolin Ding

Recently, various neural encoder-decoder models pioneered by Seq2Seq framework have been proposed to achieve the goal of generating more abstractive summaries by learning to map input text to output text. At a high level, such neural models…

Computation and Language · Computer Science 2023-04-11 Yichong Huang , Xiachong Feng , Xiaocheng Feng , Bing Qin

Detecting factual inconsistency for long document summarization remains challenging, given the complex structure of the source article and long summary length. In this work, we study factual inconsistency errors and connect them with a line…

Computation and Language · Computer Science 2025-02-11 Yang Zhong , Diane Litman

Evaluating the factual consistency of abstractive text summarization remains a significant challenge, particularly for long documents, where conventional metrics struggle with input length limitations and long-range dependencies. In this…

Computation and Language · Computer Science 2026-04-30 Zain Muhammad Mujahid , Dustin Wright , Isabelle Augenstein

Despite the seeming success of contemporary grounded text generation systems, they often tend to generate factually inconsistent text with respect to their input. This phenomenon is emphasized in tasks like summarization, in which the…

A key challenge for abstractive summarization is ensuring factual consistency of the generated summary with respect to the original document. For example, state-of-the-art models trained on existing datasets exhibit entity hallucination,…

Computation and Language · Computer Science 2021-02-19 Feng Nan , Ramesh Nallapati , Zhiguo Wang , Cicero Nogueira dos Santos , Henghui Zhu , Dejiao Zhang , Kathleen McKeown , Bing Xiang

Reinforcement learning with evaluation metrics as rewards is widely used to enhance specific capabilities of language models. However, for tasks such as factually consistent summarisation, existing metrics remain underdeveloped, limiting…

Computation and Language · Computer Science 2026-05-27 Yuxuan Ye , Raul Santos-Rodriguez , Edwin Simpson

Automatic abstractive summaries are found to often distort or fabricate facts in the article. This inconsistency between summary and original text has seriously impacted its applicability. We propose a fact-aware summarization model FASum…

Computation and Language · Computer Science 2021-03-16 Chenguang Zhu , William Hinthorn , Ruochen Xu , Qingkai Zeng , Michael Zeng , Xuedong Huang , Meng Jiang

Abstractive text summarization is a highly difficult problem, and the sequence-to-sequence model has shown success in improving the performance on the task. However, the generated summaries are often inconsistent with the source content in…

Computation and Language · Computer Science 2018-05-11 Bingzhen Wei , Xuancheng Ren , Xu Sun , Yi Zhang , Xiaoyan Cai , Qi Su

Unlike extractive summarization, abstractive summarization has to fuse different parts of the source text, which inclines to create fake facts. Our preliminary study reveals nearly 30% of the outputs from a state-of-the-art neural…

Information Retrieval · Computer Science 2017-11-15 Ziqiang Cao , Furu Wei , Wenjie Li , Sujian Li

Lack of factual correctness is an issue that still plagues state-of-the-art summarization systems despite their impressive progress on generating seemingly fluent summaries. In this paper, we show that factual inconsistency can be caused by…

Computation and Language · Computer Science 2024-01-22 Asish Ghoshal , Arash Einolghozati , Ankit Arun , Haoran Li , Lili Yu , Vera Gor , Yashar Mehdad , Scott Wen-tau Yih , Asli Celikyilmaz

Abstractive summarization models often generate factually inconsistent content particularly when the parametric knowledge of the model conflicts with the knowledge in the input document. In this paper, we analyze the robustness of…

Computation and Language · Computer Science 2024-02-26 Jongyoon Song , Nohil Park , Bongkyu Hwang , Jaewoong Yun , Seongho Joe , Youngjune L. Gwon , Sungroh Yoon

This work addresses the challenge of factual consistency in text generation systems. We unify the tasks of Natural Language Inference, Summarization Evaluation, Factuality Verification and Factual Consistency Evaluation to train models…

Computation and Language · Computer Science 2024-08-09 Raunak Agarwal

Dialogue summarization is abstractive in nature, making it suffer from factual errors. The factual correctness of summaries has the highest priority before practical applications. Many efforts have been made to improve faithfulness in text…

Computation and Language · Computer Science 2022-10-24 Bin Wang , Chen Zhang , Yan Zhang , Yiming Chen , Haizhou Li

Despite the recent progress in language generation models, their outputs may not always meet user expectations. In this work, we study whether informational feedback in natural language can be leveraged to improve generation quality and…

Computation and Language · Computer Science 2023-10-17 Yixin Liu , Budhaditya Deb , Milagro Teruel , Aaron Halfaker , Dragomir Radev , Ahmed H. Awadallah

Recent pre-trained abstractive summarization systems have started to achieve credible performance, but a major barrier to their use in practice is their propensity to output summaries that are not faithful to the input and that contain…

Computation and Language · Computer Science 2021-04-12 Tanya Goyal , Greg Durrett

Practical applications of abstractive summarization models are limited by frequent factual inconsistencies with respect to their input. Existing automatic evaluation metrics for summarization are largely insensitive to such errors. We…

Computation and Language · Computer Science 2020-04-10 Alex Wang , Kyunghyun Cho , Mike Lewis
‹ Prev 1 2 3 10 Next ›