English
Related papers

Related papers: Factual Error Correction for Abstractive Summariza…

200 papers

Abstractive text summarization is a highly difficult problem, and the sequence-to-sequence model has shown success in improving the performance on the task. However, the generated summaries are often inconsistent with the source content in…

Computation and Language · Computer Science 2018-05-11 Bingzhen Wei , Xuancheng Ren , Xu Sun , Yi Zhang , Xiaoyan Cai , Qi Su

Factual inconsistencies in generated summaries severely limit the practical applications of abstractive dialogue summarization. Although significant progress has been achieved by using pre-trained models, substantial amounts of hallucinated…

Computation and Language · Computer Science 2023-05-10 Xiangru Tang , Arjun Nair , Borui Wang , Bingyao Wang , Jai Desai , Aaron Wade , Haoran Li , Asli Celikyilmaz , Yashar Mehdad , Dragomir Radev

Automatic text summarization extracts important information from texts and presents the information in the form of a summary. Abstractive summarization approaches progressed significantly by switching to deep neural networks, but results…

Computation and Language · Computer Science 2021-09-03 Aleš Žagar , Marko Robnik-Šikonja

We study generating abstractive summaries that are faithful and factually consistent with the given articles. A novel contrastive learning formulation is presented, which leverages both reference summaries, as positive training data, and…

Computation and Language · Computer Science 2021-09-21 Shuyang Cao , Lu Wang

Pre-trained language models (e.g. BART) have shown impressive results when fine-tuned on large summarization datasets. However, little is understood about this fine-tuning process, including what knowledge is retained from pre-training time…

Computation and Language · Computer Science 2022-03-16 Tanya Goyal , Jiacheng Xu , Junyi Jessy Li , Greg Durrett

We apply the Adversarial NLI dataset to train the NLI model and show that the model has the potential to enhance factual correctness in abstract summarization. We follow the work of Falke et al. (2019), which rank multiple generated…

Computation and Language · Computer Science 2020-05-26 Mario Barrantes , Benedikt Herudek , Richard Wang

Neural abstractive summarization models are prone to generate summaries which are factually inconsistent with their source documents. Previous work has introduced the task of recognizing such factual inconsistency as a downstream…

Computation and Language · Computer Science 2022-05-13 Prasetya Ajie Utama , Joshua Bambrick , Nafise Sadat Moosavi , Iryna Gurevych

Neural abstractive summarization models are flexible and can produce coherent summaries, but they are sometimes unfaithful and can be difficult to control. While previous studies attempt to provide different types of guidance to control the…

Computation and Language · Computer Science 2021-04-20 Zi-Yi Dou , Pengfei Liu , Hiroaki Hayashi , Zhengbao Jiang , Graham Neubig

Despite the recent progress in language generation models, their outputs may not always meet user expectations. In this work, we study whether informational feedback in natural language can be leveraged to improve generation quality and…

Computation and Language · Computer Science 2023-10-17 Yixin Liu , Budhaditya Deb , Milagro Teruel , Aaron Halfaker , Dragomir Radev , Ahmed H. Awadallah

The rapid dissemination of misinformation through social media increased the importance of automated fact-checking. Furthermore, studies on what deep neural models pay attention to when making predictions have increased in recent years.…

Computation and Language · Computer Science 2024-02-12 Recep Firat Cekinel , Pinar Karagoz

Most studies on abstractive summarization report ROUGE scores between system and reference summaries. However, we have a concern about the truthfulness of generated summaries: whether all facts of a generated summary are mentioned in the…

Computation and Language · Computer Science 2020-05-06 Kazuki Matsumaru , Sho Takase , Naoaki Okazaki

While large language models (LLMs) have shown remarkable capabilities to generate coherent text, they suffer from the issue of hallucinations -- factually inaccurate statements. Among numerous approaches to tackle hallucinations, especially…

Computation and Language · Computer Science 2025-06-25 Juraj Vladika , Ihsan Soydemir , Florian Matthes

In recent times, extracting valuable information from large text is making significant progress. Especially in the current era of social media, people expect quick bites of information. Automatic text summarization seeks to tackle this by…

Computation and Language · Computer Science 2024-10-23 Sindhu Nair , Y. S. Rao , Radha Shankarmani

Despite the great development of document summarisation techniques nowadays, factual inconsistencies between the generated summaries and the original texts still occur from time to time. This study explores the possibility of adopting…

Computation and Language · Computer Science 2023-05-18 Chen Chen , Wei Emma Zhang , Alireza Seyed Shakeri , Makhmoor Fiza

Attentional, RNN-based encoder-decoder models for abstractive summarization have achieved good performance on short input and output sequences. For longer documents and summaries however these models often include repetitive and incoherent…

Computation and Language · Computer Science 2017-11-15 Romain Paulus , Caiming Xiong , Richard Socher

Abstractive neural summarization models have seen great improvements in recent years, as shown by ROUGE scores of the generated summaries. But despite these improved metrics, there is limited understanding of the strategies different models…

Computation and Language · Computer Science 2021-06-04 Matt Wilber , William Timkey , Marten Van Schijndel

In the past few years, neural abstractive text summarization with sequence-to-sequence (seq2seq) models have gained a lot of popularity. Many interesting techniques have been proposed to improve seq2seq models, making them capable of…

Computation and Language · Computer Science 2020-09-22 Tian Shi , Yaser Keneshloo , Naren Ramakrishnan , Chandan K. Reddy

Grammatical error correction can be viewed as a low-resource sequence-to-sequence task, because publicly available parallel corpora are limited. To tackle this challenge, we first generate erroneous versions of large unannotated corpora…

Computation and Language · Computer Science 2019-07-03 Yo Joong Choe , Jiyeon Ham , Kyubyong Park , Yeoil Yoon

This paper introduces the task of factual error correction: performing edits to a claim so that the generated rewrite is better supported by evidence. This extends the well-studied task of fact verification by providing a mechanism to…

Computation and Language · Computer Science 2021-06-18 James Thorne , Andreas Vlachos

This paper introduces the task of factual error correction: performing edits to a claim so that the generated rewrite is better supported by evidence. This extends the well-studied task of fact verification by providing a mechanism to…

Computation and Language · Computer Science 2021-06-17 James Thorne , Andreas Vlachos