English
Related papers

Related papers: Improving Truthfulness of Headline Generation

200 papers

Neural abstractive summarization systems have achieved promising progress, thanks to the availability of large-scale datasets and models pre-trained with self-supervised methods. However, ensuring the factual consistency of the generated…

Computation and Language · Computer Science 2021-04-05 Meng Cao , Yue Dong , Jiapeng Wu , Jackie Chi Kit Cheung

The popularity of automated news headline generation has surged with advancements in pre-trained language models. However, these models often suffer from the ``hallucination'' problem, where the generated headline is not fully supported by…

Computation and Language · Computer Science 2024-07-24 Jiaming Shen , Tianqi Liu , Jialu Liu , Zhen Qin , Jay Pavagadhi , Simon Baumgartner , Michael Bendersky

In recent times, extracting valuable information from large text is making significant progress. Especially in the current era of social media, people expect quick bites of information. Automatic text summarization seeks to tackle this by…

Computation and Language · Computer Science 2024-10-23 Sindhu Nair , Y. S. Rao , Radha Shankarmani

State-of-the-art abstractive summarization systems often generate \emph{hallucinations}; i.e., content that is not directly inferable from the source text. Despite being assumed incorrect, we find that much hallucinated content is factual,…

Computation and Language · Computer Science 2021-12-07 Meng Cao , Yue Dong , Jackie Chi Kit Cheung

State-of-the-art summarization models still struggle to be factually consistent with the input text. A model-agnostic way to address this problem is post-editing the generated summaries. However, existing approaches typically fail to remove…

Computation and Language · Computer Science 2022-11-14 Alexander R. Fabbri , Prafulla Kumar Choubey , Jesse Vig , Chien-Sheng Wu , Caiming Xiong

Fact-checking systems have become important tools to verify fake and misguiding news. These systems become more trustworthy when human-readable explanations accompany the veracity labels. However, manual collection of such explanations is…

Computation and Language · Computer Science 2021-12-15 Shailza Jolly , Pepa Atanasova , Isabelle Augenstein

Opinion summarization is the task of automatically creating summaries that reflect subjective information expressed in multiple documents, such as product reviews. While the majority of previous work has focused on the extractive setting,…

Computation and Language · Computer Science 2020-04-21 Arthur Bražinskas , Mirella Lapata , Ivan Titov

Neural models for abstractive summarization tend to generate output that is fluent and well-formed but lacks semantic faithfulness, or factuality, with respect to the input documents. In this paper, we analyze the tradeoff between…

Computation and Language · Computer Science 2023-04-26 Markus Dreyer , Mengwen Liu , Feng Nan , Sandeep Atluri , Sujith Ravi

Reinforcement learning with evaluation metrics as rewards is widely used to enhance specific capabilities of language models. However, for tasks such as factually consistent summarisation, existing metrics remain underdeveloped, limiting…

Computation and Language · Computer Science 2026-05-27 Yuxuan Ye , Raul Santos-Rodriguez , Edwin Simpson

Recent language generative models are mostly trained on large-scale datasets, while in some real scenarios, the training datasets are often expensive to obtain and would be small-scale. In this paper we investigate the challenging task of…

Computation and Language · Computer Science 2022-10-11 Zhuoxuan Jiang , Lingfeng Qiao , Di Yin , Shanshan Feng , Bo Ren

Pre-trained and fine-tuned news summarizers are expected to generalize to news articles unseen in the fine-tuning (training) phase. However, these articles often contain specifics, such as new events and people, a summarizer could not learn…

Computation and Language · Computer Science 2022-04-19 Arthur Bražinskas , Mengwen Liu , Ramesh Nallapati , Sujith Ravi , Markus Dreyer

Pointer generator networks have been used successfully for abstractive summarization. Along with the capability to generate novel words, it also allows the model to copy from the input text to handle out-of-vocabulary words. In this paper,…

Machine Learning · Computer Science 2019-02-01 Kushal Chawla , Kundan Krishna , Balaji Vasan Srinivasan

Generative models achieve remarkable results in multiple data domains, including images and texts, among other examples. Unfortunately, malicious users exploit synthetic media for spreading misinformation and disseminating deepfakes.…

Artificial Intelligence · Computer Science 2025-08-04 Tom Or , Omri Azencot

Despite significant progress in neural abstractive summarization, recent studies have shown that the current models are prone to generating summaries that are unfaithful to the original context. To address the issue, we study contrast…

Computation and Language · Computer Science 2021-04-20 Sihao Chen , Fan Zhang , Kazoo Sone , Dan Roth

With advances in generative artificial intelligence (AI), it is now possible to produce realistic-looking automated reports for preliminary reads of radiology images. This can expedite clinical workflows, improve accuracy and reduce overall…

Artificial Intelligence · Computer Science 2025-06-03 Razi Mahmood , Diego Machado Reyes , Ge Wang , Mannudeep Kalra , Pingkun Yan

Personalized news headline generation, aiming at generating user-specific headlines based on readers' preferences, burgeons a recent flourishing research direction. Existing studies generally inject a user interest embedding into an…

Computation and Language · Computer Science 2025-01-22 Zhao Yang , Junhong Lian , Xiang Ao

Recently, neural models have been proposed for headline generation by learning to map documents to headlines with recurrent neural networks. Nevertheless, as traditional neural network utilizes maximum likelihood estimation for parameter…

Computation and Language · Computer Science 2016-10-11 Ayana , Shiqi Shen , Yu Zhao , Zhiyuan Liu , Maosong Sun

Detecting factual inconsistency for long document summarization remains challenging, given the complex structure of the source article and long summary length. In this work, we study factual inconsistency errors and connect them with a line…

Computation and Language · Computer Science 2025-02-11 Yang Zhong , Diane Litman

Keyphrases are crucial for searching and systematizing scholarly documents. Most current methods for keyphrase extraction are aimed at the extraction of the most significant words in the text. But in practice, the list of keyphrases often…

Computation and Language · Computer Science 2024-10-23 Anna Glazkova , Dmitry Morozov

The timeline generation task summarises an entity's biography by selecting stories representing key events from a large pool of relevant documents. This paper addresses the lack of a standard dataset and evaluative methodology for the…

Computation and Language · Computer Science 2016-11-08 Xavier Holt , Will Radford , Ben Hachey