English
Related papers

Related papers: Improving Faithfulness in Abstractive Summarizatio…

200 papers

Improving factual consistency of abstractive summarization has been a widely studied topic. However, most of the prior works on training factuality-aware models have ignored the negative effect it has on summary quality. We propose EFACTSUM…

Computation and Language · Computer Science 2023-05-25 Tanay Dixit , Fei Wang , Muhao Chen

We introduce a general framework for abstractive summarization with factual consistency and distinct modeling of the narrative flow in an output summary. Our work addresses current limitations of models for abstractive summarization that…

Computation and Language · Computer Science 2021-04-12 Saadia Gabriel , Antoine Bosselut , Jeff Da , Ari Holtzman , Jan Buys , Kyle Lo , Asli Celikyilmaz , Yejin Choi

Text summarization condenses a text to a shorter version while retaining the important informations. Abstractive summarization is a recent development that generates new phrases, rather than simply copying or rephrasing sentences within the…

Computation and Language · Computer Science 2018-02-06 André Cibils , Claudiu Musat , Andreea Hossman , Michael Baeriswyl

Opinion summarization has been traditionally approached with unsupervised, weakly-supervised and few-shot learning techniques. In this work, we collect a large dataset of summaries paired with user reviews for over 31,000 products, enabling…

Computation and Language · Computer Science 2021-09-10 Arthur Bražinskas , Mirella Lapata , Ivan Titov

The recent demand for customized image generation raises a need for techniques that effectively extract the common concept from small sets of images. Existing methods typically rely on additional guidance, such as text prompts or spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Minseo Kim , Minchan Kwon , Dongyeun Lee , Yunho Jeon , Junmo Kim

We consider the problem of automatically generating a narrative biomedical evidence summary from multiple trial reports. We evaluate modern neural models for abstractive summarization of relevant article abstracts from systematic reviews…

Computation and Language · Computer Science 2020-12-23 Byron C. Wallace , Sayantan Saha , Frank Soboczenski , Iain J. Marshall

Despite large language models (LLMs) have demonstrated impressive performance in various tasks, they are still suffering from the factual inconsistency problem called hallucinations. For instance, LLMs occasionally generate content that…

Computation and Language · Computer Science 2024-08-01 Taiji Li , Zhi Li , Yin Zhang

Neural network-based methods for abstractive summarization produce outputs that are more fluent than other techniques, but which can be poor at content selection. This work proposes a simple technique for addressing this issue: use a…

Computation and Language · Computer Science 2018-10-10 Sebastian Gehrmann , Yuntian Deng , Alexander M. Rush

Neural sequence models can generate highly fluent sentences, but recent studies have also shown that they are also prone to hallucinate additional content not supported by the input. These variety of fluent but wrong outputs are…

Computation and Language · Computer Science 2021-06-04 Chunting Zhou , Graham Neubig , Jiatao Gu , Mona Diab , Paco Guzman , Luke Zettlemoyer , Marjan Ghazvininejad

The advent of Large Language Models (LLMs) has led to remarkable progress on a wide range of natural language processing tasks. Despite the advances, these large-sized models still suffer from hallucinating information in their output,…

Computation and Language · Computer Science 2024-03-15 Laura Mascarell , Ribin Chalumattu , Annette Rios

Despite the recent advances in abstractive summarization systems, it is still difficult to determine whether a generated summary is factual consistent with the source text. To this end, the latest approach is to train a factual consistency…

Computation and Language · Computer Science 2022-05-05 Hwanhee Lee , Kang Min Yoo , Joonsuk Park , Hwaran Lee , Kyomin Jung

The pursuit of high perceptual quality in image restoration has driven the development of revolutionary generative models, capable of producing results often visually indistinguishable from real data. However, as their perceptual quality…

Machine Learning · Computer Science 2024-10-29 Regev Cohen , Idan Kligvasser , Ehud Rivlin , Daniel Freedman

Neural abstractive summarization models are prone to generate summaries which are factually inconsistent with their source documents. Previous work has introduced the task of recognizing such factual inconsistency as a downstream…

Computation and Language · Computer Science 2022-05-13 Prasetya Ajie Utama , Joshua Bambrick , Nafise Sadat Moosavi , Iryna Gurevych

Currently used metrics for assessing summarization algorithms do not account for whether summaries are factually consistent with source documents. We propose a weakly-supervised, model-based approach for verifying factual consistency and…

Computation and Language · Computer Science 2019-10-29 Wojciech Kryściński , Bryan McCann , Caiming Xiong , Richard Socher

Large Language Models (LLMs) have shown propensity to generate hallucinated outputs, i.e., texts that are factually incorrect or unsupported. Existing methods for alleviating hallucinations typically require costly human annotations to…

Computation and Language · Computer Science 2024-04-03 Yu Xia , Xu Liu , Tong Yu , Sungchul Kim , Ryan A. Rossi , Anup Rao , Tung Mai , Shuai Li

One of the most challenging aspects of current single-document news summarization is that the summary often contains 'extrinsic hallucinations', i.e., facts that are not present in the source document, which are often derived via world…

Computation and Language · Computer Science 2021-09-23 Xinnuo Xu , Ondřej Dušek , Shashi Narayan , Verena Rieser , Ioannis Konstas

Reinforcement learning with evaluation metrics as rewards is widely used to enhance specific capabilities of language models. However, for tasks such as factually consistent summarisation, existing metrics remain underdeveloped, limiting…

Computation and Language · Computer Science 2026-05-27 Yuxuan Ye , Raul Santos-Rodriguez , Edwin Simpson

Despite the seeming success of contemporary grounded text generation systems, they often tend to generate factually inconsistent text with respect to their input. This phenomenon is emphasized in tasks like summarization, in which the…

Abstractive summarization is the process of generating a summary given a document as input. Although significant progress has been made, the factual inconsistency between the document and the generated summary still limits its practical…

Computation and Language · Computer Science 2023-04-03 Shuaijie She , Xiang Geng , Shujian Huang , Jiajun Chen

Large Language Models have demonstrated remarkable capabilities across diverse tasks, yet they frequently generate hallucinations outputs that are fluent but factually incorrect or unsupported. We propose Counterfactual Probing, a novel…

Computation and Language · Computer Science 2025-08-05 Yijun Feng