English
Related papers

Related papers: Entity-level Factual Consistency of Abstractive Te…

200 papers

Neural models for abstractive summarization tend to generate output that is fluent and well-formed but lacks semantic faithfulness, or factuality, with respect to the input documents. In this paper, we analyze the tradeoff between…

Computation and Language · Computer Science 2023-04-26 Markus Dreyer , Mengwen Liu , Feng Nan , Sandeep Atluri , Sujith Ravi

The topic of summarization evaluation has recently attracted a surge of attention due to the rapid development of abstractive summarization systems. However, the formulation of the task is rather ambiguous, neither the linguistic nor the…

Computation and Language · Computer Science 2022-11-01 Yanzhu Guo , Chloé Clavel , Moussa Kamal Eddine , Michalis Vazirgiannis

E-commerce stores collect customer feedback to let sellers learn about customer concerns and enhance customer order experience. Because customer feedback often contains redundant information, a concise summary of the feedback can be…

Computation and Language · Computer Science 2021-07-01 Yang Liu , Yifei Sun , Vincent Gao

Automatic abstractive summaries are found to often distort or fabricate facts in the article. This inconsistency between summary and original text has seriously impacted its applicability. We propose a fact-aware summarization model FASum…

Computation and Language · Computer Science 2021-03-16 Chenguang Zhu , William Hinthorn , Ruochen Xu , Qingkai Zeng , Michael Zeng , Xuedong Huang , Meng Jiang

Modern abstractive summarization models often generate summaries that contain hallucinated or contradictory information. In this paper, we propose a simple but effective contrastive learning framework that incorporates recent developments…

Computation and Language · Computer Science 2023-07-11 I-Chun Chern , Zhiruo Wang , Sanjan Das , Bhavuk Sharma , Pengfei Liu , Graham Neubig

As part of the large number of scientific articles being published every year, the publication rate of biomedical literature has been increasing. Consequently, there has been considerable effort to harness and summarize the massive amount…

Computation and Language · Computer Science 2022-03-31 Amanuel Alambo , Tanvi Banerjee , Krishnaprasad Thirunarayan , Michael Raymer

Despite the seeming success of contemporary grounded text generation systems, they often tend to generate factually inconsistent text with respect to their input. This phenomenon is emphasized in tasks like summarization, in which the…

Improving factual consistency of abstractive summarization has been a widely studied topic. However, most of the prior works on training factuality-aware models have ignored the negative effect it has on summary quality. We propose EFACTSUM…

Computation and Language · Computer Science 2023-05-25 Tanay Dixit , Fei Wang , Muhao Chen

A primary challenge in abstractive summarization is hallucination -- the phenomenon where a model generates plausible text that is absent in the source text. We hypothesize that the domain (or topic) of the source text triggers the model to…

Computation and Language · Computer Science 2025-06-10 Kyubyung Chae , Jaepill Choi , Yohan Jo , Taesup Kim

Abstractive text summarization aims at compressing the information of a long source document into a rephrased, condensed summary. Despite advances in modeling techniques, abstractive summarization models still suffer from several key…

Computation and Language · Computer Science 2021-02-17 Vidhisha Balachandran , Artidoro Pagnoni , Jay Yoon Lee , Dheeraj Rajagopal , Jaime Carbonell , Yulia Tsvetkov

Large Language Models work quite well with general-purpose data and many tasks in Natural Language Processing. However, they show several limitations when used for a task such as domain-specific abstractive text summarization. This paper…

Computation and Language · Computer Science 2023-07-04 Anum Afzal , Juraj Vladika , Daniel Braun , Florian Matthes

Abstractive summarization using large language models (LLMs) has become an essential tool for condensing information. However, despite their ability to generate fluent summaries, these models sometimes produce unfaithful summaries,…

Computation and Language · Computer Science 2025-10-14 Sicong Huang , Qianqi Yan , Shengze Wang , Ian Lane

The propensity of abstractive summarization models to make factual errors has been studied extensively, including design of metrics to detect factual errors and annotation of errors in current systems' outputs. However, the ever-evolving…

Factual hallucinations are a major challenge for Large Language Models (LLMs). They undermine reliability and user trust by generating inaccurate or fabricated content. Recent studies suggest that when generating false statements, the…

Computation and Language · Computer Science 2025-06-02 Giovanni Servedio , Alessandro De Bellis , Dario Di Palma , Vito Walter Anelli , Tommaso Di Noia

Abstractive summarization has enjoyed renewed interest in recent years, thanks to pre-trained language models and the availability of large-scale datasets. Despite promising results, current models still suffer from generating factually…

Computation and Language · Computer Science 2024-01-08 Roee Aharoni , Shashi Narayan , Joshua Maynez , Jonathan Herzig , Elizabeth Clark , Mirella Lapata

No existing dataset adequately tests how well language models can incrementally update entity summaries - a crucial ability as these models rapidly advance. The Incremental Entity Summarization (IES) task is vital for maintaining accurate,…

Computation and Language · Computer Science 2024-06-10 Eunjeong Hwang , Yichao Zhou , Beliz Gunel , James Bradley Wendt , Sandeep Tata

Evaluating the factual consistency of abstractive text summarization remains a significant challenge, particularly for long documents, where conventional metrics struggle with input length limitations and long-range dependencies. In this…

Computation and Language · Computer Science 2026-04-30 Zain Muhammad Mujahid , Dustin Wright , Isabelle Augenstein

Neural abstractive summarization systems have achieved promising progress, thanks to the availability of large-scale datasets and models pre-trained with self-supervised methods. However, ensuring the factual consistency of the generated…

Computation and Language · Computer Science 2021-04-05 Meng Cao , Yue Dong , Jiapeng Wu , Jackie Chi Kit Cheung

State-of-the-art summarization models still struggle to be factually consistent with the input text. A model-agnostic way to address this problem is post-editing the generated summaries. However, existing approaches typically fail to remove…

Computation and Language · Computer Science 2022-11-14 Alexander R. Fabbri , Prafulla Kumar Choubey , Jesse Vig , Chien-Sheng Wu , Caiming Xiong

In a world of proliferating data, the ability to rapidly summarize text is growing in importance. Automatic summarization of text can be thought of as a sequence to sequence problem. Another area of natural language processing that solves a…

Computation and Language · Computer Science 2018-10-23 Jacob Krantz , Jugal Kalita