English
Related papers

Related papers: Entity-level Factual Consistency of Abstractive Te…

200 papers

Abstractive summarization systems today produce fluent and relevant output, but often "hallucinate" statements not supported by the source text. We analyze the connection between hallucinations and training data, and find evidence that…

Computation and Language · Computer Science 2023-11-20 Daniel King , Zejiang Shen , Nishant Subramani , Daniel S. Weld , Iz Beltagy , Doug Downey

Large Language Models have significantly advanced natural language processing tasks, but remain prone to generating incorrect or misleading but plausible arguments. This issue, known as hallucination, is particularly concerning in…

Computation and Language · Computer Science 2025-12-04 Ahmad Aghaebrahimian

While large language models (LLMs) have shown remarkable capabilities to generate coherent text, they suffer from the issue of hallucinations -- factually inaccurate statements. Among numerous approaches to tackle hallucinations, especially…

Computation and Language · Computer Science 2025-06-25 Juraj Vladika , Ihsan Soydemir , Florian Matthes

Lack of factual correctness is an issue that still plagues state-of-the-art summarization systems despite their impressive progress on generating seemingly fluent summaries. In this paper, we show that factual inconsistency can be caused by…

Computation and Language · Computer Science 2024-01-22 Asish Ghoshal , Arash Einolghozati , Ankit Arun , Haoran Li , Lili Yu , Vera Gor , Yashar Mehdad , Scott Wen-tau Yih , Asli Celikyilmaz

Specifically focusing on the landscape of abstractive text summarization, as opposed to extractive techniques, this survey presents a comprehensive overview, delving into state-of-the-art techniques, prevailing challenges, and prospective…

Computation and Language · Computer Science 2024-09-05 Hassan Shakil , Ahmad Farooq , Jugal Kalita

The issue of factual consistency in abstractive summarization has received extensive attention in recent years, and the evaluation of factual consistency between summary and document has become an important and urgent task. Most of the…

Computation and Language · Computer Science 2023-11-29 Yiyang Li , Lei Li , Marina Litvak , Natalia Vanetik , Dingxin Hu , Yuze Li , Yanquan Zhou

We explore the need for more comprehensive and precise evaluation techniques for generative artificial intelligence (GenAI) in text summarization tasks, specifically in the area of opinion summarization. Traditional methods, which leverage…

Computation and Language · Computer Science 2026-02-10 Leandro Anghinoni , Jorge Sanchez

Entity matching is the task of linking records from different sources that refer to the same real-world entity. Past work has primarily treated entity linking as a standard supervised learning problem. However, supervised entity matching…

Computation and Language · Computer Science 2024-10-01 Somin Wadhwa , Adit Krishnan , Runhui Wang , Byron C. Wallace , Chris Kong

We consider the problem of automatically generating a narrative biomedical evidence summary from multiple trial reports. We evaluate modern neural models for abstractive summarization of relevant article abstracts from systematic reviews…

Computation and Language · Computer Science 2020-12-23 Byron C. Wallace , Sayantan Saha , Frank Soboczenski , Iain J. Marshall

Text summarizing is a critical Natural Language Processing (NLP) task with applications ranging from information retrieval to content generation. Large Language Models (LLMs) have shown remarkable promise in generating fluent abstractive…

Computation and Language · Computer Science 2025-03-03 Colleen Gilhuly , Haleh Shahzad

Automatic summarization of legal case judgements, which are known to be long and complex, has traditionally been tried via extractive summarization models. In recent years, generative models including abstractive summarization models and…

Computation and Language · Computer Science 2024-07-23 Aniket Deroy , Kripabandhu Ghosh , Saptarshi Ghosh

Text Summarization is recognised as one of the NLP downstream tasks and it has been extensively investigated in recent years. It can assist people with perceiving the information rapidly from the Internet, including news articles, social…

Computation and Language · Computer Science 2022-12-08 Guan Wang , Weihua Li , Edmund Lai , Jianhua Jiang

The task of automatic text summarization produces a concise and fluent text summary while preserving key information and overall meaning. Recent approaches to document-level summarization have seen significant improvements in recent years…

Computation and Language · Computer Science 2022-12-07 Gonçalo Raposo , Afonso Raposo , Ana Sofia Carmo

Ensuring factual consistency is crucial for natural language generation tasks, particularly in abstractive summarization, where preserving the integrity of information is paramount. Prior works on evaluating factual consistency of…

Computation and Language · Computer Science 2024-10-07 Haoyi Qiu , Kung-Hsiang Huang , Jingnong Qu , Nanyun Peng

Despite the remarkable performance of generative large language models (LLMs) on abstractive summarization, they face two significant challenges: their considerable size and tendency to hallucinate. Hallucinations are concerning because…

Computation and Language · Computer Science 2024-10-28 George Chrysostomou , Zhixue Zhao , Miles Williams , Nikolaos Aletras

Abstractive text summarization is a highly difficult problem, and the sequence-to-sequence model has shown success in improving the performance on the task. However, the generated summaries are often inconsistent with the source content in…

Computation and Language · Computer Science 2018-05-11 Bingzhen Wei , Xuancheng Ren , Xu Sun , Yi Zhang , Xiaoyan Cai , Qi Su

Current abstractive summarization systems present important weaknesses which prevent their deployment in real-world applications, such as the omission of relevant information and the generation of factual inconsistencies (also known as…

Computation and Language · Computer Science 2022-11-08 Diogo Pernes , Afonso Mendes , André F. T. Martins

Despite the recent advancements in abstractive summarization systems leveraged from large-scale datasets and pre-trained language models, the factual correctness of the summary is still insufficient. One line of trials to mitigate this…

Computation and Language · Computer Science 2022-04-19 Hwanhee Lee , Cheoneum Park , Seunghyun Yoon , Trung Bui , Franck Dernoncourt , Juae Kim , Kyomin Jung

Hallucinations in text generation occur when the system produces text that is not grounded in the input. In this work, we tackle the problem of hallucinations in neural chart summarization. Our analysis shows that the target side of chart…

Computation and Language · Computer Science 2023-08-11 Saad Obaid ul Islam , Iza Škrjanec , Ondřej Dušek , Vera Demberg

Hallucinations pose a significant challenge to the reliability of neural models for abstractive summarisation. While automatically generated summaries may be fluent, they often lack faithfulness to the original document. This issue becomes…

Computation and Language · Computer Science 2023-10-27 Yifu Qiu , Yftah Ziser , Anna Korhonen , Edoardo M. Ponti , Shay B. Cohen