中文
相关论文

相关论文: Understanding Factual Errors in Summarization: Err…

200 篇论文

Fighting misinformation is a challenging, yet crucial, task. Despite the growing number of experts being involved in manual fact-checking, this activity is time-consuming and cannot keep up with the ever-increasing amount of Fake News…

计算与语言 · 计算机科学 2023-08-30 Daniel Russo , Serra Sinem Tekiroglu , Marco Guerini

While the reasoning capabilities of Large Language Models (LLMs) excel in analytical tasks such as mathematics and code generation, their utility for abstractive summarization remains widely assumed but largely unverified. To bridge this…

计算与语言 · 计算机科学 2025-12-10 Haohan Yuan , Haopeng Zhang

We explore the need for more comprehensive and precise evaluation techniques for generative artificial intelligence (GenAI) in text summarization tasks, specifically in the area of opinion summarization. Traditional methods, which leverage…

计算与语言 · 计算机科学 2026-02-10 Leandro Anghinoni , Jorge Sanchez

We present FactPEGASUS, an abstractive summarization model that addresses the problem of factuality during pre-training and fine-tuning: (1) We augment the sentence selection strategy of PEGASUS's (Zhang et al., 2020) pre-training objective…

计算与语言 · 计算机科学 2022-05-17 David Wan , Mohit Bansal

Automated simplification models aim to make input texts more readable. Such methods have the potential to make complex information accessible to a wider audience, e.g., providing access to recent medical literature which might otherwise be…

计算与语言 · 计算机科学 2022-04-18 Ashwin Devaraj , William Sheffield , Byron C. Wallace , Junyi Jessy Li

The evaluation of abstractive summarization models typically uses test data that is identically distributed as training data. In real-world practice, documents to be summarized may contain input noise caused by text extraction artifacts or…

计算与语言 · 计算机科学 2023-12-05 Kundan Krishna , Yao Zhao , Jie Ren , Balaji Lakshminarayanan , Jiaming Luo , Mohammad Saleh , Peter J. Liu

Long documents such as academic articles and business reports have been the standard format to detail out important issues and complicated subjects that require extra attention. An automatic summarization system that can effectively…

计算与语言 · 计算机科学 2022-07-05 Huan Yee Koh , Jiaxin Ju , Ming Liu , Shirui Pan

Multimodal summarization aims to generate a concise summary based on the input text and image. However, the existing methods potentially suffer from unfactual output. To evaluate the factuality of multimodal summarization models, we propose…

计算与语言 · 计算机科学 2025-12-01 Yue Zhang , Jingxuan Zuo , Ke Su , Liqiang Jing

With the recent undeniable advancement in reasoning abilities in large language models (LLMs) like ChatGPT and GPT-4, there is a growing trend for using LLMs on various tasks. One area where LLMs can be employed is as an alternative…

计算与语言 · 计算机科学 2023-10-23 Chenhui Shen , Liying Cheng , Xuan-Phi Nguyen , Yang You , Lidong Bing

While there has been recent progress in abstractive summarization as applied to different domains including news articles, scientific articles, and blog posts, the application of these techniques to clinical text summarization has been…

计算与语言 · 计算机科学 2022-04-05 Amanuel Alambo , Tanvi Banerjee , Krishnaprasad Thirunarayan , Mia Cajita

Improving factual consistency in abstractive summarization has been a focus of current research. One promising approach is the post-editing method. However, previous works have yet to make sufficient use of factual factors in summaries and…

计算与语言 · 计算机科学 2024-02-14 Yiyang Li , Lei Li , Dingxin Hu , Xueyi Hao , Marina Litvak , Natalia Vanetik , Yanquan Zhou

Detecting factual inconsistencies in summarization is critical, yet existing benchmarks lack the necessary challenge and interpretability for robust evaluation. In this paper, we introduce SummExecEdit, a novel pipeline and benchmark…

计算与语言 · 计算机科学 2025-06-03 Onkar Thorat , Philippe Laban , Chien-Sheng Wu

In recent times, extracting valuable information from large text is making significant progress. Especially in the current era of social media, people expect quick bites of information. Automatic text summarization seeks to tackle this by…

计算与语言 · 计算机科学 2024-10-23 Sindhu Nair , Y. S. Rao , Radha Shankarmani

State-of-the-art summarization models still struggle to be factually consistent with the input text. A model-agnostic way to address this problem is post-editing the generated summaries. However, existing approaches typically fail to remove…

计算与语言 · 计算机科学 2022-11-14 Alexander R. Fabbri , Prafulla Kumar Choubey , Jesse Vig , Chien-Sheng Wu , Caiming Xiong

This study addresses the critical issue of factual inaccuracies in machine-generated text summaries, an increasingly prevalent issue in information dissemination. Recognizing the potential of such errors to compromise information…

计算与语言 · 计算机科学 2023-12-05 Aniket Deroy , Subhankar Maity , Saptarshi Ghosh

Through the advent of pre-trained language models, there have been notable advancements in abstractive summarization systems. Simultaneously, a considerable number of novel methods for evaluating factual consistency in abstractive…

计算与语言 · 计算机科学 2024-10-03 Joonho Yang , Seunghyun Yoon , Byeongjeong Kim , Hwanhee Lee

Modern artificial intelligence is supported by machine learning models (e.g., foundation models) that are pretrained on a massive data corpus and then adapted to solve a variety of downstream tasks. To summarize performance across multiple…

机器学习 · 统计学 2025-01-09 Rachel Longjohn , Giri Gopalan , Emily Casleton

Despite the recent progress in language generation models, their outputs may not always meet user expectations. In this work, we study whether informational feedback in natural language can be leveraged to improve generation quality and…

计算与语言 · 计算机科学 2023-10-17 Yixin Liu , Budhaditya Deb , Milagro Teruel , Aaron Halfaker , Dragomir Radev , Ahmed H. Awadallah

Summaries of medical text shall be faithful by being consistent and factual with source inputs, which is an important but understudied topic for safety and efficiency in healthcare. In this paper, we investigate and improve faithfulness in…

计算与语言 · 计算机科学 2023-11-10 Nan Zhang , Yusen Zhang , Wu Guo , Prasenjit Mitra , Rui Zhang

Specifically focusing on the landscape of abstractive text summarization, as opposed to extractive techniques, this survey presents a comprehensive overview, delving into state-of-the-art techniques, prevailing challenges, and prospective…

计算与语言 · 计算机科学 2024-09-05 Hassan Shakil , Ahmad Farooq , Jugal Kalita