English
Related papers

Related papers: Improving Factual Consistency in Summarization wit…

200 papers

Entity resolution is a widely studied problem with several proposals to match records across relations. Matching textual content is a widespread task in many applications, such as question answering and search. While recent methods achieve…

Databases · Computer Science 2021-12-17 Naser Ahmadi , Hansjorg Sand , Paolo Papotti

Summarizing texts is not a straightforward task. Before even considering text summarization, one should determine what kind of summary is expected. How much should the information be compressed? Is it relevant to reformulate or should the…

Computation and Language · Computer Science 2020-07-16 Paul Tardy , David Janiszek , Yannick Estève , Vincent Nguyen

We propose a model-based metric to estimate the factual accuracy of generated text that is complementary to typical scoring schemes like ROUGE (Recall-Oriented Understudy for Gisting Evaluation) and BLEU (Bilingual Evaluation Understudy).…

Computation and Language · Computer Science 2021-05-27 Ben Goodrich , Vinay Rao , Mohammad Saleh , Peter J Liu

Fact-checking systems have become important tools to verify fake and misguiding news. These systems become more trustworthy when human-readable explanations accompany the veracity labels. However, manual collection of such explanations is…

Computation and Language · Computer Science 2021-12-15 Shailza Jolly , Pepa Atanasova , Isabelle Augenstein

Text summarization models are often trained to produce summaries that meet human quality requirements. However, the existing evaluation metrics for summary text are only rough proxies for summary quality, suffering from low correlation with…

Computation and Language · Computer Science 2022-07-12 Wuhang Lin , Shasha Li , Chen Zhang , Bin Ji , Jie Yu , Jun Ma , Zibo Yi

This paper introduces the task of factual error correction: performing edits to a claim so that the generated rewrite is better supported by evidence. This extends the well-studied task of fact verification by providing a mechanism to…

Computation and Language · Computer Science 2021-06-18 James Thorne , Andreas Vlachos

This paper introduces the task of factual error correction: performing edits to a claim so that the generated rewrite is better supported by evidence. This extends the well-studied task of fact verification by providing a mechanism to…

Computation and Language · Computer Science 2021-06-17 James Thorne , Andreas Vlachos

In real world translation scenarios, terminology is rarely one-to-one. Instead, multiple valid translations may appear in a terminology dictionary, but correctness of a translation depends on corporate style guides and context. This can be…

Computation and Language · Computer Science 2025-07-18 Nathaniel Berger , Johannes Eschbach-Dymanus , Miriam Exel , Matthias Huck , Stefan Riezler

NLP models that compare or consolidate information across multiple documents often struggle when challenged with recognizing substantial information redundancies across the texts. For example, in multi-document summarization it is crucial…

Computation and Language · Computer Science 2021-10-12 Daniela Brook Weiss , Paul Roit , Ori Ernst , Ido Dagan

This research focuses on utilizing natural language processing techniques to predict stock price fluctuations, with a specific interest in early detection of economic, political, social, and technological changes that can be leveraged for…

Artificial Intelligence · Computer Science 2023-10-10 Krutika Sarode , Shashidhar Reddy Javaji , Vishal Kalakonnavar

Automatic summarization is the process of reducing a text document in order to generate a summary that retains the most important points of the original document. In this work, we study two problems - i) summarizing a text document as set…

Information Retrieval · Computer Science 2024-06-04 Jayaprakash Sundararaj

Training and deploying deepfake detection models on edge devices offers the advantage of maintaining data privacy and confidentiality by processing it close to its source. However, this approach is constrained by the limited computational…

Machine Learning · Computer Science 2025-05-01 Andreas Karathanasis , John Violos , Ioannis Kompatsiaris , Symeon Papadopoulos

Pre-trained sequence-to-sequence (seq-to-seq) models have significantly improved the accuracy of several language generation tasks, including abstractive summarization. Although the fluency of abstractive summarization has been greatly…

Computation and Language · Computer Science 2020-03-31 Itsumi Saito , Kyosuke Nishida , Kosuke Nishida , Junji Tomita

Multi-document summarization entails producing concise synopses of collections of inputs. For some applications, the synopsis should accurately synthesize inputs with respect to a key aspect, e.g., a synopsis of film reviews written about a…

Computation and Language · Computer Science 2024-07-15 Jay DeYoung , Stephanie C. Martinez , Iain J. Marshall , Byron C. Wallace

With the development of Semantic Web, entity summarization has become an emerging task to generate concrete summaries for real world entities. To solve this problem, we propose an approach named MPSUM that extends a probabilistic topic…

Information Retrieval · Computer Science 2020-05-26 Dongjun Wei , Shiyuan Gao , Yaxin Liu , Zhibing Liu , Longtao Hang

Practical applications of abstractive summarization models are limited by frequent factual inconsistencies with respect to their input. Existing automatic evaluation metrics for summarization are largely insensitive to such errors. We…

Computation and Language · Computer Science 2020-04-10 Alex Wang , Kyunghyun Cho , Mike Lewis

Factual consistency is an important quality in dialogue summarization. Large language model (LLM)-based automatic text summarization models generate more factually consistent summaries compared to those by smaller pretrained language…

Computation and Language · Computer Science 2024-06-24 Rongxin Zhu , Jey Han Lau , Jianzhong Qi

Fact-checking real-world claims often requires reviewing multiple multimodal documents to assess a claim's truthfulness, which is a highly laborious and time-consuming task. In this paper, we present a summarization model designed to…

Artificial Intelligence · Computer Science 2024-09-23 Ting-Chih Chen , Chia-Wei Tang , Chris Thomas

In recent years, summarizers that incorporate domain knowledge into the process of text summarization have outperformed generic methods, especially for summarization of biomedical texts. However, construction and maintenance of domain…

Computation and Language · Computer Science 2019-08-23 Milad Moradi , Matthias Samwald

Abstractive summarization is the process of generating a summary given a document as input. Although significant progress has been made, the factual inconsistency between the document and the generated summary still limits its practical…

Computation and Language · Computer Science 2023-04-03 Shuaijie She , Xiang Geng , Shujian Huang , Jiajun Chen