English
Related papers

Related papers: Optimizing the Factual Correctness of a Summary: A…

200 papers

Summaries of medical text shall be faithful by being consistent and factual with source inputs, which is an important but understudied topic for safety and efficiency in healthcare. In this paper, we investigate and improve faithfulness in…

Computation and Language · Computer Science 2023-11-10 Nan Zhang , Yusen Zhang , Wu Guo , Prasenjit Mitra , Rui Zhang

Automatic text summarization has enjoyed great progress over the years and is used in numerous applications, impacting the lives of many. Despite this development, there is little research that meaningfully investigates how the current…

Computation and Language · Computer Science 2022-05-02 Maartje ter Hoeve , Julia Kiseleva , Maarten de Rijke

Abstractive summarization typically relies on large collections of paired articles and summaries. However, in many cases, parallel data is scarce and costly to obtain. We develop an abstractive summarization system that relies only on large…

Computation and Language · Computer Science 2020-03-04 Nikola I. Nikolov , Richard H. R. Hahnloser

Neural abstractive summarization models are prone to generate summaries which are factually inconsistent with their source documents. Previous work has introduced the task of recognizing such factual inconsistency as a downstream…

Computation and Language · Computer Science 2022-05-13 Prasetya Ajie Utama , Joshua Bambrick , Nafise Sadat Moosavi , Iryna Gurevych

Abstractive dialogue summarization has received increasing attention recently. Despite the fact that most of the current dialogue summarization systems are trained to maximize the likelihood of human-written summaries and have achieved…

Computation and Language · Computer Science 2022-12-21 Jiaao Chen , Mohan Dodda , Diyi Yang

Despite the recent advances in abstractive text summarization, current summarization models still suffer from generating factually inconsistent summaries, reducing their utility for real-world application. We argue that the main reason for…

Computation and Language · Computer Science 2023-10-16 Polina Zablotskaia , Misha Khalman , Rishabh Joshi , Livio Baldini Soares , Shoshana Jakobovits , Joshua Maynez , Shashi Narayan

Existing approaches to automatic summarization assume that a length limit for the summary is given, and view content selection as an optimization problem to maximize informativeness and minimize redundancy within this budget. This framework…

Computation and Language · Computer Science 2019-01-15 Jingyun Liu , Jackie C. K. Cheung , Annie Louis

Understanding a medical conversation between a patient and a physician poses a unique natural language understanding challenge since it combines elements of standard open ended conversation with very domain specific elements that require…

Computation and Language · Computer Science 2020-09-21 Anirudh Joshi , Namit Katariya , Xavier Amatriain , Anitha Kannan

Long-form clinical summarization of hospital admissions has real-world significance because of its potential to help both clinicians and patients. The faithfulness of summaries is critical to their safe usage in clinical settings. To better…

Computation and Language · Computer Science 2023-03-08 Griffin Adams , Jason Zucker , Noémie Elhadad

Relation extraction (RE) models have been challenged by their reliance on training data with expensive annotations. Considering that summarization tasks aim at acquiring concise expressions of synoptical information from the longer context,…

Computation and Language · Computer Science 2022-10-24 Keming Lu , I-Hung Hsu , Wenxuan Zhou , Mingyu Derek Ma , Muhao Chen

How reliably an automatic summarization evaluation metric replicates human judgments of summary quality is quantified by system-level correlations. We identify two ways in which the definition of the system-level correlation is inconsistent…

Computation and Language · Computer Science 2022-04-22 Daniel Deutsch , Rotem Dror , Dan Roth

Automatic video summarization is still an unsolved problem due to several challenges. We take steps towards making automatic video summarization more realistic by addressing them. Firstly, the currently available datasets either have very…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Vishal Kaushal , Suraj Kothawade , Rishabh Iyer , Ganesh Ramakrishnan

Automatic text summarization has experienced substantial progress in recent years. With this progress, the question has arisen whether the types of summaries that are typically generated by automatic summarization models align with users'…

Computation and Language · Computer Science 2022-04-26 Maartje ter Hoeve , Julia Kiseleva , Maarten de Rijke

Improving the quality of model-generated summaries, especially factuality, the accuracy of a summary with respect to its source content, remains a challenge. While reranking could select the optimal output from multiple generated…

Computation and Language · Computer Science 2026-05-29 Riza Setiawan Soetedjo , Yusuke Sakai , Hidetaka Kamigaito , Jingun Kwon , Manabu Okumura , Taro Watanabe

Summarization models often generate text that is poorly calibrated to quality metrics because they are trained to maximize the likelihood of a single reference (MLE). To address this, recent work has added a calibration step, which exposes…

We present a new neural model for text summarization that first extracts sentences from a document and then compresses them. The proposed model offers a balance that sidesteps the difficulties in abstractive methods while generating more…

Information Retrieval · Computer Science 2019-04-08 Afonso Mendes , Shashi Narayan , Sebastião Miranda , Zita Marinho , André F. T. Martins , Shay B. Cohen

Text summarization aims at compressing long documents into a shorter form that conveys the most important parts of the original document. Despite increased interest in the community and notable research effort, progress on benchmark…

Computation and Language · Computer Science 2019-08-27 Wojciech Kryściński , Nitish Shirish Keskar , Bryan McCann , Caiming Xiong , Richard Socher

We study submodular information measures as a rich framework for generic, query-focused, privacy sensitive, and update summarization tasks. While past work generally treats these problems differently ({\em e.g.}, different models are often…

Machine Learning · Computer Science 2020-10-13 Vishal Kaushal , Suraj Kothawade , Ganesh Ramakrishnan , Jeff Bilmes , Himanshu Asnani , Rishabh Iyer

We present TrialsSummarizer, a system that aims to automatically summarize evidence presented in the set of randomized controlled trials most relevant to a given query. Building on prior work, the system retrieves trial publications…

Computation and Language · Computer Science 2023-03-10 Sanjana Ramprasad , Denis Jered McInerney , Iain J. Marshal , Byron C. Wallace

Despite some recent advances, automatic text summarization remains unreliable, elusive, and of limited practical use in applications. Two main problems with current summarization methods are well known: evaluation and factual consistency.…

Computation and Language · Computer Science 2022-04-12 Jay Ahn , Foaad Khosmood