English
Related papers

Related papers: Improving Factual Consistency in Summarization wit…

200 papers

Controllable summarization aims to provide summaries that take into account user-specified aspects and preferences to better assist them with their information need, as opposed to the standard summarization setup which build a single…

Computation and Language · Computer Science 2022-04-06 Mounica Maddela , Mayank Kulkarni , Daniel Preotiuc-Pietro

Aligning sentences in a reference summary with their counterparts in source documents was shown as a useful auxiliary summarization task, notably for generating training data for salience detection. Despite its assessed utility, the…

Computation and Language · Computer Science 2021-09-27 Ori Ernst , Ori Shapira , Ramakanth Pasunuru , Michael Lepioshkin , Jacob Goldberger , Mohit Bansal , Ido Dagan

Despite being vast repositories of factual information, cross-domain knowledge graphs, such as Wikidata and the Google Knowledge Graph, only sparsely provide short synoptic descriptions for entities. Such descriptions that briefly identify…

Computation and Language · Computer Science 2019-04-17 Rajarshi Bhowmik , Gerard de Melo

Despite the success achieved in neural abstractive summarization based on pre-trained language models, one unresolved issue is that the generated summaries are not always faithful to the input document. There are two possible causes of the…

Computation and Language · Computer Science 2022-10-06 Xiuying Chen , Mingzhe Li , Xin Gao , Xiangliang Zhang

Extractive summarization plays a pivotal role in natural language processing due to its wide-range applications in summarizing diverse content efficiently, while also being faithful to the original content. Despite significant advancement…

Computation and Language · Computer Science 2024-07-09 Mihir Parmar , Hanieh Deilamsalehy , Franck Dernoncourt , Seunghyun Yoon , Ryan A. Rossi , Trung Bui

Citation texts are sometimes not very informative or in some cases inaccurate by themselves; they need the appropriate context from the referenced paper to reflect its exact contributions. To address this problem, we propose an unsupervised…

Computation and Language · Computer Science 2017-05-24 Arman Cohan , Nazli Goharian

Contextualized word embeddings can lead to state-of-the-art performances in natural language understanding. Recently, a pre-trained deep contextualized text encoder such as BERT has shown its potential in improving natural language tasks…

Computation and Language · Computer Science 2022-09-02 Hyunjae Lee , Jaewoong Yun , Hyunjin Choi , Seongho Joe , Youngjune L. Gwon

The performance of text summarization has been greatly boosted by pre-trained language models. A main concern of existing methods is that most generated summaries are not factually inconsistent with their source documents. To alleviate the…

Computation and Language · Computer Science 2023-04-14 Zheheng Luo , Qianqian Xie , Sophia Ananiadou

Dialogue summarization is abstractive in nature, making it suffer from factual errors. The factual correctness of summaries has the highest priority before practical applications. Many efforts have been made to improve faithfulness in text…

Computation and Language · Computer Science 2022-10-24 Bin Wang , Chen Zhang , Yan Zhang , Yiming Chen , Haizhou Li

Automatic summarization techniques aim to shorten and generalize information given in the text while preserving its core message and the most relevant ideas. This task can be approached and treated with a variety of methods, however, not…

Computation and Language · Computer Science 2021-08-10 Alexandr Nikolich , Arina Puchkova

Abstractive text summarization aims at compressing the information of a long source document into a rephrased, condensed summary. Despite advances in modeling techniques, abstractive summarization models still suffer from several key…

Computation and Language · Computer Science 2021-02-17 Vidhisha Balachandran , Artidoro Pagnoni , Jay Yoon Lee , Dheeraj Rajagopal , Jaime Carbonell , Yulia Tsvetkov

In inference problems, we often have domain knowledge which allows us to define summary statistics that capture most of the information content in a dataset. In this paper, we present a hybrid approach, where such physics-based summaries…

Cosmology and Nongalactic Astrophysics · Physics 2025-04-24 T. Lucas Makinen , Alan Heavens , Natalia Porqueres , Tom Charnock , Axel Lapel , Benjamin D. Wandelt

Abstractive summarization has enjoyed renewed interest in recent years, thanks to pre-trained language models and the availability of large-scale datasets. Despite promising results, current models still suffer from generating factually…

Computation and Language · Computer Science 2024-01-08 Roee Aharoni , Shashi Narayan , Joshua Maynez , Jonathan Herzig , Elizabeth Clark , Mirella Lapata

Growing literature has shown that NLP systems may encode social biases; however, the political bias of summarization models remains relatively unknown. In this work, we use an entity replacement method to investigate the portrayal of…

Computation and Language · Computer Science 2023-10-23 Karen Zhou , Chenhao Tan

Automated code summarization is a long-standing goal for code comprehension. This task automatically generates documentation using a given method. Deep Learning (DL)-based approaches have been proven beneficial for various software…

Software Engineering · Computer Science 2025-02-12 Antonio Vitale , Antonio Mastropaolo , Rocco Oliveto , Massimiliano Di Penta , Simone Scalabrino

We study submodular information measures as a rich framework for generic, query-focused, privacy sensitive, and update summarization tasks. While past work generally treats these problems differently ({\em e.g.}, different models are often…

Machine Learning · Computer Science 2020-10-13 Vishal Kaushal , Suraj Kothawade , Ganesh Ramakrishnan , Jeff Bilmes , Himanshu Asnani , Rishabh Iyer

Recent work has shown the promise of learning with human feedback paradigms to produce human-determined high-quality text. Existing works use human feedback to train large language models (LLMs) in general domain abstractive summarization…

Computation and Language · Computer Science 2025-01-07 Zonghai Yao , Benjamin J Schloss , Sai P. Selvaraj

Factual inconsistencies pose a significant hurdle for the faithful summarization by generative models. While a major direction to enhance inconsistency detection is to derive stronger Natural Language Inference (NLI) models, we propose an…

Computation and Language · Computer Science 2024-10-07 Liyan Xu , Zhenlin Su , Mo Yu , Jin Xu , Jinho D. Choi , Jie Zhou , Fei Liu

Detecting factual errors in summaries has been an important and challenging subject in summarization research. Inspired by the emergent ability of large language models (LLMs), we explore evaluating factual consistency of summaries by…

Computation and Language · Computer Science 2023-10-13 Shiqi Chen , Siyang Gao , Junxian He

We introduce entity post-modifier generation as an instance of a collaborative writing task. Given a sentence about a target entity, the task is to automatically generate a post-modifier phrase that provides contextually relevant…

Computation and Language · Computer Science 2019-04-10 Jun Seok Kang , Robert L. Logan , Zewei Chu , Yang Chen , Dheeru Dua , Kevin Gimpel , Sameer Singh , Niranjan Balasubramanian