English
Related papers

Related papers: Correcting Diverse Factual Errors in Abstractive S…

200 papers

This paper creates a paradigm shift with regard to the way we build neural extractive summarization systems. Instead of following the commonly used framework of extracting sentences individually and modeling the relationship between…

Computation and Language · Computer Science 2020-04-21 Ming Zhong , Pengfei Liu , Yiran Chen , Danqing Wang , Xipeng Qiu , Xuanjing Huang

We develop an abstractive summarization framework independent of labeled data for multiple heterogeneous documents. Unlike existing multi-document summarization methods, our framework processes documents telling different stories instead of…

Computation and Language · Computer Science 2022-05-03 Ning Wang , Han Liu , Diego Klabjan

Fighting misinformation is a challenging, yet crucial, task. Despite the growing number of experts being involved in manual fact-checking, this activity is time-consuming and cannot keep up with the ever-increasing amount of Fake News…

Computation and Language · Computer Science 2023-08-30 Daniel Russo , Serra Sinem Tekiroglu , Marco Guerini

Through the advent of pre-trained language models, there have been notable advancements in abstractive summarization systems. Simultaneously, a considerable number of novel methods for evaluating factual consistency in abstractive…

Computation and Language · Computer Science 2024-10-03 Joonho Yang , Seunghyun Yoon , Byeongjeong Kim , Hwanhee Lee

Fact-checking real-world claims often requires reviewing multiple multimodal documents to assess a claim's truthfulness, which is a highly laborious and time-consuming task. In this paper, we present a summarization model designed to…

Artificial Intelligence · Computer Science 2024-09-23 Ting-Chih Chen , Chia-Wei Tang , Chris Thomas

Previous dialogue summarization techniques adapt large language models pretrained on the narrative text by injecting dialogue-specific features into the models. These features either require additional knowledge to recognize or make the…

Computation and Language · Computer Science 2022-04-29 Qi Jia , Yizhu Liu , Haifeng Tang , Kenny Q. Zhu

LLMs (Large Language Models) usually interact with users in the form of dialogue and generate responses following their instructions, which naturally require dialogue comprehension abilities. However, dialogue comprehension is a general…

Computation and Language · Computer Science 2024-04-02 Shuaijie She , Shujian Huang , Xingyun Wang , Yanke Zhou , Jiajun Chen

In this work, we model abstractive text summarization using Attentional Encoder-Decoder Recurrent Neural Networks, and show that they achieve state-of-the-art performance on two different corpora. We propose several novel models that…

Computation and Language · Computer Science 2016-08-29 Ramesh Nallapati , Bowen Zhou , Cicero Nogueira dos santos , Caglar Gulcehre , Bing Xiang

While large language models (LLMs) have proven to be effective on a large variety of tasks, they are also known to hallucinate information. To measure whether an LLM prefers factually consistent continuations of its input, we propose a new…

Computation and Language · Computer Science 2023-12-05 Derek Tam , Anisha Mascarenhas , Shiyue Zhang , Sarah Kwan , Mohit Bansal , Colin Raffel

Recently, compressive text summarisation offers a balance between the conciseness issue of extractive summarisation and the factual hallucination issue of abstractive summarisation. However, most existing compressive summarisation methods…

Computation and Language · Computer Science 2023-06-07 Peggy Tang , Junbin Gao , Lei Zhang , Zhiyong Wang

The scarcity of comprehensive up-to-date studies on evaluation metrics for text summarization and the lack of consensus regarding evaluation protocols continue to inhibit progress. We address the existing shortcomings of summarization…

Computation and Language · Computer Science 2021-02-03 Alexander R. Fabbri , Wojciech Kryściński , Bryan McCann , Caiming Xiong , Richard Socher , Dragomir Radev

Cutting-edge abstractive summarisers generate fluent summaries, but the factuality of the generated text is not guaranteed. Early summary factuality evaluation metrics are usually based on n-gram overlap and embedding similarity, but are…

Computation and Language · Computer Science 2024-09-24 Yuxuan Ye , Edwin Simpson , Raul Santos Rodriguez

Pre-trained sequence-to-sequence (seq-to-seq) models have significantly improved the accuracy of several language generation tasks, including abstractive summarization. Although the fluency of abstractive summarization has been greatly…

Computation and Language · Computer Science 2020-03-31 Itsumi Saito , Kyosuke Nishida , Kosuke Nishida , Junji Tomita

Existing factual consistency evaluation approaches for text summarization provide binary predictions and limited insights into the weakness of summarization systems. Therefore, we propose the task of fine-grained inconsistency detection,…

Computation and Language · Computer Science 2023-05-25 Hou Pong Chan , Qi Zeng , Heng Ji

No existing dataset adequately tests how well language models can incrementally update entity summaries - a crucial ability as these models rapidly advance. The Incremental Entity Summarization (IES) task is vital for maintaining accurate,…

Computation and Language · Computer Science 2024-06-10 Eunjeong Hwang , Yichao Zhou , Beliz Gunel , James Bradley Wendt , Sandeep Tata

Under special circumstances, summaries should conform to a particular style with patterns, such as court judgments and abstracts in academic papers. To this end, the prototype document-summary pairs can be utilized to generate better…

Computation and Language · Computer Science 2019-09-20 Shen Gao , Xiuying Chen , Piji Li , Zhangming Chan , Dongyan Zhao , Rui Yan

Despite being able to generate fluent and grammatical text, current Seq2Seq summarization models still suffering from the unfaithful generation problem. In this paper, we study the faithfulness of existing systems from a new perspective of…

Computation and Language · Computer Science 2022-11-02 Wenhao Wu , Wei Li , Jiachen Liu , Xinyan Xiao , Ziqiang Cao , Sujian Li , Hua Wu

Due to the exponential growth of information and the need for efficient information consumption the task of summarization has gained paramount importance. Evaluating summarization accurately and objectively presents significant challenges,…

Computation and Language · Computer Science 2024-12-31 Dong Yuan , Eti Rastogi , Fen Zhao , Sagar Goyal , Gautam Naik , Sree Prasanna Rajagopal

The use of large language models (LLMs) has significantly increased since the introduction of ChatGPT in 2022, demonstrating their value across various applications. However, a major challenge for enterprise and commercial adoption of LLMs…

Computation and Language · Computer Science 2024-08-28 N. E. Kriman

Document summarization condenses a long document into a short version with salient information and accurate semantic descriptions. The main issue is how to make the output summary semantically consistent with the input document. To reach…

Computation and Language · Computer Science 2022-04-01 Mingyang Song , Liping Jing