English
Related papers

Related papers: Evaluation of Automatic Text Summarization using S…

200 papers

Summarizing texts is not a straightforward task. Before even considering text summarization, one should determine what kind of summary is expected. How much should the information be compressed? Is it relevant to reformulate or should the…

Computation and Language · Computer Science 2020-07-16 Paul Tardy , David Janiszek , Yannick Estève , Vincent Nguyen

The performance of text summarization has been greatly boosted by pre-trained language models. A main concern of existing methods is that most generated summaries are not factually inconsistent with their source documents. To alleviate the…

Computation and Language · Computer Science 2023-04-14 Zheheng Luo , Qianqian Xie , Sophia Ananiadou

Fact-checking has become increasingly important due to the speed with which both information and misinformation can spread in the modern media ecosystem. Therefore, researchers have been exploring how fact-checking can be automated, using…

Computation and Language · Computer Science 2022-06-07 Zhijiang Guo , Michael Schlichtkrull , Andreas Vlachos

The amount of text data available online is increasing at a very fast pace hence text summarization has become essential. Most of the modern recommender and text classification systems require going through a huge amount of data. Manually…

Computation and Language · Computer Science 2021-08-03 Anushka Gupta , Diksha Chugh , Anjum , Rahul Katarya

Dialogue summarization is abstractive in nature, making it suffer from factual errors. The factual correctness of summaries has the highest priority before practical applications. Many efforts have been made to improve faithfulness in text…

Computation and Language · Computer Science 2022-10-24 Bin Wang , Chen Zhang , Yan Zhang , Yiming Chen , Haizhou Li

Sentence extraction based summarization methods has some limitations as it doesn't go into the semantics of the document. Also, it lacks the capability of sentence generation which is intuitive to humans. Here we present a novel method to…

Computation and Language · Computer Science 2014-06-06 Divyanshu Bhartiya , Ashudeep Singh

Evaluation of automatic video summaries is a challenging problem. In the past years, some evaluation methods are presented that utilize only a single feature like color feature to detect similarity between automatic video summaries and…

Computer Vision and Pattern Recognition · Computer Science 2016-04-20 Karim M. Mahmoud

Automatic summarization is the process of reducing a text document in order to generate a summary that retains the most important points of the original document. In this work, we study two problems - i) summarizing a text document as set…

Information Retrieval · Computer Science 2024-06-04 Jayaprakash Sundararaj

Automatic summarization is the process of shortening a set of textual data computationally, to create a subset (a summary) that represents the most important pieces of information in the original text. Existing summarization methods can be…

Computation and Language · Computer Science 2022-04-21 Meng Cao

Automatic text summarization, the automated process of shortening a text while reserving the main ideas of the document(s), is a critical research area in natural language processing. The aim of this literature review is to survey the…

Computation and Language · Computer Science 2018-04-13 Yue Dong

State-of-the-art summarization systems are trained and evaluated on massive datasets scraped from the web. Despite their prevalence, we know very little about the underlying characteristics (data noise, summarization complexity, etc.) of…

Computation and Language · Computer Science 2021-06-23 Priyam Tejaswin , Dhruv Naik , Pengfei Liu

In this paper, we propose FFCI, a framework for fine-grained summarization evaluation that comprises four elements: faithfulness (degree of factual consistency with the source), focus (precision of summary content relative to the…

Computation and Language · Computer Science 2022-03-01 Fajri Koto , Timothy Baldwin , Jey Han Lau

Many Natural Language Processing and Computational Linguistics applications involves the generation of new texts based on some existing texts, such as summarization, text simplification and machine translation. However, there has been a…

Computation and Language · Computer Science 2018-04-12 Ping Chen , Fei Wu , Tong Wang , Wei Ding

Reinforcement learning with evaluation metrics as rewards is widely used to enhance specific capabilities of language models. However, for tasks such as factually consistent summarisation, existing metrics remain underdeveloped, limiting…

Computation and Language · Computer Science 2026-05-27 Yuxuan Ye , Raul Santos-Rodriguez , Edwin Simpson

Automatic abstractive summaries are found to often distort or fabricate facts in the article. This inconsistency between summary and original text has seriously impacted its applicability. We propose a fact-aware summarization model FASum…

Computation and Language · Computer Science 2021-03-16 Chenguang Zhu , William Hinthorn , Ruochen Xu , Qingkai Zeng , Michael Zeng , Xuedong Huang , Meng Jiang

In this work, we present the results of a systematic study to investigate the (commercial) benefits of automatic text summarization systems in a real world scenario. More specifically, we define a use case in the context of media monitoring…

Computation and Language · Computer Science 2017-01-04 Pashutan Modaresi , Philipp Gross , Siavash Sefidrodi , Mirja Eckhof , Stefan Conrad

The scarcity of comprehensive up-to-date studies on evaluation metrics for text summarization and the lack of consensus regarding evaluation protocols continue to inhibit progress. We address the existing shortcomings of summarization…

Computation and Language · Computer Science 2021-02-03 Alexander R. Fabbri , Wojciech Kryściński , Bryan McCann , Caiming Xiong , Richard Socher , Dragomir Radev

Text summarization can be classified into two approaches: extraction and abstraction. This paper focuses on extraction approach. The goal of text summarization based on extraction approach is sentence selection. One of the methods to obtain…

Information Retrieval · Computer Science 2009-06-26 Ladda Suanmali , Naomie Salim , Mohammed Salem Binwahlan

Multimodal summarization aims to generate a concise summary based on the input text and image. However, the existing methods potentially suffer from unfactual output. To evaluate the factuality of multimodal summarization models, we propose…

Computation and Language · Computer Science 2025-12-01 Yue Zhang , Jingxuan Zuo , Ke Su , Liqiang Jing

Summarization is one of the key features of human intelligence. It plays an important role in understanding and representation. With rapid and continual expansion of texts, pictures and videos in cyberspace, automatic summarization becomes…

Computation and Language · Computer Science 2015-07-02 Hai Zhuge