English
Related papers

Related papers: An Automated Length-Aware Quality Metric for Summa…

200 papers

With more and more advanced data analysis techniques emerging, people will expect these techniques to be applied in more complex tasks and solve problems in our daily lives. Text Summarization is one of famous applications in Natural…

Computation and Language · Computer Science 2024-02-13 Chen Jia-Chen , Guillem Senabre , Allane Caron

Automatic text summarization aims to cut down readers time and cognitive effort by reducing the content of a text document without compromising on its essence. Ergo, informativeness is the prime attribute of document summary generated by an…

Information Retrieval · Computer Science 2021-10-01 Alka Khurana , Vasudha Bhatnagar

We propose an abstraction-based multi-document summarization framework that can construct new sentences by exploring more fine-grained syntactic units than sentences, namely, noun/verb phrases. Different from existing abstraction-based…

Computation and Language · Computer Science 2015-06-08 Lidong Bing , Piji Li , Yi Liao , Wai Lam , Weiwei Guo , Rebecca J. Passonneau

Semantic annotations have to satisfy quality constraints to be useful for digital libraries, which is particularly challenging on large and diverse datasets. Confidence scores of multi-label classification methods typically refer only to…

Information Retrieval · Computer Science 2018-06-08 Martin Toepfer , Christin Seifert

We present BLANC, a new approach to the automatic estimation of document summary quality. Our goal is to measure the functional performance of a summary with an objective, reproducible, and fully automated method. Our approach achieves this…

Computation and Language · Computer Science 2020-11-13 Oleg Vasilyev , Vedant Dharnidharka , John Bohannon

A basic information theoretic model for summarization is formulated. Here summarization is considered as the process of taking a report of $v$ binary objects, and producing from it a $j$ element subset that captures most of the important…

Information Theory · Computer Science 2019-01-21 Eric Graves , Qiang Ning , Prithwish Basu

The quality of a summarization evaluation metric is quantified by calculating the correlation between its scores and human annotations across a large number of summaries. Currently, it is unclear how precise these correlation estimates are,…

Computation and Language · Computer Science 2021-07-28 Daniel Deutsch , Rotem Dror , Dan Roth

Text summarization aims to condense long documents and retain key information. Critical to the success of a summarization model is the faithful inference of latent representations of words or tokens in the source documents. Most recent…

Computation and Language · Computer Science 2022-03-16 Bo Pang , Erik Nijkamp , Wojciech Kryściński , Silvio Savarese , Yingbo Zhou , Caiming Xiong

Although the problem of automatic video summarization has recently received a lot of attention, the problem of creating a video summary that also highlights elements relevant to a search query has been less studied. We address this problem…

Computer Vision and Pattern Recognition · Computer Science 2017-09-29 Arun Balajee Vasudevan , Michael Gygli , Anna Volokitin , Luc Van Gool

Fixed length summarization aims at generating summaries with a preset number of words or characters. Most recent researches incorporate length information with word embeddings as the input to the recurrent decoding unit, causing a…

Computation and Language · Computer Science 2021-06-02 Zhongyi Yu , Zhenghao Wu , Hao Zheng , Zhe XuanYuan , Jefferson Fong , Weifeng Su

Video summarization is a technique to create a short skim of the original video while preserving the main stories/content. There exists a substantial interest in automatizing this process due to the rapid growth of the available material.…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Mayu Otani , Yuta Nakashima , Esa Rahtu , Janne Heikkilä

Assessing the quality of natural language generation systems through human annotation is very expensive. Additionally, human annotation campaigns are time-consuming and include non-reusable human labour. In practice, researchers rely on…

Computation and Language · Computer Science 2022-03-28 Pierre Colombo , Chloe Clavel , Pablo Piantanida

The ability to compress observational data and accurately estimate physical parameters relies heavily on informative summary statistics. In this paper, we introduce the use of mutual information (MI) as a means of evaluating the quality of…

Cosmology and Nongalactic Astrophysics · Physics 2023-07-12 Ce Sui , Xiaosheng Zhao , Tao Jing , Yi Mao

Evaluating multi-document summarization (MDS) quality is difficult. This is especially true in the case of MDS for biomedical literature reviews, where models must synthesize contradicting evidence reported across different documents. Prior…

Computation and Language · Computer Science 2023-05-24 Lucy Lu Wang , Yulia Otmakhova , Jay DeYoung , Thinh Hung Truong , Bailey E. Kuehl , Erin Bransom , Byron C. Wallace

This paper proposes a medical text summarization method based on LongFormer, aimed at addressing the challenges faced by existing models when processing long medical texts. Traditional summarization methods are often limited by short-term…

Computation and Language · Computer Science 2025-03-11 Dan Sun , Jacky He , Hanlu Zhang , Zhen Qi , Hongye Zheng , Xiaokai Wang

Reliable evaluation of large language model (LLM)-generated summaries remains an open challenge, particularly across heterogeneous domains and document lengths. We conduct a comprehensive meta-evaluation of 14 automatic summarization…

Computation and Language · Computer Science 2026-04-29 Huyen Nguyen , Haoxuan Zhang , Yang Zhang , Junhua Ding , Haihua Chen

Online information has increased tremendously in today's age of Internet. As a result, the need has arose to extract relevant content from the plethora of available information. Researchers are widely using automatic text summarization…

Social and Information Networks · Computer Science 2021-06-02 Mohd Khizir Siddiqui , Amreen Ahmad , Om Pal , Tanvir Ahmad

In this article is analyzed technology of automatic text abstracting and annotation. The role of annotation in automatic search and classification for different scientific articles is described. The algorithm of summarization of natural…

Computation and Language · Computer Science 2019-05-08 Nataliya Shakhovska , Taras Cherna

Recent work in the field of automatic summarization and headline generation focuses on maximizing ROUGE scores for various news datasets. We present an alternative, extrinsic, evaluation metric for this task, Answering Performance for…

Computation and Language · Computer Science 2019-06-04 Matan Eyal , Tal Baumel , Michael Elhadad

Controlling the length of generated text can be crucial in various text-generation tasks, including summarization. Existing methods often require complex model alterations, limiting compatibility with pre-trained models. We address these…

Computation and Language · Computer Science 2025-06-06 Zeno Belligoli , Emmanouil Stergiadis , Eran Fainman , Ilya Gusev