English
Related papers

Related papers: Unsupervised Reference-Free Summary Quality Evalua…

200 papers

Given a document and a target aspect (e.g., a topic of interest), aspect-based abstractive summarization attempts to generate a summary with respect to the aspect. Previous studies usually assume a small pre-defined set of aspects and fall…

Computation and Language · Computer Science 2020-10-20 Bowen Tan , Lianhui Qin , Eric P. Xing , Zhiting Hu

We present RepRank, an unsupervised graph-based ranking model for extractive multi-document summarization in which the similarity between words, sentences, and word-to-sentence can be estimated by the distances between their vector…

Computation and Language · Computer Science 2023-07-25 Zongyi Li , Xiaoqing Zheng , Jun He

Large Language Models (LLMs) have achieved state-of-the-art performance at zero-shot generation of abstractive summaries for given articles. However, little is known about the robustness of such a process of zero-shot summarization. To…

Computation and Language · Computer Science 2025-02-04 Hadi Askari , Anshuman Chhabra , Muhao Chen , Prasant Mohapatra

Tremendous amounts of multimedia associated with speech information are driving an urgent need to develop efficient and effective automatic summarization methods. To this end, we have seen rapid progress in applying supervised deep neural…

Computation and Language · Computer Science 2020-06-03 Shi-Yan Weng , Tien-Hong Lo , Berlin Chen

Despite some recent advances, automatic text summarization remains unreliable, elusive, and of limited practical use in applications. Two main problems with current summarization methods are well known: evaluation and factual consistency.…

Computation and Language · Computer Science 2022-04-12 Jay Ahn , Foaad Khosmood

We consider the problem of automatically generating textual paraphrases with modified attributes or properties, focusing on the setting without parallel data (Hu et al., 2017; Shen et al., 2017). This setting poses challenges for…

Computation and Language · Computer Science 2019-10-01 Richard Yuanzhe Pang , Kevin Gimpel

There has been substantial progress in summarization research enabled by the availability of novel, often large-scale, datasets and recent advances on neural network-based approaches. However, manual evaluation of the system generated…

Computation and Language · Computer Science 2019-06-05 Hardy , Shashi Narayan , Andreas Vlachos

Aligning sentences in a reference summary with their counterparts in source documents was shown as a useful auxiliary summarization task, notably for generating training data for salience detection. Despite its assessed utility, the…

Computation and Language · Computer Science 2021-09-27 Ori Ernst , Ori Shapira , Ramakanth Pasunuru , Michael Lepioshkin , Jacob Goldberger , Mohit Bansal , Ido Dagan

Opinion summarization is the task of automatically creating summaries that reflect subjective information expressed in multiple documents, such as product reviews. While the majority of previous work has focused on the extractive setting,…

Computation and Language · Computer Science 2020-04-21 Arthur Bražinskas , Mirella Lapata , Ivan Titov

Unsupervised sentence embedding aims to obtain the most appropriate embedding for a sentence to reflect its semantic. Contrastive learning has been attracting developing attention. For a sentence, current models utilize diverse data…

Computation and Language · Computer Science 2022-03-03 Hao Wang , Yangguang Li , Zhen Huang , Yong Dou , Lingpeng Kong , Jing Shao

Contrastive learning is a promising approach to unsupervised learning, as it inherits the advantages of well-studied deep models without a dedicated and complex model design. In this paper, based on bidirectional encoder representations…

Computation and Language · Computer Science 2021-09-20 Haoxiang Shi , Cen Wang

Recently, compressive text summarisation offers a balance between the conciseness issue of extractive summarisation and the factual hallucination issue of abstractive summarisation. However, most existing compressive summarisation methods…

Computation and Language · Computer Science 2023-06-07 Peggy Tang , Junbin Gao , Lei Zhang , Zhiyong Wang

Model-based, reference-free evaluation metrics have been proposed as a fast and cost-effective approach to evaluate Natural Language Generation (NLG) systems. Despite promising recent results, we find evidence that reference-free evaluation…

Computation and Language · Computer Science 2022-04-22 Esin Durmus , Faisal Ladhak , Tatsunori Hashimoto

Smart word substitution aims to enhance sentence quality by improving word choices; however current benchmarks rely on human-labeled data. Since word choices are inherently subjective, ground-truth word substitutions generated by a small…

Computation and Language · Computer Science 2025-02-18 Hongye Liu , Ricardo Henao

Current abstractive summarization systems present important weaknesses which prevent their deployment in real-world applications, such as the omission of relevant information and the generation of factual inconsistencies (also known as…

Computation and Language · Computer Science 2022-11-08 Diogo Pernes , Afonso Mendes , André F. T. Martins

Unsupervised approaches to extractive summarization usually rely on a notion of sentence importance defined by the semantic similarity between a sentence and the document. We propose new metrics of relevance and redundancy using pointwise…

Computation and Language · Computer Science 2021-03-24 Vishakh Padmakumar , He He

Automatic text summarization (ATS) has recently achieved impressive performance thanks to recent advances in deep learning and the availability of large-scale corpora. To make the summarization results more faithful, this paper presents an…

Computation and Language · Computer Science 2019-10-15 Shengluan Hou , Ruqian Lu

In this paper, we introduce ChatCite, a novel method leveraging large language models (LLMs) for generating comparative literature summaries. The ability to summarize research papers with a focus on key comparisons between studies is an…

Computation and Language · Computer Science 2024-12-04 Fernando Gabriela Garcia , Spencer Burns , Harrison Fuller

The quality of a summarization evaluation metric is quantified by calculating the correlation between its scores and human annotations across a large number of summaries. Currently, it is unclear how precise these correlation estimates are,…

Computation and Language · Computer Science 2021-07-28 Daniel Deutsch , Rotem Dror , Dan Roth

Highlighting while reading is a natural behavior for people to track salient content of a document. It would be desirable to teach an extractive summarizer to do the same. However, a major obstacle to the development of a supervised…

Computation and Language · Computer Science 2019-04-05 Kristjan Arumae , Fei Liu