中文
相关论文

相关论文: Unsupervised Reference-Free Summary Quality Evalua…

200 篇论文

Given a document and a target aspect (e.g., a topic of interest), aspect-based abstractive summarization attempts to generate a summary with respect to the aspect. Previous studies usually assume a small pre-defined set of aspects and fall…

计算与语言 · 计算机科学 2020-10-20 Bowen Tan , Lianhui Qin , Eric P. Xing , Zhiting Hu

We present RepRank, an unsupervised graph-based ranking model for extractive multi-document summarization in which the similarity between words, sentences, and word-to-sentence can be estimated by the distances between their vector…

计算与语言 · 计算机科学 2023-07-25 Zongyi Li , Xiaoqing Zheng , Jun He

Large Language Models (LLMs) have achieved state-of-the-art performance at zero-shot generation of abstractive summaries for given articles. However, little is known about the robustness of such a process of zero-shot summarization. To…

计算与语言 · 计算机科学 2025-02-04 Hadi Askari , Anshuman Chhabra , Muhao Chen , Prasant Mohapatra

Tremendous amounts of multimedia associated with speech information are driving an urgent need to develop efficient and effective automatic summarization methods. To this end, we have seen rapid progress in applying supervised deep neural…

计算与语言 · 计算机科学 2020-06-03 Shi-Yan Weng , Tien-Hong Lo , Berlin Chen

Despite some recent advances, automatic text summarization remains unreliable, elusive, and of limited practical use in applications. Two main problems with current summarization methods are well known: evaluation and factual consistency.…

计算与语言 · 计算机科学 2022-04-12 Jay Ahn , Foaad Khosmood

We consider the problem of automatically generating textual paraphrases with modified attributes or properties, focusing on the setting without parallel data (Hu et al., 2017; Shen et al., 2017). This setting poses challenges for…

计算与语言 · 计算机科学 2019-10-01 Richard Yuanzhe Pang , Kevin Gimpel

There has been substantial progress in summarization research enabled by the availability of novel, often large-scale, datasets and recent advances on neural network-based approaches. However, manual evaluation of the system generated…

计算与语言 · 计算机科学 2019-06-05 Hardy , Shashi Narayan , Andreas Vlachos

Aligning sentences in a reference summary with their counterparts in source documents was shown as a useful auxiliary summarization task, notably for generating training data for salience detection. Despite its assessed utility, the…

计算与语言 · 计算机科学 2021-09-27 Ori Ernst , Ori Shapira , Ramakanth Pasunuru , Michael Lepioshkin , Jacob Goldberger , Mohit Bansal , Ido Dagan

Opinion summarization is the task of automatically creating summaries that reflect subjective information expressed in multiple documents, such as product reviews. While the majority of previous work has focused on the extractive setting,…

计算与语言 · 计算机科学 2020-04-21 Arthur Bražinskas , Mirella Lapata , Ivan Titov

Unsupervised sentence embedding aims to obtain the most appropriate embedding for a sentence to reflect its semantic. Contrastive learning has been attracting developing attention. For a sentence, current models utilize diverse data…

计算与语言 · 计算机科学 2022-03-03 Hao Wang , Yangguang Li , Zhen Huang , Yong Dou , Lingpeng Kong , Jing Shao

Contrastive learning is a promising approach to unsupervised learning, as it inherits the advantages of well-studied deep models without a dedicated and complex model design. In this paper, based on bidirectional encoder representations…

计算与语言 · 计算机科学 2021-09-20 Haoxiang Shi , Cen Wang

Recently, compressive text summarisation offers a balance between the conciseness issue of extractive summarisation and the factual hallucination issue of abstractive summarisation. However, most existing compressive summarisation methods…

计算与语言 · 计算机科学 2023-06-07 Peggy Tang , Junbin Gao , Lei Zhang , Zhiyong Wang

Model-based, reference-free evaluation metrics have been proposed as a fast and cost-effective approach to evaluate Natural Language Generation (NLG) systems. Despite promising recent results, we find evidence that reference-free evaluation…

计算与语言 · 计算机科学 2022-04-22 Esin Durmus , Faisal Ladhak , Tatsunori Hashimoto

Smart word substitution aims to enhance sentence quality by improving word choices; however current benchmarks rely on human-labeled data. Since word choices are inherently subjective, ground-truth word substitutions generated by a small…

计算与语言 · 计算机科学 2025-02-18 Hongye Liu , Ricardo Henao

Current abstractive summarization systems present important weaknesses which prevent their deployment in real-world applications, such as the omission of relevant information and the generation of factual inconsistencies (also known as…

计算与语言 · 计算机科学 2022-11-08 Diogo Pernes , Afonso Mendes , André F. T. Martins

Unsupervised approaches to extractive summarization usually rely on a notion of sentence importance defined by the semantic similarity between a sentence and the document. We propose new metrics of relevance and redundancy using pointwise…

计算与语言 · 计算机科学 2021-03-24 Vishakh Padmakumar , He He

Automatic text summarization (ATS) has recently achieved impressive performance thanks to recent advances in deep learning and the availability of large-scale corpora. To make the summarization results more faithful, this paper presents an…

计算与语言 · 计算机科学 2019-10-15 Shengluan Hou , Ruqian Lu

In this paper, we introduce ChatCite, a novel method leveraging large language models (LLMs) for generating comparative literature summaries. The ability to summarize research papers with a focus on key comparisons between studies is an…

计算与语言 · 计算机科学 2024-12-04 Fernando Gabriela Garcia , Spencer Burns , Harrison Fuller

The quality of a summarization evaluation metric is quantified by calculating the correlation between its scores and human annotations across a large number of summaries. Currently, it is unclear how precise these correlation estimates are,…

计算与语言 · 计算机科学 2021-07-28 Daniel Deutsch , Rotem Dror , Dan Roth

Highlighting while reading is a natural behavior for people to track salient content of a document. It would be desirable to teach an extractive summarizer to do the same. However, a major obstacle to the development of a supervised…

计算与语言 · 计算机科学 2019-04-05 Kristjan Arumae , Fei Liu