English
Related papers

Related papers: SUPERT: Towards New Frontiers in Unsupervised Eval…

200 papers

Automatic text summarization (ATS) has recently achieved impressive performance thanks to recent advances in deep learning and the availability of large-scale corpora. To make the summarization results more faithful, this paper presents an…

Computation and Language · Computer Science 2019-10-15 Shengluan Hou , Ruqian Lu

Contextualized word embeddings can lead to state-of-the-art performances in natural language understanding. Recently, a pre-trained deep contextualized text encoder such as BERT has shown its potential in improving natural language tasks…

Computation and Language · Computer Science 2022-09-02 Hyunjae Lee , Jaewoong Yun , Hyunjin Choi , Seongho Joe , Youngjune L. Gwon

Text summarizing is a critical Natural Language Processing (NLP) task with applications ranging from information retrieval to content generation. Large Language Models (LLMs) have shown remarkable promise in generating fluent abstractive…

Computation and Language · Computer Science 2025-03-03 Colleen Gilhuly , Haleh Shahzad

In recent times, extracting valuable information from large text is making significant progress. Especially in the current era of social media, people expect quick bites of information. Automatic text summarization seeks to tackle this by…

Computation and Language · Computer Science 2024-10-23 Sindhu Nair , Y. S. Rao , Radha Shankarmani

High-quality dialogue-summary paired data is expensive to produce and domain-sensitive, making abstractive dialogue summarization a challenging task. In this work, we propose the first unsupervised abstractive dialogue summarization model…

Computation and Language · Computer Science 2020-09-16 Xinyuan Zhang , Ruiyi Zhang , Manzil Zaheer , Amr Ahmed

Unsupervised extractive document summarization aims to select important sentences from a document without using labeled summaries during training. Existing methods are mostly graph-based with sentences as nodes and edge weights measured by…

Computation and Language · Computer Science 2021-12-14 Shusheng Xu , Xingxing Zhang , Yi Wu , Furu Wei , Ming Zhou

We present RepRank, an unsupervised graph-based ranking model for extractive multi-document summarization in which the similarity between words, sentences, and word-to-sentence can be estimated by the distances between their vector…

Computation and Language · Computer Science 2023-07-25 Zongyi Li , Xiaoqing Zheng , Jun He

Opinion summarization sets itself apart from other types of summarization tasks due to its distinctive focus on aspects and sentiments. Although certain automated evaluation methods like ROUGE have gained popularity, we have found them to…

Computation and Language · Computer Science 2023-11-14 Yuchen Shen , Xiaojun Wan

Automated summary quality assessment falls into two categories: reference-based and reference-free. Reference-based metrics, historically deemed more accurate due to the additional information provided by human-written references, are…

Artificial Intelligence · Computer Science 2023-11-28 Forrest Sheng Bao , Ruixuan Tu , Ge Luo , Yinfei Yang , Hebi Li , Minghui Qiu , Youbiao He , Cen Chen

We explore semantic correspondence estimation through the lens of unsupervised learning. We thoroughly evaluate several recently proposed unsupervised methods across multiple challenging datasets using a standardized evaluation protocol…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Mehmet Aygün , Oisin Mac Aodha

Despite recent advancements in automatic summarization, state-of-the-art models do not summarize all documents equally well, raising the question: why? While prior research has extensively analyzed summarization models, little attention has…

Computation and Language · Computer Science 2025-04-09 Steven Koniaev , Ori Ernst , Jackie Chi Kit Cheung

Contrastive learning models have achieved great success in unsupervised visual representation learning, which maximize the similarities between feature representations of different views of the same image, while minimize the similarities…

Computation and Language · Computer Science 2022-01-13 Shusheng Xu , Xingxing Zhang , Yi Wu , Furu Wei

Reference-based metrics such as ROUGE or BERTScore evaluate the content quality of a summary by comparing the summary to a reference. Ideally, this comparison should measure the summary's information quality by calculating how much…

Computation and Language · Computer Science 2020-10-26 Daniel Deutsch , Dan Roth

In text summarization, evaluating the efficacy of automatic metrics without human judgments has become recently popular. One exemplar work concludes that automatic metrics strongly disagree when ranking high-scoring summaries. In this…

Computation and Language · Computer Science 2020-11-10 Manik Bhandari , Pranav Gour , Atabak Ashfaq , Pengfei Liu

This paper presents Semantic SentenceRank (SSR), an unsupervised scheme for automatically ranking sentences in a single document according to their relative importance. In particular, SSR extracts essential words and phrases from a text…

Information Retrieval · Computer Science 2020-05-06 Hao Zhang , Jie Wang

Generating unbiased summaries in real-world settings such as political perspective summarization remains a crucial application of Large Language Models (LLMs). Yet, existing evaluation frameworks rely on traditional metrics for measuring…

Computation and Language · Computer Science 2025-06-23 Narutatsu Ri , Nicholas Deas , Kathleen McKeown

This work presents a new approach to unsupervised abstractive summarization based on maximizing a combination of coverage and fluency for a given length constraint. It introduces a novel method that encourages the inclusion of key terms…

Computation and Language · Computer Science 2021-05-13 Philippe Laban , Andrew Hsi , John Canny , Marti A. Hearst

Summarizing texts is not a straightforward task. Before even considering text summarization, one should determine what kind of summary is expected. How much should the information be compressed? Is it relevant to reformulate or should the…

Computation and Language · Computer Science 2020-07-16 Paul Tardy , David Janiszek , Yannick Estève , Vincent Nguyen

This paper focuses on the end-to-end abstractive summarization of a single product review without supervision. We assume that a review can be described as a discourse tree, in which the summary is the root, and the child sentences explain…

Computation and Language · Computer Science 2019-06-14 Masaru Isonuma , Junichiro Mori , Ichiro Sakata

We present a set of novel neural supervised and unsupervised approaches for determining the readability of documents. In the unsupervised setting, we leverage neural language models, whereas in the supervised setting, three different neural…

Computation and Language · Computer Science 2021-03-12 Matej Martinc , Senja Pollak , Marko Robnik-Šikonja