English
Related papers

Related papers: Recent Trends in Unsupervised Summarization

200 papers

Automatic text summarization has enjoyed great progress over the years and is used in numerous applications, impacting the lives of many. Despite this development, there is little research that meaningfully investigates how the current…

Computation and Language · Computer Science 2022-05-02 Maartje ter Hoeve , Julia Kiseleva , Maarten de Rijke

Zero-shot learning is the problem of predicting instances over classes not seen during training. One approach to zero-shot learning is providing auxiliary class information to the model. Prior work along this vein have largely used…

Machine Learning · Computer Science 2023-02-01 Austin W. Hanjie , Ameet Deshpande , Karthik Narasimhan

With the rise of task-specific pre-training objectives, abstractive summarization models like PEGASUS offer appealing zero-shot performance on downstream summarization tasks. However, the performance of such unsupervised models still lags…

Computation and Language · Computer Science 2024-11-15 Mathieu Ravaut , Shafiq Joty , Nancy Chen

The recent years have seen remarkable success in the use of deep neural networks on text summarization. However, there is no clear understanding of \textit{why} they perform so well, or \textit{how} they might be improved. In this paper, we…

Computation and Language · Computer Science 2019-07-09 Ming Zhong , Pengfei Liu , Danqing Wang , Xipeng Qiu , Xuanjing Huang

Unsupervised pre-training and transfer learning are commonly used techniques to initialize training algorithms for neural networks, particularly in settings with limited labeled data. In this paper, we study the effects of unsupervised…

Machine Learning · Statistics 2025-06-12 Taj Jones-McCormick , Aukosh Jagannath , Subhabrata Sen

Deep neural networks are typically trained under a supervised learning framework where a model learns a single task using labeled data. Instead of relying solely on labeled data, practitioners can harness unlabeled or related data to…

Machine Learning · Computer Science 2020-07-03 Huanru Henry Mao

Machine unlearning, a process enabling pre-trained models to remove the influence of specific training samples, has attracted significant attention in recent years. Although extensive research has focused on developing efficient machine…

Machine Learning · Computer Science 2026-01-13 Heng Xu , Tianqing Zhu , Dayong Ye , Lefeng Zhang , Le Wang , Wanlei Zhou

The amount of text data available online is increasing at a very fast pace hence text summarization has become essential. Most of the modern recommender and text classification systems require going through a huge amount of data. Manually…

Computation and Language · Computer Science 2021-08-03 Anushka Gupta , Diksha Chugh , Anjum , Rahul Katarya

Automatic text summarization has been widely studied as an important task in natural language processing. Traditionally, various feature engineering and machine learning based systems have been proposed for extractive as well as abstractive…

Computation and Language · Computer Science 2021-01-12 Sayar Ghosh Roy , Nikhil Pinnaparaju , Risubh Jain , Manish Gupta , Vasudeva Varma

Automatic summarization of natural language is a current topic in computer science research and industry, studied for decades because of its usefulness across multiple domains. For example, summarization is necessary to create reviews such…

Computation and Language · Computer Science 2018-12-31 Marc Everett Johnson

Relation extraction (RE) models have been challenged by their reliance on training data with expensive annotations. Considering that summarization tasks aim at acquiring concise expressions of synoptical information from the longer context,…

Computation and Language · Computer Science 2022-10-24 Keming Lu , I-Hung Hsu , Wenxuan Zhou , Mingyu Derek Ma , Muhao Chen

Text summarization is a user-preference based task, i.e., for one document, users often have different priorities for summary. As a key aspect of customization in summarization, granularity is used to measure the semantic coverage between…

Computation and Language · Computer Science 2022-12-15 Ming Zhong , Yang Liu , Suyu Ge , Yuning Mao , Yizhu Jiao , Xingxing Zhang , Yichong Xu , Chenguang Zhu , Michael Zeng , Jiawei Han

Unsupervised embedding learning aims to extract good representation from data without the need for any manual labels, which has been a critical challenge in many supervised learning tasks. This paper proposes a new unsupervised embedding…

Machine Learning · Computer Science 2020-02-28 Sungwon Han , Yizhan Xu , Sungwon Park , Meeyoung Cha , Cheng-Te Li

This paper focuses on the end-to-end abstractive summarization of a single product review without supervision. We assume that a review can be described as a discourse tree, in which the summary is the root, and the child sentences explain…

Computation and Language · Computer Science 2019-06-14 Masaru Isonuma , Junichiro Mori , Ichiro Sakata

Automated source code summarization is a task that generates summarized information about the purpose, usage, and--or implementation of methods and classes to support understanding of these code entities. Multiple approaches and techniques…

Software Engineering · Computer Science 2021-11-30 AmirHossein Naghshzan , Latifa Guerrouj , Olga Baysal

Long documents such as academic articles and business reports have been the standard format to detail out important issues and complicated subjects that require extra attention. An automatic summarization system that can effectively…

Computation and Language · Computer Science 2022-07-05 Huan Yee Koh , Jiaxin Ju , Ming Liu , Shirui Pan

Opinion summarization is expected to digest larger review sets and provide summaries from different perspectives. However, most existing solutions are deficient in epitomizing extensive reviews and offering opinion summaries from various…

Computation and Language · Computer Science 2023-10-23 Han Jiang , Rui Wang , Zhihua Wei , Yu Li , Xinpeng Wang

Document Summarization is the procedure of generating a meaningful and concise summary of a given document with the inclusion of relevant and topic-important points. There are two approaches: one is picking up the most relevant statements…

Computation and Language · Computer Science 2023-01-19 Siddhant Porwal , Laxmi Bewoor , Vivek Deshpande

A typical product or place often has hundreds of reviews, and summarization of these texts is an important and challenging problem. Recent progress on abstractive summarization in domains such as news has been driven by supervised systems…

Computation and Language · Computer Science 2022-12-22 Annie Louis , Joshua Maynez

Single document summarization has enjoyed renewed interests in recent years thanks to the popularity of neural network models and the availability of large-scale datasets. In this paper we develop an unsupervised approach arguing that it is…

Computation and Language · Computer Science 2019-06-11 Hao Zheng , Mirella Lapata