English
Related papers

Related papers: TED: A Pretrained Unsupervised Summarization Model…

200 papers

Neural text-to-speech (TTS) models can synthesize natural human speech when trained on large amounts of transcribed speech. However, collecting such large-scale transcribed data is expensive. This paper proposes an unsupervised pre-training…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-29 Seongyeon Park , Myungseo Song , Bohyung Kim , Tae-Hyun Oh

As the number of documents on the web is growing exponentially, multi-document summarization is becoming more and more important since it can provide the main ideas in a document set in short time. In this paper, we present an unsupervised…

Computation and Language · Computer Science 2018-06-12 Kaustubh Mani , Ishan Verma , Hardik Meisheri , Lipika Dey

We address the problem of abstractive summarization in two directions: proposing a novel dataset and a new model. First, we collect Reddit TIFU dataset, consisting of 120K posts from the online discussion forum Reddit. We use such informal…

Computation and Language · Computer Science 2019-04-10 Byeongchang Kim , Hyunwoo Kim , Gunhee Kim

Word embedding methods revolve around learning continuous distributed vector representations of words with neural networks, which can capture semantic and/or syntactic cues, and in turn be used to induce similarity measures among words,…

Computation and Language · Computer Science 2016-07-25 Kuan-Yu Chen , Shih-Hung Liu , Berlin Chen , Hsin-Min Wang , Hsin-Hsi Chen

In recent years, automatic text summarization has witnessed significant advancement, particularly with the development of transformer-based models. However, the challenge of controlling the readability level of generated summaries remains…

Computation and Language · Computer Science 2025-03-17 Mehmet Samet Duran , Tevfik Aytekin

Language model (LM) pre-training has resulted in impressive performance and sample efficiency on a variety of language understanding tasks. However, it remains unclear how to best use pre-trained LMs for generation tasks such as abstractive…

Computation and Language · Computer Science 2019-05-23 Urvashi Khandelwal , Kevin Clark , Dan Jurafsky , Lukasz Kaiser

Recent progress of abstractive text summarization largely relies on large pre-trained sequence-to-sequence Transformer models, which are computationally expensive. This paper aims to distill these large models into smaller ones for faster…

Computation and Language · Computer Science 2022-03-02 Shengqiang Zhang , Xingxing Zhang , Hangbo Bao , Furu Wei

We propose a new framework for abstractive text summarization based on a sequence-to-sequence oriented encoder-decoder model equipped with a deep recurrent generative decoder (DRGN). Latent structure information implied in the target…

Computation and Language · Computer Science 2017-08-03 Piji Li , Wai Lam , Lidong Bing , Zihao Wang

The proliferation of video content on platforms like YouTube and Vimeo presents significant challenges in efficiently locating relevant information. Automatic video summarization aims to address this by extracting and presenting key content…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Jia-Hong Huang

Attention-based neural abstractive summarization systems equipped with copy mechanisms have shown promising results. Despite this success, it has been noticed that such a system generates a summary by mostly, if not entirely, copying over…

Computation and Language · Computer Science 2018-03-21 Noah Weber , Leena Shekhar , Niranjan Balasubramanian , Kyunghyun Cho

Opinion summarization is the task of automatically generating summaries for a set of reviews about a specific target (e.g., a movie or a product). Since the number of reviews for each target can be prohibitively large, neural network-based…

Computation and Language · Computer Science 2021-01-25 Reinald Kim Amplayo , Mirella Lapata

Automatic sentence summarization produces a shorter version of a sentence, while preserving its most important information. A good summary is characterized by language fluency and high information overlap with the source sentence. We model…

Computation and Language · Computer Science 2020-05-06 Raphael Schumann , Lili Mou , Yao Lu , Olga Vechtomova , Katja Markert

Cross-lingual text summarization aims at generating a document summary in one language given input in another language. It is a practically important but under-explored task, primarily due to the dearth of available data. Existing methods…

Computation and Language · Computer Science 2020-06-30 Zi-Yi Dou , Sachin Kumar , Yulia Tsvetkov

We propose a selective encoding model to extend the sequence-to-sequence framework for abstractive sentence summarization. It consists of a sentence encoder, a selective gate network, and an attention equipped decoder. The sentence encoder…

Computation and Language · Computer Science 2017-07-31 Qingyu Zhou , Nan Yang , Furu Wei , Ming Zhou

Text segmentation aims to divide text into contiguous, semantically coherent segments, while segment labeling deals with producing labels for each segment. Past work has shown success in tackling segmentation and labeling for documents and…

Computation and Language · Computer Science 2022-09-29 Hakan Inan , Rashi Rungta , Yashar Mehdad

Authors' keyphrases assigned to scientific articles are essential for recognizing content and topic aspects. Most of the proposed supervised and unsupervised methods for keyphrase generation are unable to produce terms that are valuable but…

Computation and Language · Computer Science 2019-08-22 Erion Çano , Ondřej Bojar

Fine-tuning pretrained models for automatically summarizing doctor-patient conversation transcripts presents many challenges: limited training data, significant domain shift, long and noisy transcripts, and high target summary variability.…

This paper creates a paradigm shift with regard to the way we build neural extractive summarization systems. Instead of following the commonly used framework of extracting sentences individually and modeling the relationship between…

Computation and Language · Computer Science 2020-04-21 Ming Zhong , Pengfei Liu , Yiran Chen , Danqing Wang , Xipeng Qiu , Xuanjing Huang

Video summarization is a crucial technique for social understanding, enabling efficient browsing of massive multimedia content and extraction of key information from social platforms. Most existing unsupervised summarization methods rely on…

Artificial Intelligence · Computer Science 2026-01-22 Haizhou Liu , Haodong Jin , Yiming Wang , Hui Yu

Abstractive summarization, the task of generating a concise summary of input documents, requires: (1) reasoning over the source document to determine the salient pieces of information scattered across the long document, and (2) composing a…