English
Related papers

Related papers: BottleSum: Unsupervised and Self-supervised Senten…

200 papers

We propose an unsupervised method to extract keywords and keyphrases from texts based on a pre-trained language model (LM) and Shannon's information maximization. Specifically, our method extracts phrases having the highest conditional…

Computation and Language · Computer Science 2023-08-31 Alexander Tsvetkov , Alon Kipnis

Unsupervised document summarization has re-acquired lots of attention in recent years thanks to its simplicity and data independence. In this paper, we propose a graph-based unsupervised approach for extractive document summarization.…

Computation and Language · Computer Science 2021-04-23 Haopeng Zhang , Jiawei Zhang

Summarization based on text extraction is inherently limited, but generation-style abstractive methods have proven challenging to build. In this work, we propose a fully data-driven approach to abstractive sentence summarization. Our method…

Computation and Language · Computer Science 2015-09-04 Alexander M. Rush , Sumit Chopra , Jason Weston

Text summarization aims to extract essential information from a piece of text and transform the text into a concise version. Existing unsupervised abstractive summarization models leverage recurrent neural networks framework while the…

Computation and Language · Computer Science 2020-10-20 Ziyi Yang , Chenguang Zhu , Robert Gmyr , Michael Zeng , Xuedong Huang , Eric Darve

A typical product or place often has hundreds of reviews, and summarization of these texts is an important and challenging problem. Recent progress on abstractive summarization in domains such as news has been driven by supervised systems…

Computation and Language · Computer Science 2022-12-22 Annie Louis , Joshua Maynez

Extractive text summarisation aims to select salient sentences from a document to form a short yet informative summary. While learning-based methods have achieved promising results, they have several limitations, such as dependence on…

Computation and Language · Computer Science 2022-04-22 Peggy Tang , Kun Hu , Rui Yan , Lei Zhang , Junbin Gao , Zhiyong Wang

Text summarization condenses a text to a shorter version while retaining the important informations. Abstractive summarization is a recent development that generates new phrases, rather than simply copying or rephrasing sentences within the…

Computation and Language · Computer Science 2018-02-06 André Cibils , Claudiu Musat , Andreea Hossman , Michael Baeriswyl

Extractive opinion summarization involves automatically producing a summary of text about an entity (e.g., a product's reviews) by extracting representative sentences that capture prevalent opinions in the review set. Typically, in online…

Computation and Language · Computer Science 2024-04-15 Somnath Basu Roy Chowdhury , Nicholas Monath , Avinava Dubey , Manzil Zaheer , Andrew McCallum , Amr Ahmed , Snigdha Chaturvedi

This paper presents a novel unsupervised abstractive summarization method for opinionated texts. While the basic variational autoencoder-based models assume a unimodal Gaussian prior for the latent code of sentences, we alternate it with a…

Computation and Language · Computer Science 2021-06-16 Masaru Isonuma , Junichiro Mori , Danushka Bollegala , Ichiro Sakata

Aligning sentences in a reference summary with their counterparts in source documents was shown as a useful auxiliary summarization task, notably for generating training data for salience detection. Despite its assessed utility, the…

Computation and Language · Computer Science 2021-09-27 Ori Ernst , Ori Shapira , Ramakanth Pasunuru , Michael Lepioshkin , Jacob Goldberger , Mohit Bansal , Ido Dagan

Contextualized word embeddings can lead to state-of-the-art performances in natural language understanding. Recently, a pre-trained deep contextualized text encoder such as BERT has shown its potential in improving natural language tasks…

Computation and Language · Computer Science 2022-09-02 Hyunjae Lee , Jaewoong Yun , Hyunjin Choi , Seongho Joe , Youngjune L. Gwon

We develop an abstractive summarization framework independent of labeled data for multiple heterogeneous documents. Unlike existing multi-document summarization methods, our framework processes documents telling different stories instead of…

Computation and Language · Computer Science 2022-05-03 Ning Wang , Han Liu , Diego Klabjan

Current neural network-based methods to the problem of document summarisation struggle when applied to datasets containing large inputs. In this paper we propose a new approach to the challenge of content-selection when dealing with…

Computation and Language · Computer Science 2025-05-07 Maciej Zembrzuski , Saad Mahamood

Current summarization systems yield generic summaries that are disconnected from users' preferences and expectations. To address this limitation, we present CTRLsum, a novel framework for controllable summarization. Our approach enables…

Computation and Language · Computer Science 2020-12-09 Junxian He , Wojciech Kryściński , Bryan McCann , Nazneen Rajani , Caiming Xiong

We propose an abstraction-based multi-document summarization framework that can construct new sentences by exploring more fine-grained syntactic units than sentences, namely, noun/verb phrases. Different from existing abstraction-based…

Computation and Language · Computer Science 2015-06-08 Lidong Bing , Piji Li , Yi Liao , Wai Lam , Weiwei Guo , Rebecca J. Passonneau

We investigate the unsupervised constituency parsing task, which organizes words and phrases of a sentence into a hierarchical structure without using linguistically annotated data. We observe that existing unsupervised parsers capture…

Computation and Language · Computer Science 2024-04-29 Behzad Shayegh , Yanshuai Cao , Xiaodan Zhu , Jackie C. K. Cheung , Lili Mou

Extractive summarization aims to form a summary by directly extracting sentences from the source document. Existing works mostly formulate it as a sequence labeling problem by making individual sentence label predictions. This paper…

Computation and Language · Computer Science 2023-05-12 Haopeng Zhang , Xiao Liu , Jiawei Zhang

As human society transitions into the information age, reduction in our attention span is a contingency, and people who spend time reading lengthy news articles are decreasing rapidly and the need for succinct information is higher than…

Computation and Language · Computer Science 2024-03-26 Aditya Saxena , Ashutosh Ranjan

Pre-trained language models (PLMs) have recently shown great success in text representation field. However, the high computational cost and high-dimensional representation of PLMs pose significant challenges for practical applications. To…

Computation and Language · Computer Science 2023-11-10 Yanzhao Zhang , Dingkun Long , Zehan Li , Pengjun Xie

Knowledge discovery from data is an inherently iterative process. That is, what we know about the data greatly determines our expectations, and therefore, what results we would find interesting and/or surprising. Given new knowledge about…

Data Structures and Algorithms · Computer Science 2019-04-30 Michael Mampaey , Jilles Vreeken , Nikolaj Tatti