English
Related papers

Related papers: Improving Sentence Similarity Estimation for Unsup…

200 papers

We propose DeepChannel, a robust, data-efficient, and interpretable neural model for extractive document summarization. Given any document-summary pair, we estimate a salience score, which is modeled using an attention-based deep neural…

Computation and Language · Computer Science 2018-11-08 Jiaxin Shi , Chen Liang , Lei Hou , Juanzi Li , Zhiyuan Liu , Hanwang Zhang

There have been several efforts to extend distributional semantics beyond individual words, to measure the similarity of word pairs, phrases, and sentences (briefly, tuples; ordered sets of words, contiguous or noncontiguous). One way to…

Machine Learning · Computer Science 2013-10-21 Peter D. Turney

Abstractive text summarization is a highly difficult problem, and the sequence-to-sequence model has shown success in improving the performance on the task. However, the generated summaries are often inconsistent with the source content in…

Computation and Language · Computer Science 2018-05-11 Bingzhen Wei , Xuancheng Ren , Xu Sun , Yi Zhang , Xiaoyan Cai , Qi Su

We explore semantic correspondence estimation through the lens of unsupervised learning. We thoroughly evaluate several recently proposed unsupervised methods across multiple challenging datasets using a standardized evaluation protocol…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Mehmet Aygün , Oisin Mac Aodha

Text summarization and text simplification are two major ways to simplify the text for poor readers, including children, non-native speakers, and the functionally illiterate. Text summarization is to produce a brief summary of the main…

Computation and Language · Computer Science 2017-10-09 Shuming Ma , Xu Sun

We present a novel iterative, edit-based approach to unsupervised sentence simplification. Our model is guided by a scoring function involving fluency, simplicity, and meaning preservation. Then, we iteratively perform word and phrase-level…

Computation and Language · Computer Science 2020-06-18 Dhruv Kumar , Lili Mou , Lukasz Golab , Olga Vechtomova

Learning semantically meaningful sentence embeddings is an open problem in natural language processing. In this work, we propose a sentence embedding learning approach that exploits both visual and textual information via a multimodal…

Computation and Language · Computer Science 2022-04-26 Miaoran Zhang , Marius Mosbach , David Ifeoluwa Adelani , Michael A. Hedderich , Dietrich Klakow

Abstractive text summarization aims to shorten long text documents into a human readable form that contains the most important facts from the original document. However, the level of actual abstraction as measured by novel phrases that do…

Computation and Language · Computer Science 2018-08-27 Wojciech Kryściński , Romain Paulus , Caiming Xiong , Richard Socher

Traditional approaches to extractive summarization rely heavily on human-engineered features. In this work we propose a data-driven approach based on neural networks and continuous sentence features. We develop a general framework for…

Computation and Language · Computer Science 2016-07-04 Jianpeng Cheng , Mirella Lapata

Back-translation based approaches have recently lead to significant progress in unsupervised sequence-to-sequence tasks such as machine translation or style transfer. In this work, we extend the paradigm to the problem of learning a…

Computation and Language · Computer Science 2019-08-26 Yacine Jernite

We propose and study a novel supervised approach to learning statistical semantic relatedness models from subjectively annotated training examples. The proposed semantic model consists of parameterized co-occurrence statistics associated…

Computation and Language · Computer Science 2013-11-12 Ran El-Yaniv , David Yanay

We show that a simple unsupervised masking objective can approach near supervised performance on abstractive multi-document news summarization. Our method trains a state-of-the-art neural summarization model to predict the masked out source…

Computation and Language · Computer Science 2022-01-10 Nikolai Vogler , Songlin Li , Yujie Xu , Yujian Mi , Taylor Berg-Kirkpatrick

Attention mechanism plays a dominant role in the sequence generation models and has been used to improve the performance of machine translation and abstractive text summarization. Different from neural machine translation, in the task of…

Computation and Language · Computer Science 2020-04-09 Piji Li , Lidong Bing , Zhongyu Wei , Wai Lam

Recently, compressive text summarisation offers a balance between the conciseness issue of extractive summarisation and the factual hallucination issue of abstractive summarisation. However, most existing compressive summarisation methods…

Computation and Language · Computer Science 2023-06-07 Peggy Tang , Junbin Gao , Lei Zhang , Zhiyong Wang

Keyphrase extraction from a given document is the task of automatically extracting salient phrases that best describe the document. This paper proposes a novel unsupervised graph-based ranking method to extract high-quality phrases from a…

Information Retrieval · Computer Science 2022-01-27 Venktesh V , Mukesh Mohania , Vikram Goyal

This work presents a new approach to unsupervised abstractive summarization based on maximizing a combination of coverage and fluency for a given length constraint. It introduces a novel method that encourages the inclusion of key terms…

Computation and Language · Computer Science 2021-05-13 Philippe Laban , Andrew Hsi , John Canny , Marti A. Hearst

Sentence ordering is a general and critical task for natural language generation applications. Previous works have focused on improving its performance in an external, downstream task, such as multi-document summarization. Given its…

Computation and Language · Computer Science 2016-07-26 Xinchi Chen , Xipeng Qiu , Xuanjing Huang

Automatically highlighting words that cause semantic differences between two documents could be useful for a wide range of applications. We formulate recognizing semantic differences (RSD) as a token-level regression task and study three…

Computation and Language · Computer Science 2023-10-23 Jannis Vamvas , Rico Sennrich

Text clustering methods were traditionally incorporated into multi-document summarization (MDS) as a means for coping with considerable information repetition. Particularly, clusters were leveraged to indicate information saliency as well…

Computation and Language · Computer Science 2022-05-23 Ori Ernst , Avi Caciularu , Ori Shapira , Ramakanth Pasunuru , Mohit Bansal , Jacob Goldberger , Ido Dagan

Existing models for extractive summarization are usually trained from scratch with a cross-entropy loss, which does not explicitly capture the global context at the document level. In this paper, we aim to improve this task by introducing…

Computation and Language · Computer Science 2019-06-12 Hong Wang , Xin Wang , Wenhan Xiong , Mo Yu , Xiaoxiao Guo , Shiyu Chang , William Yang Wang