English
Related papers

Related papers: Neural Abstractive Summarization with Structural A…

200 papers

We propose a method to create document representations that reflect their internal structure. We modify Tree-LSTMs to hierarchically merge basic elements such as words and sentences into blocks of increasing complexity. Our Structure…

Computation and Language · Computer Science 2019-10-08 Khalil Mrini , Claudiu Musat , Michael Baeriswyl , Martin Jaggi

Token representation strategies within large-scale neural architectures often rely on contextually refined embeddings, yet conventional approaches seldom encode structured relationships explicitly within token interactions. Self-attention…

Computation and Language · Computer Science 2025-03-27 James Blades , Frederick Somerfield , William Langley , Susan Everingham , Maurice Witherington

Sequence-to-sequence models for abstractive summarization have been studied extensively, yet the generated summaries commonly suffer from fabricated content, and are often found to be near-extractive. We argue that, to address these issues,…

Computation and Language · Computer Science 2020-05-05 Luyang Huang , Lingfei Wu , Lu Wang

We introduce a general framework for abstractive summarization with factual consistency and distinct modeling of the narrative flow in an output summary. Our work addresses current limitations of models for abstractive summarization that…

Computation and Language · Computer Science 2021-04-12 Saadia Gabriel , Antoine Bosselut , Jeff Da , Ari Holtzman , Jan Buys , Kyle Lo , Asli Celikyilmaz , Yejin Choi

Neural network-based approaches have become the driven forces for Natural Language Processing (NLP) tasks. Conventionally, there are two mainstream neural architectures for NLP tasks: the recurrent neural network (RNN) and the convolution…

Computation and Language · Computer Science 2020-08-13 Zhenyu Liu , Chaohong Lu , Haiwei Huang , Shengfei Lyu , Zhenchao Tao

Previous approaches for video summarization mainly concentrate on finding the most diverse and representative visual contents as video summary without considering the user's preference. This paper addresses the task of query-focused video…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Shuwen Xiao , Zhou Zhao , Zijian Zhang , Xiaohui Yan , Min Yang

Abstractive summarization at controllable lengths is a challenging task in natural language processing. It is even more challenging for domains where limited training data is available or scenarios in which the length of the summary is not…

Computation and Language · Computer Science 2020-12-01 Ritesh Sarkhel , Moniba Keymanesh , Arnab Nandi , Srinivasan Parthasarathy

Despite the success of attention-based neural models for natural language generation and classification tasks, they are unable to capture the discourse structure of larger documents. We hypothesize that explicit discourse representations…

Computation and Language · Computer Science 2019-11-19 Fajri Koto , Jey Han Lau , Timothy Baldwin

In this work, we study abstractive text summarization by exploring different models such as LSTM-encoder-decoder with attention, pointer-generator networks, coverage mechanisms, and transformers. Upon extensive and careful hyperparameter…

Computation and Language · Computer Science 2019-12-13 Soheil Esmaeilzadeh , Gao Xian Peh , Angela Xu

A major challenge to the problem of community question answering is the lexical and semantic gap between the sentence representations. Some solutions to minimize this gap includes the introduction of extra parameters to deep models or…

Computation and Language · Computer Science 2018-01-23 Gaurav Bhatt , Shivam Sharma , Balasubramanian Raman

Attention-based encoder-decoder neural network models have recently shown promising results in goal-oriented dialogue systems. However, these models struggle to reason over and incorporate state-full knowledge while preserving their…

Computation and Language · Computer Science 2020-01-29 Firas Kassawat , Debanjan Chaudhuri , Jens Lehmann

A system that could reliably identify and sum up the most important points of a conversation would be valuable in a wide variety of real-world contexts, from business meetings to medical consultations to customer service calls. Recent…

Computation and Language · Computer Science 2023-04-26 Virgile Rennard , Guokan Shang , Julie Hunter , Michalis Vazirgiannis

With the rising number of interconnected devices and sensors, modeling distributed sensor networks is of increasing interest. Recurrent neural networks (RNN) are considered particularly well suited for modeling sensory and streaming data.…

Machine Learning · Computer Science 2017-11-15 Stephan Baier , Sigurd Spieckermann , Volker Tresp

We propose a method for unsupervised opinion summarization that encodes sentences from customer reviews into a hierarchical discrete latent space, then identifies common opinions based on the frequency of their encodings. We are able to…

Computation and Language · Computer Science 2023-05-22 Tom Hosking , Hao Tang , Mirella Lapata

Query Focused Summarization (QFS) has been addressed mostly using extractive methods. Such methods, however, produce text which suffers from low coherence. We investigate how abstractive methods can be applied to QFS, to overcome such…

Computation and Language · Computer Science 2018-01-26 Tal Baumel , Matan Eyal , Michael Elhadad

Existing models based on artificial neural networks (ANNs) for sentence classification often do not incorporate the context in which sentences appear, and classify sentences individually. However, traditional sentence classification…

Computation and Language · Computer Science 2016-12-16 Franck Dernoncourt , Ji Young Lee , Peter Szolovits

Recently BERT has been adopted for document encoding in state-of-the-art text summarization models. However, sentence-based extractive models often result in redundant or uninformative phrases in the extracted summaries. Also, long-range…

Computation and Language · Computer Science 2020-04-28 Jiacheng Xu , Zhe Gan , Yu Cheng , Jingjing Liu

Like humans, document summarization models can interpret a document's contents in a number of ways. Unfortunately, the neural models of today are largely black boxes that provide little explanation of how or why they generated a summary in…

Computation and Language · Computer Science 2020-12-15 Wang Haonan , Gao Yang , Bai Yu , Mirella Lapata , Huang Heyan

Recurrent neural networks (RNNs) have shown the ability to improve scene parsing through capturing long-range dependencies among image units. In this paper, we propose dense RNNs for scene labeling by exploring various long-range semantic…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Heng Fan , Peng Chu , Longin Jan Latecki , Haibin Ling

Query suggestions help users of a search engine to refine their queries. Previous work on query suggestion has mainly focused on incorporating directly observable features such as query co-occurrence and semantic similarity. The structure…

Information Retrieval · Computer Science 2018-05-09 Wanyu Chen , Fei Cai , Honghui Chen , Maarten de Rijke