English
Related papers

Related papers: A Mixed Hierarchical Attention based Encoder-Decod…

200 papers

Generating a text abstract from a set of documents remains a challenging task. The neural encoder-decoder framework has recently been exploited to summarize single documents, but its success can in part be attributed to the availability of…

Computation and Language · Computer Science 2018-08-29 Logan Lebanoff , Kaiqiang Song , Fei Liu

In this work, we model abstractive text summarization using Attentional Encoder-Decoder Recurrent Neural Networks, and show that they achieve state-of-the-art performance on two different corpora. We propose several novel models that…

Computation and Language · Computer Science 2016-08-29 Ramesh Nallapati , Bowen Zhou , Cicero Nogueira dos santos , Caglar Gulcehre , Bing Xiang

Neural models have become successful at producing abstractive summaries that are human-readable and fluent. However, these models have two critical shortcomings: they often don't respect the facts that are either included in the source…

Computation and Language · Computer Science 2020-06-30 Beliz Gunel , Chenguang Zhu , Michael Zeng , Xuedong Huang

Abstractive text summarization aims at compressing the information of a long source document into a rephrased, condensed summary. Despite advances in modeling techniques, abstractive summarization models still suffer from several key…

Computation and Language · Computer Science 2021-02-17 Vidhisha Balachandran , Artidoro Pagnoni , Jay Yoon Lee , Dheeraj Rajagopal , Jaime Carbonell , Yulia Tsvetkov

In a world of proliferating data, the ability to rapidly summarize text is growing in importance. Automatic summarization of text can be thought of as a sequence to sequence problem. Another area of natural language processing that solves a…

Computation and Language · Computer Science 2018-10-23 Jacob Krantz , Jugal Kalita

In comparison to single-document summarization, abstractive Multi-Document Summarization (MDS) brings challenges on the representation and coverage of its lengthy and linked sources. This study develops a Parallel Hierarchical Transformer…

Computation and Language · Computer Science 2022-08-17 Ye Ma , Lu Zong

Clustering of mixed-type datasets can be a particularly challenging task as it requires taking into account the associations between variables with different level of measurement, i.e., nominal, ordinal and/or interval. In some cases,…

Methodology · Statistics 2022-04-22 Odysseas Moschidis , Angelos Markos , Theodore Chadjipadelis

Existing neural generation approaches create multi-sentence text as a single sequence. In this paper we propose a structured convolutional decoder that is guided by the content structure of target summaries. We compare our model with…

Computation and Language · Computer Science 2019-06-12 Laura Perez-Beltrachini , Yang Liu , Mirella Lapata

Traditional sequence-to-sequence (seq2seq) models and other variations of the attention-mechanism such as hierarchical attention have been applied to the text summarization problem. Though there is a hierarchy in the way humans use language…

Machine Learning · Computer Science 2019-11-04 Rajeev Bhatt Ambati , Saptarashmi Bandyopadhyay , Prasenjit Mitra

The output structure of database-like tables, consisting of values structured in horizontal rows and vertical columns identifiable by name, can cover a wide range of NLP tasks. Following this constatation, we propose a framework for…

Abstractive summarization for long-document or multi-document remains challenging for the Seq2Seq architecture, as Seq2Seq is not good at analyzing long-distance relations in text. In this paper, we present BASS, a novel framework for…

Computation and Language · Computer Science 2021-05-26 Wenhao Wu , Wei Li , Xinyan Xiao , Jiachen Liu , Ziqiang Cao , Sujian Li , Hua Wu , Haifeng Wang

Abstractive summarization aims to generate a shorter version of the document covering all the salient points in a compact and coherent fashion. On the other hand, query-based summarization highlights those points that are relevant in the…

Computation and Language · Computer Science 2018-07-16 Preksha Nema , Mitesh Khapra , Anirban Laha , Balaraman Ravindran

Automatic summarisation is a popular approach to reduce a document to its main arguments. Recent research in the area has focused on neural approaches to summarisation, which can be very data-hungry. However, few large datasets exist and…

Computation and Language · Computer Science 2017-06-14 Ed Collins , Isabelle Augenstein , Sebastian Riedel

A good neural sequence-to-sequence summarization model should have a strong encoder that can distill and memorize the important information from long input texts so that the decoder can generate salient summaries based on the encoder's…

Computation and Language · Computer Science 2018-09-13 Yichen Jiang , Mohit Bansal

Transformer architectures have achieved remarkable success across language, vision, and multimodal tasks, and there is growing demand for them to address in-context compositional learning tasks. In these tasks, models solve the target…

Machine Learning · Computer Science 2025-11-26 Wei Chen , Jingxi Yu , Zichen Miao , Qiang Qiu

Despite the prevalence of pretrained language models in natural language understanding tasks, understanding lengthy text such as document is still challenging due to the data sparseness problem. Inspired by that humans develop their ability…

Computation and Language · Computer Science 2023-12-04 Yueguan Wang , Naoki Yoshinaga

Dense prediction tasks have enjoyed a growing complexity of encoder architectures, decoders, however, have remained largely the same. They rely on individual blocks decoding intermediate feature maps sequentially. We introduce banks, shared…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Frederik Laboyrie , Mehmet Kerim Yucel , Albert Saa-Garriga

Table summarization is a crucial task aimed at condensing information from tabular data into concise and comprehensible textual summaries. However, existing approaches often fall short of adequately meeting users' information and quality…

Computation and Language · Computer Science 2024-08-27 Weijia Zhang , Vaishali Pal , Jia-Hong Huang , Evangelos Kanoulas , Maarten de Rijke

With the abundance of automatic meeting transcripts, meeting summarization is of great interest to both participants and other parties. Traditional methods of summarizing meetings depend on complex multi-step pipelines that make joint…

Computation and Language · Computer Science 2020-09-22 Chenguang Zhu , Ruochen Xu , Michael Zeng , Xuedong Huang

Pre-trained language models (PLMs) have achieved outstanding achievements in abstractive single-document summarization (SDS). However, such benefits may not fully extend to multi-document summarization (MDS), where the handling of…

Computation and Language · Computer Science 2023-11-02 Chenhui Shen , Liying Cheng , Xuan-Phi Nguyen , Yang You , Lidong Bing