English
Related papers

Related papers: Abstractive Text Summarization Using Sequence-to-S…

200 papers

We present work on summarising deliberative processes for non-English languages. Unlike commonly studied datasets, such as news articles, this deliberation dataset reflects difficulties of combining multiple narratives, mostly of poor…

Computation and Language · Computer Science 2021-10-13 M. Arana-Catania , Rob Procter , Yulan He , Maria Liakata

In this paper, we propose a deep learning approach to tackle the automatic summarization tasks by incorporating topic information into the convolutional sequence-to-sequence (ConvS2S) model and using self-critical sequence training (SCST)…

Computation and Language · Computer Science 2020-07-28 Li Wang , Junlin Yao , Yunzhe Tao , Li Zhong , Wei Liu , Qiang Du

Text Summarization is recognised as one of the NLP downstream tasks and it has been extensively investigated in recent years. It can assist people with perceiving the information rapidly from the Internet, including news articles, social…

Computation and Language · Computer Science 2022-12-08 Guan Wang , Weihua Li , Edmund Lai , Jianhua Jiang

In this paper, we develop a neural summarization model which can effectively process multiple input documents and distill Transformer architecture with the ability to encode documents in a hierarchical manner. We represent cross-document…

Computation and Language · Computer Science 2019-05-31 Yang Liu , Mirella Lapata

Nowadays, pre-trained sequence-to-sequence models such as BERTSUM and BART have shown state-of-the-art results in abstractive summarization. In these models, during fine-tuning, the encoder transforms sentences to context vectors in the…

Computation and Language · Computer Science 2022-02-24 Sung-Guk Jo , Jeong-Jae Kim , Byung-Won On

Auto-encoders compress input data into a latent-space representation and reconstruct the original data from the representation. This latent representation is not easily interpreted by humans. In this paper, we propose training an…

Computation and Language · Computer Science 2018-10-09 Yau-Shian Wang , Hung-Yi Lee

Distributed representation learned with neural networks has recently shown to be effective in modeling natural languages at fine granularities such as words, phrases, and even sentences. Whether and how such an approach can be extended to…

Computation and Language · Computer Science 2016-10-27 Qian Chen , Xiaodan Zhu , Zhenhua Ling , Si Wei , Hui Jiang

In this paper, we propose an adversarial process for abstractive text summarization, in which we simultaneously train a generative model G and a discriminative model D. In particular, we build the generator G as an agent of reinforcement…

Computation and Language · Computer Science 2017-11-28 Linqing Liu , Yao Lu , Min Yang , Qiang Qu , Jia Zhu , Hongyan Li

In this work we formulate the problem of image captioning as a multimodal translation task. Analogous to machine translation, we present a sequence-to-sequence recurrent neural networks (RNN) model for image caption generation. Different…

Computer Vision and Pattern Recognition · Computer Science 2017-08-11 Chang Liu , Fuchun Sun , Changhu Wang , Feng Wang , Alan Yuille

Neural sequence-to-sequence networks with attention have achieved remarkable performance for machine translation. One of the reasons for their effectiveness is their ability to capture relevant source-side contextual information at each…

Computation and Language · Computer Science 2018-10-02 Lesly Miculicich Werlen , Nikolaos Pappas , Dhananjay Ram , Andrei Popescu-Belis

Text summarization is one of the most challenging and interesting problems in NLP. Although much attention has been paid to summarizing structured text like news reports or encyclopedia articles, summarizing conversations---an essential…

Computation and Language · Computer Science 2020-10-06 Jiaao Chen , Diyi Yang

Text summarization aims to condense long documents and retain key information. Critical to the success of a summarization model is the faithful inference of latent representations of words or tokens in the source documents. Most recent…

Computation and Language · Computer Science 2022-03-16 Bo Pang , Erik Nijkamp , Wojciech Kryściński , Silvio Savarese , Yingbo Zhou , Caiming Xiong

Automatic summarization is the process of shortening a set of textual data computationally, to create a subset (a summary) that represents the most important pieces of information in the original text. Existing summarization methods can be…

Computation and Language · Computer Science 2022-04-21 Meng Cao

An advantage of seq2seq abstractive summarization models is that they generate text in a free-form manner, but this flexibility makes it difficult to interpret model behavior. In this work, we analyze summarization decoders in both blackbox…

Computation and Language · Computer Science 2020-10-16 Jiacheng Xu , Shrey Desai , Greg Durrett

Attention mechanisms in neural networks have proved useful for problems in which the input and output do not have fixed dimension. Often there exist features that are locally translation invariant and would be valuable for directing the…

Machine Learning · Computer Science 2016-05-26 Miltiadis Allamanis , Hao Peng , Charles Sutton

In neural abstractive summarization field, conventional sequence-to-sequence based models often suffer from summarizing the wrong aspect of the document with respect to the main aspect. To tackle this problem, we propose the task of…

Computation and Language · Computer Science 2018-12-14 Shen Gao , Xiuying Chen , Piji Li , Zhaochun Ren , Lidong Bing , Dongyan Zhao , Rui Yan

Abstractive text summarization is one of the areas influenced by the emergence of pre-trained language models. Current pre-training works in abstractive summarization give more points to the summaries with more words in common with the main…

Computation and Language · Computer Science 2021-09-10 Alireza Salemi , Emad Kebriaei , Ghazal Neisi Minaei , Azadeh Shakery

Neural abstractive summarization has been increasingly studied, where the prior work mainly focused on summarizing single-speaker documents (news, scientific publications, etc). In dialogues, there are different interactions between…

Computation and Language · Computer Science 2018-10-02 Chih-Wen Goo , Yun-Nung Chen

Tremendous amounts of multimedia associated with speech information are driving an urgent need to develop efficient and effective automatic summarization methods. To this end, we have seen rapid progress in applying supervised deep neural…

Computation and Language · Computer Science 2020-06-03 Shi-Yan Weng , Tien-Hong Lo , Berlin Chen

Rapid growth of the biomedical literature has led to many advances in the biomedical text mining field. Among the vast amount of information, biomedical article abstracts are the easily accessible sources. However, the number of the…

Computation and Language · Computer Science 2022-01-19 Mehmet Efruz Karabulut , K. Vijay-Shanker