English
Related papers

Related papers: Topic-Aware Encoding for Extractive Summarization

200 papers

One key challenge in multi-document summarization is to capture the relations among input documents that distinguish between single document summarization (SDS) and multi-document summarization (MDS). Few existing MDS works address this…

Computation and Language · Computer Science 2022-09-14 Congbo Ma , Wei Emma Zhang , Pitawelayalage Dasun Dileepa Pitawela , Yutong Qu , Haojie Zhuang , Hu Wang

In this paper, we propose a deep learning approach to tackle the automatic summarization tasks by incorporating topic information into the convolutional sequence-to-sequence (ConvS2S) model and using self-critical sequence training (SCST)…

Computation and Language · Computer Science 2020-07-28 Li Wang , Junlin Yao , Yunzhe Tao , Li Zhong , Wei Liu , Qiang Du

Neural models have recently been used in text summarization including headline generation. The model can be trained using a set of document-headline pairs. However, the model does not explicitly consider topical similarities and differences…

Computation and Language · Computer Science 2016-08-23 Lei Xu , Ziyun Wang , Ayana , Zhiyuan Liu , Maosong Sun

The task of automatic text summarization produces a concise and fluent text summary while preserving key information and overall meaning. Recent approaches to document-level summarization have seen significant improvements in recent years…

Computation and Language · Computer Science 2022-12-07 Gonçalo Raposo , Afonso Raposo , Ana Sofia Carmo

We propose a new length-controllable abstractive summarization model. Recent state-of-the-art abstractive summarization models based on encoder-decoder models generate only one summary per source text. However, controllable summarization,…

Computation and Language · Computer Science 2020-01-22 Itsumi Saito , Kyosuke Nishida , Kosuke Nishida , Atsushi Otsuka , Hisako Asano , Junji Tomita , Hiroyuki Shindo , Yuji Matsumoto

Sequence-to-sequence (seq2seq) neural models have been actively investigated for abstractive summarization. Nevertheless, existing neural abstractive systems frequently generate factually incorrect summaries and are vulnerable to…

Computation and Language · Computer Science 2018-10-16 Lisa Fan , Dong Yu , Lu Wang

The technology of automatic document summarization is maturing and may provide a solution to the information overload problem. Nowadays, document summarization plays an important role in information retrieval. With a large volume of…

Information Retrieval · Computer Science 2012-04-10 Mohsen Pourvali , Mohammad Saniee Abadeh

(Source) Code summarization aims to automatically generate summaries/comments for a given code snippet in the form of natural language. Such summaries play a key role in helping developers understand and maintain source code. Existing code…

Software Engineering · Computer Science 2023-11-07 Weisong Sun , Chunrong Fang , Yuchen Chen , Quanjun Zhang , Guanhong Tao , Tingxu Han , Yifei Ge , Yudu You , Bin Luo

We present our method for tackling a legal case retrieval task by introducing our method of encoding documents by summarizing them into continuous vector space via our phrase scoring framework utilizing deep neural networks. On the other…

Computation and Language · Computer Science 2023-09-18 Vu Tran , Minh Le Nguyen , Satoshi Tojo , Ken Satoh

Abstractive text summarization aims to shorten long text documents into a human readable form that contains the most important facts from the original document. However, the level of actual abstraction as measured by novel phrases that do…

Computation and Language · Computer Science 2018-08-27 Wojciech Kryściński , Romain Paulus , Caiming Xiong , Richard Socher

Text summarization aims to condense long documents and retain key information. Critical to the success of a summarization model is the faithful inference of latent representations of words or tokens in the source documents. Most recent…

Computation and Language · Computer Science 2022-03-16 Bo Pang , Erik Nijkamp , Wojciech Kryściński , Silvio Savarese , Yingbo Zhou , Caiming Xiong

This paper creates a paradigm shift with regard to the way we build neural extractive summarization systems. Instead of following the commonly used framework of extracting sentences individually and modeling the relationship between…

Computation and Language · Computer Science 2020-04-21 Ming Zhong , Pengfei Liu , Yiran Chen , Danqing Wang , Xipeng Qiu , Xuanjing Huang

An ongoing challenge in the analysis of document collections is how to summarize content in terms of a set of inferred themes that can be interpreted substantively in terms of topics. The current practice of parametrizing the themes in…

Machine Learning · Computer Science 2014-07-29 Edoardo M Airoldi , Jonathan M Bischof

Topic modelling is a text mining technique for identifying salient themes from a number of documents. The output is commonly a set of topics consisting of isolated tokens that often co-occur in such documents. Manual effort is often…

Computation and Language · Computer Science 2024-04-26 Lowri Williams , Eirini Anthi , Laura Arman , Pete Burnap

Abstractive summarization for long-document or multi-document remains challenging for the Seq2Seq architecture, as Seq2Seq is not good at analyzing long-distance relations in text. In this paper, we present BASS, a novel framework for…

Computation and Language · Computer Science 2021-05-26 Wenhao Wu , Wei Li , Xinyan Xiao , Jiachen Liu , Ziqiang Cao , Sujian Li , Hua Wu , Haifeng Wang

The success of neural summarization models stems from the meticulous encodings of source articles. To overcome the impediments of limited and sometimes noisy training data, one promising direction is to make better use of the available…

Computation and Language · Computer Science 2019-06-13 Kai Wang , Xiaojun Quan , Rui Wang

Statistical topic models efficiently facilitate the exploration of large-scale data sets. Many models have been developed and broadly used to summarize the semantic structure in news, science, social media, and digital humanities. However,…

Machine Learning · Computer Science 2016-12-02 Jian Tang , Cheng Li , Ming Zhang , Qiaozhu Mei

Topic modelling is a pivotal unsupervised machine learning technique for extracting valuable insights from large document collections. Existing neural topic modelling methods often encode contextual information of documents, while ignoring…

Computation and Language · Computer Science 2025-02-07 Yanan Ma , Chenghao Xiao , Chenhan Yuan , Sabine N van der Veer , Lamiece Hassan , Chenghua Lin , Goran Nenadic

Topic models are used to identify and group similar themes in a set of documents. Recent advancements in deep learning based neural topic models has received significant research interest. In this paper, an approach is proposed that further…

Computation and Language · Computer Science 2024-10-15 Trishia Khandelwal

Abstractive text summarization is a challenging task, and one need to design a mechanism to effectively extract salient information from the source text and then generate a summary. A parsing process of the source text contains critical…

Computation and Language · Computer Science 2020-03-19 Haiyang Xu , Yun Wang , Kun Han , Baochang Ma , Junwen Chen , Xiangang Li