English
Related papers

Related papers: Dissecting Generation Modes for Abstractive Summar…

200 papers

The pursuit of interpretable artificial intelligence has led to significant advancements in the development of methods that aim to explain the decision-making processes of complex models, such as deep learning systems. Among these methods,…

Machine Learning · Computer Science 2024-10-29 Yihao Zhang

Nonparametric regression models have recently surged in their power and popularity, accompanying the trend of increasing dataset size and complexity. While these models have proven their predictive ability in empirical settings, they are…

Methodology · Statistics 2020-07-23 Spencer Woody , Carlos M. Carvalho , Jared S. Murray

This paper tackles the reduction of redundant repeating generation that is often observed in RNN-based encoder-decoder models. Our basic idea is to jointly estimate the upper-bound frequency of each target vocabulary in the encoder and…

Computation and Language · Computer Science 2017-02-15 Jun Suzuki , Masaaki Nagata

We introduce a new approach for abstractive text summarization, Topic-Guided Abstractive Summarization, which calibrates long-range dependencies from topic-level features with globally salient content. The idea is to incorporate neural…

Computation and Language · Computer Science 2021-08-31 Chujie Zheng , Kunpeng Zhang , Harry Jiannan Wang , Ling Fan , Zhe Wang

In this work, we model abstractive text summarization using Attentional Encoder-Decoder Recurrent Neural Networks, and show that they achieve state-of-the-art performance on two different corpora. We propose several novel models that…

Computation and Language · Computer Science 2016-08-29 Ramesh Nallapati , Bowen Zhou , Cicero Nogueira dos santos , Caglar Gulcehre , Bing Xiang

Traditional approaches to extractive summarization rely heavily on human-engineered features. In this work we propose a data-driven approach based on neural networks and continuous sentence features. We develop a general framework for…

Computation and Language · Computer Science 2016-07-04 Jianpeng Cheng , Mirella Lapata

Opinion summarization is the task of automatically generating summaries for a set of reviews about a specific target (e.g., a movie or a product). Since the number of reviews for each target can be prohibitively large, neural network-based…

Computation and Language · Computer Science 2021-01-25 Reinald Kim Amplayo , Mirella Lapata

Writing style is a combination of consistent decisions associated with a specific author at different levels of language production, including lexical, syntactic, and structural. In this paper, we introduce a style-aware neural model to…

Computation and Language · Computer Science 2019-09-16 Fereshteh Jafariakinabad , Kien A. Hua

We present a new neural model for text summarization that first extracts sentences from a document and then compresses them. The proposed model offers a balance that sidesteps the difficulties in abstractive methods while generating more…

Information Retrieval · Computer Science 2019-04-08 Afonso Mendes , Shashi Narayan , Sebastião Miranda , Zita Marinho , André F. T. Martins , Shay B. Cohen

Abstractive text summarization aims to shorten long text documents into a human readable form that contains the most important facts from the original document. However, the level of actual abstraction as measured by novel phrases that do…

Computation and Language · Computer Science 2018-08-27 Wojciech Kryściński , Romain Paulus , Caiming Xiong , Richard Socher

Generating a readable summary that describes the functionality of a program is known as source code summarization. In this task, learning code representation by modeling the pairwise relationship between code tokens to capture their…

Software Engineering · Computer Science 2020-05-05 Wasi Uddin Ahmad , Saikat Chakraborty , Baishakhi Ray , Kai-Wei Chang

Neural document ranking models perform impressively well due to superior language understanding gained from pre-training tasks. However, due to their complexity and large number of parameters, these (typically transformer-based) models are…

Information Retrieval · Computer Science 2022-12-02 Jurek Leonhardt , Koustav Rudra , Avishek Anand

Like humans, document summarization models can interpret a document's contents in a number of ways. Unfortunately, the neural models of today are largely black boxes that provide little explanation of how or why they generated a summary in…

Computation and Language · Computer Science 2020-12-15 Wang Haonan , Gao Yang , Bai Yu , Mirella Lapata , Huang Heyan

Neural abstractive summarization models have led to promising results in summarizing relatively short documents. We propose the first model for abstractive summarization of single, longer-form documents (e.g., research papers). Our approach…

Computation and Language · Computer Science 2018-05-23 Arman Cohan , Franck Dernoncourt , Doo Soon Kim , Trung Bui , Seokhwan Kim , Walter Chang , Nazli Goharian

An abstract must not change the meaning of the original text. A single most effective way to achieve that is to increase the amount of copying while still allowing for text abstraction. Human editors can usually exercise control over…

Computation and Language · Computer Science 2019-11-26 Kaiqiang Song , Bingqing Wang , Zhe Feng , Liu Ren , Fei Liu

State of the art machine learning algorithms are highly optimized to provide the optimal prediction possible, naturally resulting in complex models. While these models often outperform simpler more interpretable models by order of…

Machine Learning · Statistics 2016-11-24 Yotam Hechtlinger

Diffusion models have demonstrated remarkable performance in generation tasks. Nevertheless, explaining the diffusion process remains challenging due to it being a sequence of denoising noisy images that are difficult for experts to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Ji-Hoon Park , Yeong-Joon Ju , Seong-Whan Lee

The substantial growth of textual content in diverse domains and platforms has led to a considerable need for Automatic Text Summarization (ATS) techniques that aid in the process of text analysis. The effectiveness of text summarization…

Computation and Language · Computer Science 2025-03-03 Nevidu Jayatilleke , Ruvan Weerasinghe , Nipuna Senanayake

Automatic Text Summarization strategies have been successfully employed to digest text collections and extract its essential content. Usually, summaries are generated using textual corpora that belongs to the same domain area where the…

Computation and Language · Computer Science 2018-07-03 Vinicius Woloszyn , Guilherme Medeiros Machado , Leandro Krug Wives , José Palazzo Moreira de Oliveira

How to generate summaries of different styles without requiring corpora in the target styles, or training separate models? We present two novel methods that can be deployed during summary decoding on any pre-trained Transformer-based…

Computation and Language · Computer Science 2021-04-06 Shuyang Cao , Lu Wang