English
Related papers

Related papers: Curriculum-Guided Abstractive Summarization

200 papers

The exponential growth of textual data has created a crucial need for tools that assist users in extracting meaningful insights. Traditional document summarization approaches often fail to meet individual user requirements and lack…

Information Retrieval · Computer Science 2023-07-13 Samira Ghodratnama , Amin Beheshti , Mehrdad Zakershahrak

YouTube users looking for instructions for a specific task may spend a long time browsing content trying to find the right video that matches their needs. Creating a visual summary (abridged version of a video) provides viewers with a quick…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Medhini Narasimhan , Arsha Nagrani , Chen Sun , Michael Rubinstein , Trevor Darrell , Anna Rohrbach , Cordelia Schmid

We provide theoretical investigation of curriculum learning in the context of stochastic gradient descent when optimizing the convex linear regression loss. We prove that the rate of convergence of an ideal curriculum learning method is…

Machine Learning · Computer Science 2023-12-29 Daphna Weinshall , Gad Cohen , Dan Amir

Steady progress has been made in abstractive summarization with attention-based sequence-to-sequence learning models. In this paper, we propose a new decoder where the output summary is generated by conditioning on both the input text and…

Machine Learning · Computer Science 2019-08-21 Melissa Ailem , Bowen Zhang , Fei Sha

Abstractive text summarization is surging with the number of training samples to cater to the needs of the deep learning models. These models tend to exploit the training data representations to attain superior performance by improving the…

Computation and Language · Computer Science 2023-12-21 Yash Kumar Atri , Vikram Goyal , Tanmoy Chakraborty

Although some recent works show potential complementarity among different state-of-the-art systems, few works try to investigate this problem in text summarization. Researchers in other areas commonly refer to the techniques of reranking or…

Computation and Language · Computer Science 2021-04-16 Yixin Liu , Zi-Yi Dou , Pengfei Liu

Multimodal summarization requires models to jointly understand textual and visual inputs to generate concise, semantically coherent summaries. Existing methods often inject shallow visual features into deep language models, leading to…

Artificial Intelligence · Computer Science 2026-05-13 Abid Ali , Diego Molla-Aliod , Usman Naseem

We develop an abstractive summarization framework independent of labeled data for multiple heterogeneous documents. Unlike existing multi-document summarization methods, our framework processes documents telling different stories instead of…

Computation and Language · Computer Science 2022-05-03 Ning Wang , Han Liu , Diego Klabjan

Abstractive text summarization is one of the areas influenced by the emergence of pre-trained language models. Current pre-training works in abstractive summarization give more points to the summaries with more words in common with the main…

Computation and Language · Computer Science 2021-09-10 Alireza Salemi , Emad Kebriaei , Ghazal Neisi Minaei , Azadeh Shakery

Video summarisation can be posed as the task of extracting important parts of a video in order to create an informative summary of what occurred in the video. In this paper we introduce SummaryNet as a supervised learning framework for…

Computer Vision and Pattern Recognition · Computer Science 2020-02-24 Ziyad Jappie , David Torpey , Turgay Celik

Sequence-to-sequence neural networks have recently achieved great success in abstractive summarization, especially through fine-tuning large pre-trained language models on the downstream dataset. These models are typically decoded with beam…

Computation and Language · Computer Science 2023-05-29 Mathieu Ravaut , Shafiq Joty , Nancy F. Chen

Training machine learning models in a meaningful order, from the easy samples to the hard ones, using curriculum learning can provide performance improvements over the standard training approach based on random data shuffling, without any…

Machine Learning · Computer Science 2022-04-12 Petru Soviany , Radu Tudor Ionescu , Paolo Rota , Nicu Sebe

To capture the semantic graph structure from raw text, most existing summarization approaches are built on GNNs with a pre-trained model. However, these methods suffer from cumbersome procedures and inefficient computations for long-text…

Computation and Language · Computer Science 2021-10-22 Ye Liu , Jian-Guo Zhang , Yao Wan , Congying Xia , Lifang He , Philip S. Yu

Models pretrained with self-supervised objectives on large text corpora achieve state-of-the-art performance on English text summarization tasks. However, these models are typically fine-tuned on hundreds of thousands of data points, an…

Computation and Language · Computer Science 2021-04-13 Alexander R. Fabbri , Simeng Han , Haoyuan Li , Haoran Li , Marjan Ghazvininejad , Shafiq Joty , Dragomir Radev , Yashar Mehdad

Recently, various neural encoder-decoder models pioneered by Seq2Seq framework have been proposed to achieve the goal of generating more abstractive summaries by learning to map input text to output text. At a high level, such neural models…

Computation and Language · Computer Science 2023-04-11 Yichong Huang , Xiachong Feng , Xiaocheng Feng , Bing Qin

Sentence scoring and sentence selection are two main steps in extractive document summarization systems. However, previous works treat them as two separated subtasks. In this paper, we present a novel end-to-end neural network framework for…

Computation and Language · Computer Science 2018-07-09 Qingyu Zhou , Nan Yang , Furu Wei , Shaohan Huang , Ming Zhou , Tiejun Zhao

Current summarization systems yield generic summaries that are disconnected from users' preferences and expectations. To address this limitation, we present CTRLsum, a novel framework for controllable summarization. Our approach enables…

Computation and Language · Computer Science 2020-12-09 Junxian He , Wojciech Kryściński , Bryan McCann , Nazneen Rajani , Caiming Xiong

Neural abstractive summarization models are able to generate summaries which have high overlap with human references. However, existing models are not optimized for factual correctness, a critical metric in real-world applications. In this…

Computation and Language · Computer Science 2020-04-29 Yuhao Zhang , Derek Merck , Emily Bao Tsai , Christopher D. Manning , Curtis P. Langlotz

Abstractive conversation summarization has received much attention recently. However, these generated summaries often suffer from insufficient, redundant, or incorrect content, largely due to the unstructured and complex characteristics of…

Computation and Language · Computer Science 2021-04-20 Jiaao Chen , Diyi Yang

Contextualized word embeddings can lead to state-of-the-art performances in natural language understanding. Recently, a pre-trained deep contextualized text encoder such as BERT has shown its potential in improving natural language tasks…

Computation and Language · Computer Science 2022-09-02 Hyunjae Lee , Jaewoong Yun , Hyunjin Choi , Seongho Joe , Youngjune L. Gwon