English
Related papers

Related papers: Improving Zero and Few-Shot Abstractive Summarizat…

200 papers

Opinion summarization is the automatic creation of text reflecting subjective information expressed in multiple documents, such as user reviews of a product. The task is practically important and has attracted a lot of attention. However,…

Machine Learning · Computer Science 2020-10-13 Arthur Bražinskas , Mirella Lapata , Ivan Titov

The Query Focused Text Summarization (QFTS) task aims at building systems that generate the summary of the text document(s) based on the given query. A key challenge in addressing this task is the lack of large labeled data for training the…

Computation and Language · Computer Science 2021-12-23 Md Tahmid Rahman Laskar , Enamul Hoque , Jimmy Xiangji Huang

Modern models for text generation show state-of-the-art results in many natural language processing tasks. In this work, we explore the effectiveness of abstractive text summarization models for keyphrase selection. A list of keyphrases is…

Computation and Language · Computer Science 2024-10-23 Anna Glazkova , Dmitry Morozov

Back-translation based approaches have recently lead to significant progress in unsupervised sequence-to-sequence tasks such as machine translation or style transfer. In this work, we extend the paradigm to the problem of learning a…

Computation and Language · Computer Science 2019-08-26 Yacine Jernite

Text summarization is crucial for mitigating information overload across domains like journalism, medicine, and business. This research evaluates summarization performance across 17 large language models (OpenAI, Google, Anthropic,…

Computation and Language · Computer Science 2025-04-08 Anantharaman Janakiraman , Behnaz Ghoraani

With the rise of task-specific pre-training objectives, abstractive summarization models like PEGASUS offer appealing zero-shot performance on downstream summarization tasks. However, the performance of such unsupervised models still lags…

Computation and Language · Computer Science 2024-11-15 Mathieu Ravaut , Shafiq Joty , Nancy Chen

Neural abstractive summarization has been studied in many pieces of literature and achieves great success with the aid of large corpora. However, when encountering novel tasks, one may not always benefit from transfer learning due to the…

Computation and Language · Computer Science 2021-06-01 Yi-Syuan Chen , Hong-Han Shuai

In real-world scenarios, labeled samples for dialogue summarization are usually limited (i.e., few-shot) due to high annotation costs for high-quality dialogue summaries. To efficiently learn from few-shot samples, previous works have…

Computation and Language · Computer Science 2024-02-28 Kaige Xie , Tong Yu , Haoliang Wang , Junda Wu , Handong Zhao , Ruiyi Zhang , Kanak Mahadik , Ani Nenkova , Mark Riedl

Given a document and a target aspect (e.g., a topic of interest), aspect-based abstractive summarization attempts to generate a summary with respect to the aspect. Previous studies usually assume a small pre-defined set of aspects and fall…

Computation and Language · Computer Science 2020-10-20 Bowen Tan , Lianhui Qin , Eric P. Xing , Zhiting Hu

Abstractive summarization typically relies on large collections of paired articles and summaries. However, in many cases, parallel data is scarce and costly to obtain. We develop an abstractive summarization system that relies only on large…

Computation and Language · Computer Science 2020-03-04 Nikola I. Nikolov , Richard H. R. Hahnloser

Controlled abstractive summarization focuses on producing condensed versions of a source article to cover specific aspects by shifting the distribution of generated text towards a desired style, e.g., a set of topics. Subsequently, the…

Computation and Language · Computer Science 2023-11-14 Seyed Ali Bahrainian , Martin Jaggi , Carsten Eickhoff

Opinion summarization is the task of automatically generating summaries for a set of reviews about a specific target (e.g., a movie or a product). Since the number of reviews for each target can be prohibitively large, neural network-based…

Computation and Language · Computer Science 2021-01-25 Reinald Kim Amplayo , Mirella Lapata

Text summarization is an approach for identifying important information present within text documents. This computational technique aims to generate shorter versions of the source text, by including only the relevant and salient information…

Computation and Language · Computer Science 2021-06-30 Kalliath Abdul Rasheed Issam , Shivam Patel , Subalalitha C. N

Most of the recent few-shot learning (FSL) algorithms are based on transfer learning, where a model is pre-trained using a large amount of source data, and the pre-trained model is fine-tuned using a small amount of target data. In transfer…

Machine Learning · Computer Science 2022-08-22 Yujin Kim , Jaehoon Oh , Sungnyun Kim , Se-Young Yun

Fine-tuning the Natural Language Processing (NLP) models for each new data set requires higher computational time associated with increased carbon footprint and cost. However, fine-tuning helps the pre-trained models adapt to the latest…

Computation and Language · Computer Science 2023-03-14 Deen Abdullah , Shamanth Nayak , Gandharv Suri , Yllias Chali

Zero-shot translation aims to translate between language pairs not seen during training in Multilingual Machine Translation (MMT) and is largely considered an open problem. A common, albeit resource-consuming, solution is to add as many…

Computation and Language · Computer Science 2024-03-03 Di Wu , Shaomu Tan , Yan Meng , David Stap , Christof Monz

Summarizing texts is not a straightforward task. Before even considering text summarization, one should determine what kind of summary is expected. How much should the information be compressed? Is it relevant to reformulate or should the…

Computation and Language · Computer Science 2020-07-16 Paul Tardy , David Janiszek , Yannick Estève , Vincent Nguyen

Abstractive summarization has been studied using neural sequence transduction methods with datasets of large, paired document-summary examples. However, such datasets are rare and the models trained from them do not generalize to other…

Computation and Language · Computer Science 2019-05-24 Eric Chu , Peter J. Liu

With the explosive growth of livestream broadcasting, there is an urgent need for new summarization technology that enables us to create a preview of streamed content and tap into this wealth of knowledge. However, the problem is nontrivial…

Computation and Language · Computer Science 2021-09-14 Sangwoo Cho , Franck Dernoncourt , Tim Ganter , Trung Bui , Nedim Lipka , Walter Chang , Hailin Jin , Jonathan Brandt , Hassan Foroosh , Fei Liu

This paper proposes a text summarization approach for factual reports using a deep learning model. This approach consists of three phases: feature extraction, feature enhancement, and summary generation, which work together to assimilate…

Computation and Language · Computer Science 2019-01-10 Sukriti Verma , Vagisha Nidhi