English
Related papers

Related papers: ExtraPhrase: Efficient Data Augmentation for Abstr…

200 papers

The substantial growth of textual content in diverse domains and platforms has led to a considerable need for Automatic Text Summarization (ATS) techniques that aid in the process of text analysis. The effectiveness of text summarization…

Computation and Language · Computer Science 2025-03-03 Nevidu Jayatilleke , Ruvan Weerasinghe , Nipuna Senanayake

Deep learning technologies have significantly advanced the performance of target speaker extraction (TSE) tasks. To enhance the generalization and robustness of these algorithms when training data is insufficient, data augmentation is a…

Sound · Computer Science 2024-09-17 Junjie Li , Ke Zhang , Shuai Wang , Haizhou Li , Man-Wai Mak , Kong Aik Lee

In many applications of machine learning, certain categories of examples may be underrepresented in the training data, causing systems to underperform on such "few-shot" cases at test time. A common remedy is to perform data augmentation,…

Computation and Language · Computer Science 2021-02-03 Kenton Lee , Kelvin Guu , Luheng He , Tim Dozat , Hyung Won Chung

Contrastive learning enables learning useful audio and speech representations without ground-truth labels by maximizing the similarity between latent representations of similar signal segments. In this framework various data augmentation…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-11 Salah Zaiem , Titouan Parcollet , Slim Essid

Sentence compression reduces the length of text by removing non-essential content while preserving important facts and grammaticality. Unsupervised objective driven methods for sentence compression can be used to create customized models…

Computation and Language · Computer Science 2022-05-18 Demian Gholipour Ghalandari , Chris Hokamp , Georgiana Ifrim

Text summarization aims to generate a short summary for an input text. In this work, we propose a Non-Autoregressive Unsupervised Summarization (NAUS) approach, which does not require parallel data for training. Our NAUS first performs…

Computation and Language · Computer Science 2022-05-31 Puyuan Liu , Chenyang Huang , Lili Mou

While recent neural text-to-speech (TTS) systems perform remarkably well, they typically require a substantial amount of recordings from the target speaker reading in the desired speaking style. In this work, we present a novel 3-step…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-03 Goeric Huybrechts , Thomas Merritt , Giulia Comini , Bartek Perz , Raahil Shah , Jaime Lorenzo-Trueba

Keyphrase extraction is the task of automatically selecting a small set of phrases that best describe a given free text document. Supervised keyphrase extraction requires large amounts of labeled training data and generalizes very poorly…

Computation and Language · Computer Science 2018-09-07 Kamil Bennani-Smires , Claudiu Musat , Andreea Hossmann , Michael Baeriswyl , Martin Jaggi

Training advanced machine learning models demands massive datasets, resulting in prohibitive computational costs. To address this challenge, data pruning techniques identify and remove redundant training samples while preserving model…

Machine Learning · Computer Science 2025-06-23 Sebastian Schmidt , Prasanga Dhungel , Christoffer Löffler , Björn Nieth , Stephan Günnemann , Leo Schwinn

Text summarization condenses a text to a shorter version while retaining the important informations. Abstractive summarization is a recent development that generates new phrases, rather than simply copying or rephrasing sentences within the…

Computation and Language · Computer Science 2018-02-06 André Cibils , Claudiu Musat , Andreea Hossman , Michael Baeriswyl

(Source) Code summarization aims to automatically generate summaries/comments for a given code snippet in the form of natural language. Such summaries play a key role in helping developers understand and maintain source code. Existing code…

Software Engineering · Computer Science 2023-11-07 Weisong Sun , Chunrong Fang , Yuchen Chen , Quanjun Zhang , Guanhong Tao , Tingxu Han , Yifei Ge , Yudu You , Bin Luo

Few-shot abstractive summarization has become a challenging task in natural language generation. To support it, we designed a novel soft prompts architecture coupled with a prompt pre-training plus fine-tuning paradigm that is effective and…

Computation and Language · Computer Science 2022-10-05 Xiaochen Liu , Yang Gao , Yu Bai , Jiawei Li , Yinan Hu , Heyan Huang , Boxing Chen

The task of automatic text summarization produces a concise and fluent text summary while preserving key information and overall meaning. Recent approaches to document-level summarization have seen significant improvements in recent years…

Computation and Language · Computer Science 2022-12-07 Gonçalo Raposo , Afonso Raposo , Ana Sofia Carmo

In this paper, we present a conceptually simple while empirically powerful framework for abstractive summarization, SimCLS, which can bridge the gap between the learning objective and evaluation metrics resulting from the currently…

Computation and Language · Computer Science 2021-06-04 Yixin Liu , Pengfei Liu

We investigate a new training paradigm for extractive summarization. Traditionally, human abstracts are used to derive goldstandard labels for extraction units. However, the labels are often inaccurate, because human abstracts and source…

Computation and Language · Computer Science 2018-06-22 Kristjan Arumae , Fei Liu

Many business workflows require extracting important fields from form-like documents (e.g. bank statements, bills of lading, purchase orders, etc.). Recent techniques for automating this task work well only when trained with large datasets.…

Computation and Language · Computer Science 2022-12-23 Jing Xie , James B. Wendt , Yichao Zhou , Seth Ebner , Sandeep Tata

Based on the remarkable achievements of pre-trained language models in abstractive summarization, the copying mechanism has proved helpful by improving the factuality, stability, and overall performance. This work proposes PROM, a new…

Computation and Language · Computer Science 2024-02-29 Xinbei Ma , Yeyun Gong , Pengcheng He , Hai Zhao , Nan Duan

With the abundance of automatic meeting transcripts, meeting summarization is of great interest to both participants and other parties. Traditional methods of summarizing meetings depend on complex multi-step pipelines that make joint…

Computation and Language · Computer Science 2020-09-22 Chenguang Zhu , Ruochen Xu , Michael Zeng , Xuedong Huang

Recent advances in the field of abstractive summarization leverage pre-trained language models rather than train a model from scratch. However, such models are sluggish to train and accompanied by a massive overhead. Researchers have…

Computation and Language · Computer Science 2022-09-01 Zheng Zhao , Pinzhen Chen

This paper creates a paradigm shift with regard to the way we build neural extractive summarization systems. Instead of following the commonly used framework of extracting sentences individually and modeling the relationship between…

Computation and Language · Computer Science 2020-04-21 Ming Zhong , Pengfei Liu , Yiran Chen , Danqing Wang , Xipeng Qiu , Xuanjing Huang