English
Related papers

Related papers: Analyzing Multi-Task Learning for Abstractive Text…

200 papers

Text summarization condenses a text to a shorter version while retaining the important informations. Abstractive summarization is a recent development that generates new phrases, rather than simply copying or rephrasing sentences within the…

Computation and Language · Computer Science 2018-02-06 André Cibils , Claudiu Musat , Andreea Hossman , Michael Baeriswyl

We propose a new approach to generate multiple variants of the target summary with diverse content and varying lengths, then score and select admissible ones according to users' needs. Abstractive summarizers trained on single reference…

Computation and Language · Computer Science 2021-04-06 Kaiqiang Song , Bingqing Wang , Zhe Feng , Fei Liu

Decision-making in complex, continuous multi-task environments is often hindered by the difficulty of obtaining accurate models for planning and the inefficiency of learning purely from trial and error. While precise environment dynamics…

Machine Learning · Computer Science 2025-03-20 Jeff Jewett , Sandhya Saisubramanian

The task of automatic text summarization produces a concise and fluent text summary while preserving key information and overall meaning. Recent approaches to document-level summarization have seen significant improvements in recent years…

Computation and Language · Computer Science 2022-12-07 Gonçalo Raposo , Afonso Raposo , Ana Sofia Carmo

Human beings can leverage knowledge from relative tasks to improve learning on a primary task. Similarly, multi-task learning methods suggest using auxiliary tasks to enhance a neural network's performance on a specific primary task.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yuanze Li , Chun-Mei Feng , Qilong Wang , Guanglei Yang , Wangmeng Zuo

Summarisation of research results in plain language is crucial for promoting public understanding of research findings. The use of Natural Language Processing to generate lay summaries has the potential to relieve researchers' workload and…

Computation and Language · Computer Science 2023-03-28 Oliver Vinzelberg , Mark David Jenkins , Gordon Morison , David McMinn , Zoe Tieges

The recent years have seen remarkable success in the use of deep neural networks on text summarization. However, there is no clear understanding of \textit{why} they perform so well, or \textit{how} they might be improved. In this paper, we…

Computation and Language · Computer Science 2019-07-09 Ming Zhong , Pengfei Liu , Danqing Wang , Xipeng Qiu , Xuanjing Huang

Automatic summarization is the process of shortening a set of textual data computationally, to create a subset (a summary) that represents the most important pieces of information in the original text. Existing summarization methods can be…

Computation and Language · Computer Science 2022-04-21 Meng Cao

We introduce a new approach for abstractive text summarization, Topic-Guided Abstractive Summarization, which calibrates long-range dependencies from topic-level features with globally salient content. The idea is to incorporate neural…

Computation and Language · Computer Science 2021-08-31 Chujie Zheng , Kunpeng Zhang , Harry Jiannan Wang , Ling Fan , Zhe Wang

This paper proposes a text summarization approach for factual reports using a deep learning model. This approach consists of three phases: feature extraction, feature enhancement, and summary generation, which work together to assimilate…

Computation and Language · Computer Science 2019-01-10 Sukriti Verma , Vagisha Nidhi

With the advent of deep learning, many dense prediction tasks, i.e. tasks that produce pixel-level predictions, have seen significant performance improvements. The typical approach is to learn these tasks in isolation, that is, a separate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Simon Vandenhende , Stamatios Georgoulis , Wouter Van Gansbeke , Marc Proesmans , Dengxin Dai , Luc Van Gool

We explore the benefits that multitask learning offer to speech processing as we train models on dual objectives with automatic speech recognition and intent classification or sentiment classification. Our models, although being of modest…

Computation and Language · Computer Science 2022-11-28 Quentin Meeus , Marie-Francine Moens , Hugo Van hamme

Advances in natural language processing, such as transfer learning from pre-trained language models, have impacted how models are trained for programming language tasks too. Previous research primarily explored code pre-training and…

Computation and Language · Computer Science 2023-02-08 Pinzhen Chen , Gerasimos Lampouras

Neural models for abstractive summarization tend to achieve the best performance in the presence of highly specialized, summarization specific modeling add-ons such as pointer-generator, coverage-modeling, and inferencetime heuristics. We…

Computation and Language · Computer Science 2019-09-25 Sebastian Goodman , Zhenzhong Lan , Radu Soricut

Abstractive Text Summarization is the process of constructing semantically relevant shorter sentences which captures the essence of the overall meaning of the source text. It is actually difficult and very time consuming for humans to…

Computation and Language · Computer Science 2021-01-19 Mohan Bharath B , Aravindh Gowtham B , Akhil M

This study proposes a multitask learning architecture for extractive summarization with coherence boosting. The architecture contains an extractive summarizer and coherent discriminator module. The coherent discriminator is trained online…

Computation and Language · Computer Science 2023-07-24 Renlong Jie , Xiaojun Meng , Lifeng Shang , Xin Jiang , Qun Liu

Learning distributed sentence representations is one of the key challenges in natural language processing. Previous work demonstrated that a recurrent neural network (RNNs) based sentence encoder trained on a large collection of annotated…

Computation and Language · Computer Science 2018-08-20 Wasi Uddin Ahmad , Xueying Bai , Zhechao Huang , Chao Jiang , Nanyun Peng , Kai-Wei Chang

Although domain shift has been well explored in many NLP applications, it still has received little attention in the domain of extractive text summarization. As a result, the model is under-utilizing the nature of the training data due to…

Computation and Language · Computer Science 2019-09-02 Danqing Wang , Pengfei Liu , Ming Zhong , Jie Fu , Xipeng Qiu , Xuanjing Huang

Sentence simplification aims to improve readability and understandability, based on several operations such as splitting, deletion, and paraphrasing. However, a valid simplified sentence should also be logically entailed by its input…

Computation and Language · Computer Science 2018-06-20 Han Guo , Ramakanth Pasunuru , Mohit Bansal

We present a multi-task learning framework for cross-lingual abstractive summarization to augment training data. Recent studies constructed pseudo cross-lingual abstractive summarization data to train their neural encoder-decoders.…

Computation and Language · Computer Science 2020-10-16 Sho Takase , Naoaki Okazaki