English
Related papers

Related papers: Exploring Multitask Learning for Low-Resource Abst…

200 papers

While the NLP community has produced numerous summarization benchmarks, none provide the rich annotations required to simultaneously address many important problems related to control and reliability. We introduce a Wikipedia-derived…

Computation and Language · Computer Science 2023-12-05 Kundan Krishna , Prakhar Gupta , Sanjana Ramprasad , Byron C. Wallace , Jeffrey P. Bigham , Zachary C. Lipton

Pre-trained and fine-tuned news summarizers are expected to generalize to news articles unseen in the fine-tuning (training) phase. However, these articles often contain specifics, such as new events and people, a summarizer could not learn…

Computation and Language · Computer Science 2022-04-19 Arthur Bražinskas , Mengwen Liu , Ramesh Nallapati , Sujith Ravi , Markus Dreyer

Neural network-based methods for abstractive summarization produce outputs that are more fluent than other techniques, but which can be poor at content selection. This work proposes a simple technique for addressing this issue: use a…

Computation and Language · Computer Science 2018-10-10 Sebastian Gehrmann , Yuntian Deng , Alexander M. Rush

Lung cancer and covid-19 have one of the highest morbidity and mortality rates in the world. For physicians, the identification of lesions is difficult in the early stages of the disease and time-consuming. Therefore, multi-task learning is…

Image and Video Processing · Electrical Eng. & Systems 2024-04-10 Weronika Hryniewska-Guzik , Maria Kędzierska , Przemysław Biecek

Neural network-based models augmented with unsupervised pre-trained knowledge have achieved impressive performance on text summarization. However, most existing evaluation methods are limited to an in-domain setting, where summarizers are…

Computation and Language · Computer Science 2020-10-23 Yiran Chen , Pengfei Liu , Ming Zhong , Zi-Yi Dou , Danqing Wang , Xipeng Qiu , Xuanjing Huang

In recent years, multi-task learning has turned out to be of great success in various applications. Though single model training has promised great results throughout these years, it ignores valuable information that might help us estimate…

Machine Learning · Computer Science 2022-09-28 Yeshwant Singh , Anupam Biswas , Angshuman Bora , Debashish Malakar , Subham Chakraborty , Suman Bera

This paper presents a new multitask learning framework that learns a shared representation among the tasks, incorporating both task and feature clusters. The jointly-induced clusters yield a shared latent subspace where task relationships…

Machine Learning · Statistics 2017-03-06 Keerthiram Murugesan , Jaime Carbonell , Yiming Yang

Producing a reduced version of a source text, as in generic or focused summarization, inherently involves two distinct subtasks: deciding on targeted content and generating a coherent text conveying it. While some popular approaches address…

Computation and Language · Computer Science 2022-10-25 Aviv Slobodkin , Paul Roit , Eran Hirsch , Ori Ernst , Ido Dagan

How can we generate concise explanations for multi-hop Reading Comprehension (RC)? The current strategies of identifying supporting sentences can be seen as an extractive question-focused summarization of the input text. However, these…

Computation and Language · Computer Science 2021-09-15 Naoya Inoue , Harsh Trivedi , Steven Sinha , Niranjan Balasubramanian , Kentaro Inui

Dictionary learning algorithms have been successfully used for both reconstructive and discriminative tasks, where an input signal is represented with a sparse linear combination of dictionary atoms. While these methods are mostly developed…

Machine Learning · Statistics 2016-01-20 Soheil Bahrampour , Nasser M. Nasrabadi , Asok Ray , W. Kenneth Jenkins

Multi-task learning leverages structural similarities between multiple tasks to learn despite very few samples. Motivated by the recent success of neural networks applied to data-scarce tasks, we consider a linear low-dimensional shared…

Machine Learning · Statistics 2022-06-13 Etienne Boursier , Mikhail Konobeev , Nicolas Flammarion

We study the multi-task learning problem that aims to simultaneously analyze multiple datasets collected from different sources and learn one model for each of them. We propose a family of adaptive methods that automatically utilize…

Machine Learning · Statistics 2023-09-19 Yaqi Duan , Kaizheng Wang

Real-world congestion problems (e.g. traffic congestion) are typically very complex and large-scale. Multiagent reinforcement learning (MARL) is a promising candidate for dealing with this emerging complexity by providing an autonomous and…

Multiagent Systems · Computer Science 2020-09-02 Kleanthis Malialis , Sam Devlin , Daniel Kudenko

Recent work using auxiliary prediction task classifiers to investigate the properties of LSTM representations has begun to shed light on why pretrained representations, like ELMo (Peters et al., 2018) and CoVe (McCann et al., 2017), are so…

Computation and Language · Computer Science 2019-01-08 Kelly W. Zhang , Samuel R. Bowman

Semi-supervised learning has recently been attracting attention as an alternative to fully supervised models that require large pools of labeled data. Moreover, optimizing a model for multiple tasks can provide better generalizability than…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Abdullah-Al-Zubaer Imran , Chao Huang , Hui Tang , Wei Fan , Yuan Xiao , Dingjun Hao , Zhen Qian , Demetri Terzopoulos

Multi-task problem solving has been shown to improve the accuracy of the individual tasks, which is an important feature for robots, as they have a limited resource. However, when the number of labels for each task is not equal, namely…

Robotics · Computer Science 2026-02-03 Ozgur Erkent

The aim of multi-task reinforcement learning is two-fold: (1) efficiently learn by training against multiple tasks and (2) quickly adapt, using limited samples, to a variety of new tasks. In this work, the tasks correspond to reward…

Machine Learning · Computer Science 2019-11-05 Nicholas C. Landolfi , Garrett Thomas , Tengyu Ma

Single document summarization is the task of producing a shorter version of a document while preserving its principal information content. In this paper we conceptualize extractive summarization as a sentence ranking task and propose a…

Computation and Language · Computer Science 2018-04-17 Shashi Narayan , Shay B. Cohen , Mirella Lapata

As representation learning becomes a powerful technique to reduce sample complexity in reinforcement learning (RL) in practice, theoretical understanding of its advantage is still limited. In this paper, we theoretically characterize the…

Machine Learning · Computer Science 2022-06-14 Yuan Cheng , Songtao Feng , Jing Yang , Hong Zhang , Yingbin Liang

The substantial growth of textual content in diverse domains and platforms has led to a considerable need for Automatic Text Summarization (ATS) techniques that aid in the process of text analysis. The effectiveness of text summarization…

Computation and Language · Computer Science 2025-03-03 Nevidu Jayatilleke , Ruvan Weerasinghe , Nipuna Senanayake