English
Related papers

Related papers: Sign-regularized Multi-task Learning

200 papers

Multi-task learning (MTL) is a subfield of machine learning in which multiple tasks are simultaneously learned by a shared model. Such approaches offer advantages like improved data efficiency, reduced overfitting through shared…

Machine Learning · Computer Science 2020-09-22 Michael Crawshaw

Recent multi-task learning research argues against unitary scalarization, where training simply minimizes the sum of the task losses. Several ad-hoc multi-task optimization algorithms have instead been proposed, inspired by various…

Machine Learning · Computer Science 2023-03-10 Vitaly Kurin , Alessandro De Palma , Ilya Kostrikov , Shimon Whiteson , M. Pawan Kumar

This paper presents a new multitask learning framework that learns a shared representation among the tasks, incorporating both task and feature clusters. The jointly-induced clusters yield a shared latent subspace where task relationships…

Machine Learning · Statistics 2017-03-06 Keerthiram Murugesan , Jaime Carbonell , Yiming Yang

Biased regularization and fine-tuning are two recent meta-learning approaches. They have been shown to be effective to tackle distributions of tasks, in which the tasks' target vectors are all close to a common meta-parameter vector.…

Machine Learning · Computer Science 2020-08-26 Giulia Denevi , Massimiliano Pontil , Carlo Ciliberto

We study and quantify the generalization patterns of multitask learning (MTL) models for sequence labeling tasks. MTL models are trained to optimize a set of related tasks jointly. Although multitask learning has achieved improved…

Machine Learning · Computer Science 2020-09-29 Gabriele Bettgenhäuser , Michael A. Hedderich , Dietrich Klakow

As an effective learning paradigm against insufficient training samples, Multi-Task Learning (MTL) encourages knowledge sharing across multiple related tasks so as to improve the overall performance. In MTL, a major challenge springs from…

Machine Learning · Computer Science 2020-04-30 Zhiyong Yang , Qianqian Xu , Xiaochun Cao , Qingming Huang

Multi-Task Learning (MTL) is a learning paradigm in machine learning and its aim is to leverage useful information contained in multiple related tasks to help improve the generalization performance of all the tasks. In this paper, we give a…

Machine Learning · Computer Science 2021-03-30 Yu Zhang , Qiang Yang

With the rise of neural networks in various domains, multi-task learning (MTL) gained significant relevance. A key challenge in MTL is balancing individual task losses during neural network training to improve performance and efficiency…

Machine Learning · Computer Science 2024-08-16 Lukas Kirchdorfer , Cathrin Elich , Simon Kutsche , Heiner Stuckenschmidt , Lukas Schott , Jan M. Köhler

In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them. Multi-task learning is inherently a multi-objective problem because different tasks may conflict, necessitating a trade-off. A common compromise…

Machine Learning · Computer Science 2019-01-14 Ozan Sener , Vladlen Koltun

Meta-learning models have two objectives. First, they need to be able to make predictions over a range of task distributions while utilizing only a small amount of training data. Second, they also need to adapt to new novel unseen tasks at…

Machine Learning · Computer Science 2021-01-26 Edwin Pan , Pankaj Rajak , Shubham Shrivastava

Multi-Task Learning (MTL) can enhance a classifier's generalization performance by learning multiple related tasks simultaneously. Conventional MTL works under the offline or batch setting, and suffers from expensive training cost and poor…

Machine Learning · Computer Science 2017-06-28 Peng Yang , Peilin Zhao , Xin Gao

Multi-Task Learning (MTL) is a powerful learning paradigm to improve generalization performance via knowledge sharing. However, existing studies find that MTL could sometimes hurt generalization, especially when two tasks are less…

Machine Learning · Computer Science 2022-11-28 Ziniu Hu , Zhe Zhao , Xinyang Yi , Tiansheng Yao , Lichan Hong , Yizhou Sun , Ed H. Chi

In this paper we consider a problem known as multi-task learning, consisting of fitting a set of classifier or regression functions intended for solving different tasks. In our novel formulation, we couple the parameters of these functions,…

Machine Learning · Computer Science 2021-05-28 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

For the first time, multi-task learning is proposed to improve the flexibility of NN-based equalizers in coherent systems. A "single" NN-based equalizer improves Q-factor by up to 4 dB compared to CDC, without re-training, even with…

Multi-modal brain functional connectivity (FC) data have shown great potential for providing insights into individual variations in behavioral and cognitive traits. The joint learning of multi-modal imaging data can utilize the intrinsic…

Quantitative Methods · Quantitative Biology 2019-01-18 Li Xiao , Julia M. Stephen , Tony W. Wilson , Vince D. Calhoun , Yu-Ping Wang

Sharing information between multiple tasks enables algorithms to achieve good generalization performance even from small amounts of training data. However, in a realistic scenario of multi-task learning not all tasks are equally related to…

Machine Learning · Statistics 2014-12-04 Anastasia Pentina , Viktoriia Sharmanska , Christoph H. Lampert

In multi-task learning, a learner is given a collection of prediction tasks and needs to solve all of them. In contrast to previous work, which required that annotated training data is available for all tasks, we consider a new setting, in…

Machine Learning · Statistics 2017-06-09 Anastasia Pentina , Christoph H. Lampert

Multi-task learning aims at solving multiple machine learning tasks at the same time. A good solution to a multi-task learning problem should be generalizable in addition to being Pareto optimal. In this paper, we provide some insights on…

Machine Learning · Computer Science 2020-08-14 Yuyan Wang , Zhe Zhao , Bo Dai , Christopher Fifty , Dong Lin , Lichan Hong , Ed H. Chi

This paper presents a general framework to integrate prior knowledge in the form of logic constraints among a set of task functions into kernel machines. The logic propositions provide a partial representation of the environment, in which…

Machine Learning · Computer Science 2024-02-19 Michelangelo Diligenti , Marco Gori , Marco Maggini , Leonardo Rigutini

Expressing the polarity of sentiment as 'positive' and 'negative' usually have limited scope compared with the intensity/degree of polarity. These two tasks (i.e. sentiment classification and sentiment intensity prediction) are closely…

Computation and Language · Computer Science 2020-02-07 Kumar Shikhar Deep , Md Shad Akhtar , Asif Ekbal , Pushpak Bhattacharyya