English
Related papers

Related papers: Multi-Task Networks With Universe, Group, and Task…

200 papers

In this paper, we present a Multi-Task Deep Neural Network (MT-DNN) for learning representations across multiple natural language understanding (NLU) tasks. MT-DNN not only leverages large amounts of cross-task data, but also benefits from…

Computation and Language · Computer Science 2019-05-31 Xiaodong Liu , Pengcheng He , Weizhu Chen , Jianfeng Gao

We consider a distributed multi-task learning scheme that accounts for multiple linear model estimation tasks with heterogeneous and/or correlated data streams. We assume that nodes can be partitioned into groups corresponding to different…

Multiagent Systems · Computer Science 2024-10-07 Lingzhou Hong , Alfredo Garcia

State-of-the-art studies have demonstrated the superiority of joint modelling over pipeline implementation for medical named entity recognition and normalization due to the mutual benefits between the two processes. To exploit these…

Computation and Language · Computer Science 2018-12-17 Sendong Zhao , Ting Liu , Sicheng Zhao , Fei Wang

The innate capacity of humans and other animals to learn a diverse, and often interfering, range of knowledge and skills throughout their lifespan is a hallmark of natural intelligence, with obvious evolutionary motivations. In parallel,…

Machine Learning · Computer Science 2021-12-30 David McCaffary

We present a novel methodology to jointly perform multi-task learning and infer intrinsic relationship among tasks by an interpretable and sparse graph. Unlike existing multi-task learning methodologies, the graph structure is not assumed…

Machine Learning · Computer Science 2020-09-15 Shujian Yu , Francesco Alesiani , Ammar Shaker , Wenzhe Yin

Typical multi-task learning (MTL) methods rely on architectural adjustments and a large trainable parameter set to jointly optimize over several tasks. However, when the number of tasks increases so do the complexity of the architectural…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Gjorgji Strezoski , Nanne van Noord , Marcel Worring

Multi-task learning (MTL) has led to successes in many applications of machine learning, from natural language processing and speech recognition to computer vision and drug discovery. This article aims to give a general overview of MTL,…

Machine Learning · Computer Science 2017-06-19 Sebastian Ruder

Multi-task learning (MTL) aims to leverage shared knowledge across tasks to improve generalization and parameter efficiency, yet balancing resources and mitigating interference remain open challenges. Architectural solutions often introduce…

Machine Learning · Computer Science 2025-12-24 Mihai Suteu , Ovidiu Serban

When developing deep learning models, we usually decide what task we want to solve then search for a model that generalizes well on the task. An intriguing question would be: what if, instead of fixing the task and searching in the model…

Machine Learning · Computer Science 2022-12-02 Andrei Atanov , Andrei Filatov , Teresa Yeo , Ajay Sohmshetty , Amir Zamir

Multi-task learning (MTL) aims to leverage shared information among tasks to improve learning efficiency and accuracy. However, MTL often struggles to effectively manage positive and negative transfer between tasks, which can hinder…

Machine Learning · Computer Science 2025-05-19 Chenguang Wang , Xuanhao Pan , Tianshu Yu

Multi-task learning has recently become a very active field in deep learning research. In contrast to learning a single task in isolation, multiple tasks are learned at the same time, thereby utilizing the training signal of related tasks…

Computation and Language · Computer Science 2019-04-24 Tobias Kahse

The incorporation of prior knowledge into learning is essential in achieving good performance based on small noisy samples. Such knowledge is often incorporated through the availability of related data arising from domains and tasks similar…

Machine Learning · Statistics 2026-02-24 Baruch Epstein , Ron Meir , Tomer Michaeli

Predicting node labels on a given graph is a widely studied problem with many applications, including community detection and molecular graph prediction. This paper considers predicting multiple node labeling functions on graphs…

Machine Learning · Computer Science 2024-03-18 Dongyue Li , Haotian Ju , Aneesh Sharma , Hongyang R. Zhang

Many real-world machine learning applications involve several learning tasks which are inter-related. For example, in healthcare domain, we need to learn a predictive model of a certain disease for many hospitals. The models for each…

Machine Learning · Computer Science 2016-10-03 Inci M. Baytas , Ming Yan , Anil K. Jain , Jiayu Zhou

The terms multi-task learning and multitasking are easily confused. Multi-task learning refers to a paradigm in machine learning in which a network is trained on various related tasks to facilitate the acquisition of tasks. In contrast,…

Machine Learning · Computer Science 2021-01-06 Sachin Ravi , Sebastian Musslick , Maia Hamin , Theodore L. Willke , Jonathan D. Cohen

Multi-Task Learning is a learning paradigm that uses correlated tasks to improve performance generalization. A common way to learn multiple tasks is through the hard parameter sharing approach, in which a single architecture is used to…

Machine Learning · Computer Science 2022-04-15 Angelica Tiemi Mizuno Nakamura , Denis Fernando Wolf , Valdir Grassi

Understanding how brain networks learn and manage multiple tasks simultaneously is of interest in both neuroscience and artificial intelligence. In this regard, a recent research thread in theoretical neuroscience has focused on how…

Neurons and Cognition · Quantitative Biology 2024-08-05 Giacomo Vedovati , ShiNung Ching

The goal of this paper is to use multi-task learning to efficiently scale slot filling models for natural language understanding to handle multiple target tasks or domains. The key to scalability is reducing the amount of training data…

Computation and Language · Computer Science 2016-08-11 Aaron Jaech , Larry Heck , Mari Ostendorf

In practical applications, computer vision tasks often need to be addressed simultaneously. Multitask learning typically achieves this by jointly training a single deep neural network to learn shared representations, providing efficiency…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Konstantinos Spathis , Nikolaos Kardaris , Petros Maragos

Multi-task learning is a framework that enforces different learning tasks to share their knowledge to improve their generalization performance. It is a hot and active domain that strives to handle several core issues; particularly, which…

Machine Learning · Computer Science 2021-02-23 Johnny Torres , Guangji Bai , Junxiang Wang , Liang Zhao , Carmen Vaca , Cristina Abad