中文
相关论文

相关论文: Which Tasks Should Be Learned Together in Multi-ta…

200 篇论文

Multitask learning aims at solving a set of related tasks simultaneously, by exploiting the shared knowledge for improving the performance on individual tasks. Hence, an important aspect of multitask learning is to understand the…

机器学习 · 计算机科学 2019-10-22 Changjian Shui , Mahdieh Abbasi , Louis-Émile Robitaille , Boyu Wang , Christian Gagné

Integrating knowledge across different domains is an essential feature of human learning. Learning paradigms such as transfer learning, meta-learning, and multi-task learning reflect the human learning process by exploiting the prior…

机器学习 · 计算机科学 2024-10-17 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

In the paradigm of multi-task learning, mul- tiple related prediction tasks are learned jointly, sharing information across the tasks. We propose a framework for multi-task learn- ing that enables one to selectively share the information…

机器学习 · 计算机科学 2012-07-03 Abhishek Kumar , Hal Daume

Key to multitask learning is exploiting relationships between different tasks to improve prediction performance. If the relations are linear, regularization approaches can be used successfully. However, in practice assuming the tasks to be…

机器学习 · 计算机科学 2017-08-11 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco , Massimiliano Pontil

Multi-task learning (MTL) has led to successes in many applications of machine learning, from natural language processing and speech recognition to computer vision and drug discovery. This article aims to give a general overview of MTL,…

机器学习 · 计算机科学 2017-06-19 Sebastian Ruder

Multi-task learning, as it is understood nowadays, consists of using one single model to carry out several similar tasks. From classifying hand-written characters of different alphabets to figuring out how to play several Atari games using…

机器学习 · 计算机科学 2019-03-25 Unai Garciarena , Alexander Mendiburu , Roberto Santana

Multitask learning (MTL) aims to learn multiple tasks simultaneously through the interdependence between different tasks. The way to measure the relatedness between tasks is always a popular issue. There are mainly two ways to measure…

机器学习 · 计算机科学 2019-04-04 Ya Li , Xinmei Tian , Tongliang Liu , Dacheng Tao

Modern discriminative predictors have been shown to match natural intelligences in specific perceptual tasks in image classification, object and part detection, boundary extraction, etc. However, a major advantage that natural intelligences…

机器学习 · 统计学 2016-11-30 Hakan Bilen , Andrea Vedaldi

Neural processes have recently emerged as a class of powerful neural latent variable models that combine the strengths of neural networks and stochastic processes. As they can encode contextual data in the network's function space, they…

机器学习 · 计算机科学 2021-12-03 Jiayi Shen , Xiantong Zhen , Marcel Worring , Ling Shao

Many real-world machine learning applications involve several learning tasks which are inter-related. For example, in healthcare domain, we need to learn a predictive model of a certain disease for many hospitals. The models for each…

机器学习 · 计算机科学 2016-10-03 Inci M. Baytas , Ming Yan , Anil K. Jain , Jiayu Zhou

Multi-task neural networks learn tasks simultaneously to improve individual task performance. There are three mechanisms of multi-task learning (MTL) which are explored here for the context of structural health monitoring (SHM): (i) the…

机器学习 · 计算机科学 2023-05-17 Sarah Bee , Lawrence Bull , Nikolas Dervilis , Keith Worden

We consider a distributed multi-task learning scheme that accounts for multiple linear model estimation tasks with heterogeneous and/or correlated data streams. We assume that nodes can be partitioned into groups corresponding to different…

多智能体系统 · 计算机科学 2024-10-07 Lingzhou Hong , Alfredo Garcia

Neural network models have shown their promising opportunities for multi-task learning, which focus on learning the shared layers to extract the common and task-invariant features. However, in most existing approaches, the extracted shared…

计算与语言 · 计算机科学 2017-04-20 Pengfei Liu , Xipeng Qiu , Xuanjing Huang

Continual learning of multiple tasks remains a major challenge for neural networks. Here, we investigate how task order influences continual learning and propose a strategy for optimizing it. Leveraging a linear teacher-student model with…

机器学习 · 统计学 2025-07-22 Ziyan Li , Naoki Hiratani

Multi-task learning in Convolutional Networks has displayed remarkable success in the field of recognition. This success can be largely attributed to learning shared representations from multiple supervisory tasks. However, existing…

计算机视觉与模式识别 · 计算机科学 2016-04-13 Ishan Misra , Abhinav Shrivastava , Abhinav Gupta , Martial Hebert

In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them. Multi-task learning is inherently a multi-objective problem because different tasks may conflict, necessitating a trade-off. A common compromise…

机器学习 · 计算机科学 2019-01-14 Ozan Sener , Vladlen Koltun

One of the main arguments behind studying disentangled representations is the assumption that they can be easily reused in different tasks. At the same time finding a joint, adaptable representation of data is one of the key challenges in…

机器学习 · 计算机科学 2021-10-08 Łukasz Maziarka , Aleksandra Nowak , Maciej Wołczyk , Andrzej Bedychaj

Multi-task learning (MTL) allows deep neural networks to learn from related tasks by sharing parameters with other networks. In practice, however, MTL involves searching an enormous space of possible parameter sharing architectures to find…

机器学习 · 统计学 2018-11-20 Sebastian Ruder , Joachim Bingel , Isabelle Augenstein , Anders Søgaard

Multi-task learning solves multiple correlated tasks. However, conflicts may exist between them. In such circumstances, a single solution can rarely optimize all the tasks, leading to performance trade-offs. To arrive at a set of optimized…

人工智能 · 计算机科学 2024-03-26 Lu Bai , Abhishek Gupta , Yew-Soon Ong

Recent success in training deep neural networks have prompted active investigation into the features learned on their intermediate layers. Such research is difficult because it requires making sense of non-linear computations performed by…

机器学习 · 计算机科学 2016-03-01 Yixuan Li , Jason Yosinski , Jeff Clune , Hod Lipson , John Hopcroft