English
Related papers

Related papers: Enabling Asymmetric Knowledge Transfer in Multi-Ta…

200 papers

Existing research on continual learning of a sequence of tasks focused on dealing with catastrophic forgetting, where the tasks are assumed to be dissimilar and have little shared knowledge. Some work has also been done to transfer…

Machine Learning · Computer Science 2021-12-21 Zixuan Ke , Bing Liu , Xingchang Huang

Scheduling problems are often tackled independently, and rarely solved by leveraging the commonalities across problems. Lack of awareness of this inter-task similarity could impede the search efficacy. A quantifiable relationship between…

Optimization and Control · Mathematics 2023-05-23 Peng Li , Bo Liu

Auxiliary-Task Learning (ATL) aims to improve the performance of the target task by leveraging the knowledge obtained from related tasks. Occasionally, learning multiple tasks simultaneously results in lower accuracy than learning only the…

Machine Learning · Computer Science 2023-11-17 Junguang Jiang , Baixu Chen , Junwei Pan , Ximei Wang , Liu Dapeng , Jie Jiang , Mingsheng Long

Team adaptation to new cooperative tasks is a hallmark of human intelligence, which has yet to be fully realized in learning agents. Previous work on multi-agent transfer learning accommodate teams of different sizes, heavily relying on the…

Artificial Intelligence · Computer Science 2022-03-10 Rongjun Qin , Feng Chen , Tonghan Wang , Lei Yuan , Xiaoran Wu , Zongzhang Zhang , Chongjie Zhang , Yang Yu

Multi-Task Learning (MTL) aims to learn multiple tasks simultaneously while exploiting their mutual relationships. By using shared resources to simultaneously calculate multiple outputs, this learning paradigm has the potential to have…

Machine Learning · Computer Science 2024-08-29 Maxime Fontana , Michael Spratling , Miaojing Shi

Transfer learning improves the performance of the target task by leveraging the data of a specific source task: the closer the relationship between the source and the target tasks, the greater the performance improvement by transfer…

Neurons and Cognition · Quantitative Biology 2022-08-31 Youzhi Qu , Xinyao Jian , Wenxin Che , Penghui Du , Kai Fu , Quanying Liu

The cost of annotating training data has traditionally been a bottleneck for supervised learning approaches. The problem is further exacerbated when supervised learning is applied to a number of correlated tasks simultaneously since the…

Machine Learning · Computer Science 2021-03-26 Jingxi Xu , Da Tang , Tony Jebara

On edge devices, data scarcity occurs as a common problem where transfer learning serves as a widely-suggested remedy. Nevertheless, transfer learning imposes a heavy computation burden to resource-constrained edge devices. Existing task…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-07 Zimu Zheng , Qiong Chen , Chuang Hu , Dan Wang , Fangming Liu

Multi-task learning is to improve the performance of the model by transferring and exploiting common knowledge among tasks. Existing MTL works mainly focus on the scenario where label sets among multiple tasks (MTs) are usually the same,…

Machine Learning · Computer Science 2022-01-10 Quan Feng , Songcan Chen

Transfer Learning (TL) offers the potential to accelerate learning by transferring knowledge across tasks. However, it faces critical challenges such as negative transfer, domain adaptation and inefficiency in selecting solid source…

Machine Learning · Computer Science 2025-07-29 Alessandro Capurso , Elia Piccoli , Davide Bacciu

Multitask learning is widely used in practice to train a low-resource target task by augmenting it with multiple related source tasks. Yet, naively combining all the source tasks with a target task does not always improve the prediction…

Machine Learning · Computer Science 2023-12-29 Dongyue Li , Huy L. Nguyen , Hongyang R. Zhang

The problem of learning one task using samples from another task is central to transfer learning. In this paper, we focus on answering the following question: when does combining the samples from two related tasks perform better than…

Machine Learning · Statistics 2025-06-11 Fan Yang , Hongyang R. Zhang , Sen Wu , Christopher Ré , Weijie J. Su

Multi-task learning (MTL) is to learn one single model that performs multiple tasks for achieving good performance on all tasks and lower cost on computation. Learning such a model requires to jointly optimize losses of a set of tasks with…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Wei-Hong Li , Hakan Bilen

Multi-Task Learning is a learning paradigm that uses correlated tasks to improve performance generalization. A common way to learn multiple tasks is through the hard parameter sharing approach, in which a single architecture is used to…

Machine Learning · Computer Science 2022-04-15 Angelica Tiemi Mizuno Nakamura , Denis Fernando Wolf , Valdir Grassi

Multitask learning aims at solving a set of related tasks simultaneously, by exploiting the shared knowledge for improving the performance on individual tasks. Hence, an important aspect of multitask learning is to understand the…

Machine Learning · Computer Science 2019-10-22 Changjian Shui , Mahdieh Abbasi , Louis-Émile Robitaille , Boyu Wang , Christian Gagné

Sharing information between multiple tasks enables algorithms to achieve good generalization performance even from small amounts of training data. However, in a realistic scenario of multi-task learning not all tasks are equally related to…

Machine Learning · Statistics 2014-12-04 Anastasia Pentina , Viktoriia Sharmanska , Christoph H. Lampert

When faced with learning a set of inter-related tasks from a limited amount of usable data, learning each task independently may lead to poor generalization performance. Multi-Task Learning (MTL) exploits the latent relations between tasks…

Machine Learning · Computer Science 2015-08-14 Niloofar Yousefi , Michael Georgiopoulos , Georgios C. Anagnostopoulos

In recent years, Multi-Task Learning (MTL) has attracted much attention due to its good performance in many applications. However, many existing MTL models cannot guarantee that their performance is no worse than their single-task…

Machine Learning · Computer Science 2022-10-04 Zhixiong Yue , Feiyang Ye , Yu Zhang , Christy Liang , Ivor W. Tsang

Self-supervised learning is a powerful paradigm for representation learning on unlabelled images. A wealth of effective new methods based on instance matching rely on data-augmentation to drive learning, and these have reached a rough…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Linus Ericsson , Henry Gouk , Timothy M. Hospedales

Multi-task learning aims to learn multiple tasks jointly by exploiting their relatedness to improve the generalization performance for each task. Traditionally, to perform multi-task learning, one needs to centralize data from all the tasks…

Machine Learning · Computer Science 2017-06-21 Sulin Liu , Sinno Jialin Pan , Qirong Ho