English
Related papers

Related papers: Which Tasks Should Be Learned Together in Multi-ta…

200 papers

Training multiple tasks jointly in one deep network yields reduced latency during inference and better performance over the single-task counterpart by sharing certain layers of a network. However, over-sharing a network could erroneously…

Machine Learning · Computer Science 2020-06-11 Pengsheng Guo , Chen-Yu Lee , Daniel Ulbricht

We consider a multitask learning problem, in which several predictors are learned jointly. Prior research has shown that learning the relations between tasks, and between the input features, together with the predictor, can lead to better…

Machine Learning · Computer Science 2019-07-11 Han Zhao , Otilia Stretcu , Alex Smola , Geoff Gordon

A multi-task learning (MTL) system aims at solving multiple related tasks at the same time. With a fixed model capacity, the tasks would be conflicted with each other, and the system usually has to make a trade-off among learning all of…

Machine Learning · Computer Science 2021-02-16 Xi Lin , Zhiyuan Yang , Qingfu Zhang , Sam Kwong

Multi-task learning has been widely applied in computational vision, natural language processing and other fields, which has achieved well performance. In recent years, a lot of work about multi-task learning recommender system has been…

Information Retrieval · Computer Science 2023-05-24 Mingzhu Zhang , Ruiping Yin , Zhen Yang , Yipeng Wang , Kan Li

Reliable and effective multi-task learning is a prerequisite for the development of robotic agents that can quickly learn to accomplish related, everyday tasks. However, in the reinforcement learning domain, multi-task learning has not…

Machine Learning · Computer Science 2018-02-06 Himani Arora , Rajath Kumar , Jason Krone , Chong Li

Is more data always better to train vision-and-language models? We study knowledge transferability in multi-modal tasks. The current tendency in machine learning is to assume that by joining multiple datasets from different tasks their…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Tianwei Chen , Noa Garcia , Mayu Otani , Chenhui Chu , Yuta Nakashima , Hajime Nagahara

Multi-task learning is a framework that enforces different learning tasks to share their knowledge to improve their generalization performance. It is a hot and active domain that strives to handle several core issues; particularly, which…

Machine Learning · Computer Science 2021-02-23 Johnny Torres , Guangji Bai , Junxiang Wang , Liang Zhao , Carmen Vaca , Cristina Abad

Multi-task learning (MTL) aims at achieving a better model by leveraging data and knowledge from multiple tasks. However, MTL does not always work -- sometimes negative transfer occurs between tasks, especially when aggregating loosely…

Computation and Language · Computer Science 2023-05-24 Jingwei Ni , Zhijing Jin , Qian Wang , Mrinmaya Sachan , Markus Leippold

Recent work has found that multi-task training with a large number of diverse tasks can uniformly improve downstream performance on unseen target tasks. In contrast, literature on task transferability has established that the choice of…

Computation and Language · Computer Science 2022-07-13 Vishakh Padmakumar , Leonard Lausen , Miguel Ballesteros , Sheng Zha , He He , George Karypis

In this paper we consider a problem known as multi-task learning, consisting of fitting a set of classifier or regression functions intended for solving different tasks. In our novel formulation, we couple the parameters of these functions,…

Machine Learning · Computer Science 2021-05-28 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

Multi-task learning (MTL) jointly learns a set of tasks by sharing parameters among tasks. It is a promising approach for reducing storage costs while improving task accuracy for many computer vision tasks. The effective adoption of MTL…

Machine Learning · Computer Science 2022-10-03 Lijun Zhang , Xiao Liu , Hui Guan

In this work we address task interference in universal networks by considering that a network is trained on multiple tasks, but performs one task at a time, an approach we refer to as "single-tasking multiple tasks". The network thus…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Kevis-Kokitsi Maninis , Ilija Radosavovic , Iasonas Kokkinos

Multi-task learning (MTL) is an active field in deep learning in which we train a model to jointly learn multiple tasks by exploiting relationships between the tasks. It has been shown that MTL helps the model share the learned features…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Akihiro Nakano , Shi Chen , Kazuyuki Demachi

This paper explores learned-context neural networks. It is a multi-task learning architecture based on a fully shared neural network and an augmented input vector containing trainable task parameters. The architecture is interesting due to…

Machine Learning · Computer Science 2025-08-07 Anders T. Sandnes , Bjarne Grimstad , Odd Kolbjørnsen

Tree-structured multi-task architectures have been employed to jointly tackle multiple vision tasks in the context of multi-task learning (MTL). The major challenge is to determine where to branch out for each task given a backbone model to…

Machine Learning · Computer Science 2022-05-26 Lijun Zhang , Xiao Liu , Hui Guan

Multi-Task Learning (MTL) is a framework, where multiple related tasks are learned jointly and benefit from a shared representation space, or parameter transfer. To provide sufficient learning support, modern MTL uses annotated data with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

We propose a framework for training multiple neural networks simultaneously. The parameters from all models are regularised by the tensor trace norm, so that each neural network is encouraged to reuse others' parameters if possible -- this…

Machine Learning · Computer Science 2017-02-20 Yongxin Yang , Timothy M. Hospedales

Multi-task learning has the potential to improve generalization by maximizing positive transfer between tasks while reducing task interference. Fully achieving this potential is hindered by manually designed architectures that remain static…

Machine Learning · Computer Science 2023-05-02 Naresh Kumar Gurulingan , Bahram Zonooz , Elahe Arani

Multi-task learning has recently become a very active field in deep learning research. In contrast to learning a single task in isolation, multiple tasks are learned at the same time, thereby utilizing the training signal of related tasks…

Computation and Language · Computer Science 2019-04-24 Tobias Kahse

We propose a unified look at jointly learning multiple vision tasks and visual domains through universal representations, a single deep neural network. Learning multiple problems simultaneously involves minimizing a weighted sum of multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Wei-Hong Li , Xialei Liu , Hakan Bilen