中文
相关论文

相关论文: Which Tasks Should Be Learned Together in Multi-ta…

200 篇论文

Training multiple tasks jointly in one deep network yields reduced latency during inference and better performance over the single-task counterpart by sharing certain layers of a network. However, over-sharing a network could erroneously…

机器学习 · 计算机科学 2020-06-11 Pengsheng Guo , Chen-Yu Lee , Daniel Ulbricht

We consider a multitask learning problem, in which several predictors are learned jointly. Prior research has shown that learning the relations between tasks, and between the input features, together with the predictor, can lead to better…

机器学习 · 计算机科学 2019-07-11 Han Zhao , Otilia Stretcu , Alex Smola , Geoff Gordon

A multi-task learning (MTL) system aims at solving multiple related tasks at the same time. With a fixed model capacity, the tasks would be conflicted with each other, and the system usually has to make a trade-off among learning all of…

机器学习 · 计算机科学 2021-02-16 Xi Lin , Zhiyuan Yang , Qingfu Zhang , Sam Kwong

Multi-task learning has been widely applied in computational vision, natural language processing and other fields, which has achieved well performance. In recent years, a lot of work about multi-task learning recommender system has been…

信息检索 · 计算机科学 2023-05-24 Mingzhu Zhang , Ruiping Yin , Zhen Yang , Yipeng Wang , Kan Li

Reliable and effective multi-task learning is a prerequisite for the development of robotic agents that can quickly learn to accomplish related, everyday tasks. However, in the reinforcement learning domain, multi-task learning has not…

机器学习 · 计算机科学 2018-02-06 Himani Arora , Rajath Kumar , Jason Krone , Chong Li

Is more data always better to train vision-and-language models? We study knowledge transferability in multi-modal tasks. The current tendency in machine learning is to assume that by joining multiple datasets from different tasks their…

计算机视觉与模式识别 · 计算机科学 2022-08-24 Tianwei Chen , Noa Garcia , Mayu Otani , Chenhui Chu , Yuta Nakashima , Hajime Nagahara

Multi-task learning is a framework that enforces different learning tasks to share their knowledge to improve their generalization performance. It is a hot and active domain that strives to handle several core issues; particularly, which…

机器学习 · 计算机科学 2021-02-23 Johnny Torres , Guangji Bai , Junxiang Wang , Liang Zhao , Carmen Vaca , Cristina Abad

Multi-task learning (MTL) aims at achieving a better model by leveraging data and knowledge from multiple tasks. However, MTL does not always work -- sometimes negative transfer occurs between tasks, especially when aggregating loosely…

计算与语言 · 计算机科学 2023-05-24 Jingwei Ni , Zhijing Jin , Qian Wang , Mrinmaya Sachan , Markus Leippold

Recent work has found that multi-task training with a large number of diverse tasks can uniformly improve downstream performance on unseen target tasks. In contrast, literature on task transferability has established that the choice of…

计算与语言 · 计算机科学 2022-07-13 Vishakh Padmakumar , Leonard Lausen , Miguel Ballesteros , Sheng Zha , He He , George Karypis

In this paper we consider a problem known as multi-task learning, consisting of fitting a set of classifier or regression functions intended for solving different tasks. In our novel formulation, we couple the parameters of these functions,…

机器学习 · 计算机科学 2021-05-28 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

Multi-task learning (MTL) jointly learns a set of tasks by sharing parameters among tasks. It is a promising approach for reducing storage costs while improving task accuracy for many computer vision tasks. The effective adoption of MTL…

机器学习 · 计算机科学 2022-10-03 Lijun Zhang , Xiao Liu , Hui Guan

In this work we address task interference in universal networks by considering that a network is trained on multiple tasks, but performs one task at a time, an approach we refer to as "single-tasking multiple tasks". The network thus…

计算机视觉与模式识别 · 计算机科学 2019-04-19 Kevis-Kokitsi Maninis , Ilija Radosavovic , Iasonas Kokkinos

Multi-task learning (MTL) is an active field in deep learning in which we train a model to jointly learn multiple tasks by exploiting relationships between the tasks. It has been shown that MTL helps the model share the learned features…

计算机视觉与模式识别 · 计算机科学 2021-11-30 Akihiro Nakano , Shi Chen , Kazuyuki Demachi

This paper explores learned-context neural networks. It is a multi-task learning architecture based on a fully shared neural network and an augmented input vector containing trainable task parameters. The architecture is interesting due to…

机器学习 · 计算机科学 2025-08-07 Anders T. Sandnes , Bjarne Grimstad , Odd Kolbjørnsen

Tree-structured multi-task architectures have been employed to jointly tackle multiple vision tasks in the context of multi-task learning (MTL). The major challenge is to determine where to branch out for each task given a backbone model to…

机器学习 · 计算机科学 2022-05-26 Lijun Zhang , Xiao Liu , Hui Guan

Multi-Task Learning (MTL) is a framework, where multiple related tasks are learned jointly and benefit from a shared representation space, or parameter transfer. To provide sufficient learning support, modern MTL uses annotated data with…

计算机视觉与模式识别 · 计算机科学 2024-01-04 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

We propose a framework for training multiple neural networks simultaneously. The parameters from all models are regularised by the tensor trace norm, so that each neural network is encouraged to reuse others' parameters if possible -- this…

机器学习 · 计算机科学 2017-02-20 Yongxin Yang , Timothy M. Hospedales

Multi-task learning has the potential to improve generalization by maximizing positive transfer between tasks while reducing task interference. Fully achieving this potential is hindered by manually designed architectures that remain static…

机器学习 · 计算机科学 2023-05-02 Naresh Kumar Gurulingan , Bahram Zonooz , Elahe Arani

Multi-task learning has recently become a very active field in deep learning research. In contrast to learning a single task in isolation, multiple tasks are learned at the same time, thereby utilizing the training signal of related tasks…

计算与语言 · 计算机科学 2019-04-24 Tobias Kahse

We propose a unified look at jointly learning multiple vision tasks and visual domains through universal representations, a single deep neural network. Learning multiple problems simultaneously involves minimizing a weighted sum of multiple…

计算机视觉与模式识别 · 计算机科学 2022-08-31 Wei-Hong Li , Xialei Liu , Hakan Bilen