English
Related papers

Related papers: Routing Networks: Adaptive Selection of Non-linear…

200 papers

Multi-task representation learning (MTRL) is an approach that learns shared latent representations across related tasks, facilitating collaborative learning that improves the overall learning efficiency. This paper studies MTRL for…

Machine Learning · Computer Science 2026-04-07 Yaoze Guo , Shana Moothedath

In the context of multi-task learning, neural networks with branched architectures have often been employed to jointly tackle the tasks at hand. Such ramified networks typically start with a number of shared layers, after which different…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Simon Vandenhende , Stamatios Georgoulis , Bert De Brabandere , Luc Van Gool

Multi-task learning (MTL) seeks to learn a single model to accomplish multiple tasks by leveraging shared information among the tasks. Existing MTL models, however, have been known to suffer from negative interference among tasks. Efforts…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Chuntao Ding , Zhichao Lu , Shangguang Wang , Ran Cheng , Vishnu Naresh Boddeti

Multi-Task Learning (MTL) is a framework, where multiple related tasks are learned jointly and benefit from a shared representation space, or parameter transfer. To provide sufficient learning support, modern MTL uses annotated data with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

We propose a unified framework for adaptive routing in multitask, multimodal prediction settings where data heterogeneity and task interactions vary across samples. Motivated by applications in psychotherapy where structured assessments and…

Multi-task learning (MTL) allows deep neural networks to learn from related tasks by sharing parameters with other networks. In practice, however, MTL involves searching an enormous space of possible parameter sharing architectures to find…

Machine Learning · Statistics 2018-11-20 Sebastian Ruder , Joachim Bingel , Isabelle Augenstein , Anders Søgaard

With the advent of deep learning, many dense prediction tasks, i.e. tasks that produce pixel-level predictions, have seen significant performance improvements. The typical approach is to learn these tasks in isolation, that is, a separate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Simon Vandenhende , Stamatios Georgoulis , Wouter Van Gansbeke , Marc Proesmans , Dengxin Dai , Luc Van Gool

Multi-task reinforcement learning (MTRL) aims to endow a single agent with the ability to perform well on multiple tasks. Recent works have focused on developing novel sophisticated architectures to improve performance, often resulting in…

Machine Learning · Computer Science 2025-03-13 Reginald McLean , Evangelos Chatzaroulas , Jordan Terry , Isaac Woungang , Nariman Farsad , Pablo Samuel Castro

When a number of similar tasks have to be learned simultaneously, multi-task learning (MTL) models can attain significantly higher accuracy than single-task learning (STL) models. However, the advantage of MTL depends on various factors,…

Machine Learning · Computer Science 2023-10-26 Afiya Ayman , Ayan Mukhopadhyay , Aron Laszka

A multi-task learning (MTL) system aims at solving multiple related tasks at the same time. With a fixed model capacity, the tasks would be conflicted with each other, and the system usually has to make a trade-off among learning all of…

Machine Learning · Computer Science 2021-02-16 Xi Lin , Zhiyuan Yang , Qingfu Zhang , Sam Kwong

Multi-task learning (MTL) seeks to improve the generalized performance of learning specific tasks, exploiting useful information incorporated in related tasks. As a promising area, this paper studies an MTL-based control approach…

Systems and Control · Electrical Eng. & Systems 2024-08-01 Andres Arias , Chuangchuang Sun

Multi-task learning (MTL) aims to improve the generalization of several related tasks by learning them jointly. As a comparison, in addition to the joint training scheme, modern meta-learning allows unseen tasks with limited labels during…

Machine Learning · Computer Science 2021-06-17 Haoxiang Wang , Han Zhao , Bo Li

Multi-task learning is a very challenging problem in reinforcement learning. While training multiple tasks jointly allow the policies to share parameters across different tasks, the optimization problem becomes non-trivial: It remains…

Machine Learning · Computer Science 2020-12-08 Ruihan Yang , Huazhe Xu , Yi Wu , Xiaolong Wang

Training multiple tasks jointly in one deep network yields reduced latency during inference and better performance over the single-task counterpart by sharing certain layers of a network. However, over-sharing a network could erroneously…

Machine Learning · Computer Science 2020-06-11 Pengsheng Guo , Chen-Yu Lee , Daniel Ulbricht

Multi-task learning is assumed as a powerful inference method, specifically, where there is a considerable correlation between multiple tasks, predicting them in an unique framework may enhance prediction results. This research challenges…

Machine Learning · Computer Science 2021-10-26 Ali Yazdizadeh , Arash Kalatian , Zachary Patterson , Bilal Farooq

The terms multi-task learning and multitasking are easily confused. Multi-task learning refers to a paradigm in machine learning in which a network is trained on various related tasks to facilitate the acquisition of tasks. In contrast,…

Machine Learning · Computer Science 2021-01-06 Sachin Ravi , Sebastian Musslick , Maia Hamin , Theodore L. Willke , Jonathan D. Cohen

Machine systems inherently generate signals in which fault conditions and various variables influence signals measured from machine system. Although many existing fault classification studies rely solely on direct fault labels, the…

Machine Learning · Computer Science 2026-03-24 Wonjun Yi , Rismaya Kumar Mishra , Yong-Hwa Park

The classical approach to non-linear regression in physics, is to take a mathematical model describing the functional dependence of the dependent variable from a set of independent variables, and then, using non-linear fitting algorithms,…

Machine Learning · Computer Science 2020-07-29 Umberto , Michelucci , Francesca Venturini

Multi-task learning (MTL) is a common paradigm that seeks to improve the generalization performance of task learning by training related tasks simultaneously. However, it is still a challenging problem to search the flexible and accurate…

Machine Learning · Computer Science 2019-11-20 Yingru Liu , Xuewen Yang , Dongliang Xie , Xin Wang , Li Shen , Haozhi Huang , Niranjan Balasubramanian

Packet routing is one of the fundamental problems in computer networks in which a router determines the next-hop of each packet in the queue to get it as quickly as possible to its destination. Reinforcement learning (RL) has been…

Networking and Internet Architecture · Computer Science 2019-11-15 Xinyu You , Xuanjie Li , Yuedong Xu , Hui Feng , Jin Zhao , Huaicheng Yan