English
Related papers

Related papers: Controllable Pareto Multi-Task Learning

200 papers

Multi-task learning is a powerful method for solving multiple correlated tasks simultaneously. However, it is often impossible to find one single solution to optimize all the tasks, since different tasks might conflict with each other.…

Machine Learning · Computer Science 2020-01-01 Xi Lin , Hui-Ling Zhen , Zhenhua Li , Qingfu Zhang , Sam Kwong

In Multi-Task Learning (MTL), tasks may compete and limit the performance achieved on each other, rather than guiding the optimization to a solution, superior to all its single-task trained counterparts. Since there is often not a unique…

Machine Learning · Computer Science 2023-06-16 Nikolaos Dimitriadis , Pascal Frossard , François Fleuret

Multi-task learning solves multiple correlated tasks. However, conflicts may exist between them. In such circumstances, a single solution can rarely optimize all the tasks, leading to performance trade-offs. To arrive at a set of optimized…

Artificial Intelligence · Computer Science 2024-03-26 Lu Bai , Abhishek Gupta , Yew-Soon Ong

Multi-objective optimization (MOO) problems require balancing competing objectives, often under constraints. The Pareto optimal solution set defines all possible optimal trade-offs over such objectives. In this work, we present a novel…

Machine Learning · Computer Science 2022-04-19 Soumyajit Gupta , Gurpreet Singh , Raghu Bollapragada , Matthew Lease

Multi-Task Learning (MTL) is a learning paradigm in machine learning and its aim is to leverage useful information contained in multiple related tasks to help improve the generalization performance of all the tasks. In this paper, we give a…

Machine Learning · Computer Science 2021-03-30 Yu Zhang , Qiang Yang

Multi-Task Learning (MTL) aims to learn multiple tasks simultaneously while exploiting their mutual relationships. By using shared resources to simultaneously calculate multiple outputs, this learning paradigm has the potential to have…

Machine Learning · Computer Science 2024-08-29 Maxime Fontana , Michael Spratling , Miaojing Shi

Multi-task learning (MTL) is a subfield of machine learning in which multiple tasks are simultaneously learned by a shared model. Such approaches offer advantages like improved data efficiency, reduced overfitting through shared…

Machine Learning · Computer Science 2020-09-22 Michael Crawshaw

Continual learning aims to learn multiple tasks sequentially. A key challenge in continual learning is balancing between two objectives: retaining knowledge from old tasks (stability) and adapting to new tasks (plasticity). Experience…

Machine Learning · Computer Science 2025-04-01 Song Lai , Zhe Zhao , Fei Zhu , Xi Lin , Qingfu Zhang , Gaofeng Meng

Autonomous robots are increasingly utilized in realistic scenarios with multiple complex tasks. In these scenarios, there may be a preferred way of completing all of the given tasks, but it is often in conflict with optimal execution.…

Robotics · Computer Science 2023-06-26 Peter Amorese , Morteza Lahijanian

Many real-world machine learning applications involve several learning tasks which are inter-related. For example, in healthcare domain, we need to learn a predictive model of a certain disease for many hospitals. The models for each…

Machine Learning · Computer Science 2016-10-03 Inci M. Baytas , Ming Yan , Anil K. Jain , Jiayu Zhou

In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them. Multi-task learning is inherently a multi-objective problem because different tasks may conflict, necessitating a trade-off. A common compromise…

Machine Learning · Computer Science 2019-01-14 Ozan Sener , Vladlen Koltun

Multi-task learning (MTL) aims to improve generalization performance by learning multiple related tasks simultaneously. While sometimes the underlying task relationship structure is known, often the structure needs to be estimated from data…

The terms multi-task learning and multitasking are easily confused. Multi-task learning refers to a paradigm in machine learning in which a network is trained on various related tasks to facilitate the acquisition of tasks. In contrast,…

Machine Learning · Computer Science 2021-01-06 Sachin Ravi , Sebastian Musslick , Maia Hamin , Theodore L. Willke , Jonathan D. Cohen

Multi-task learning (MTL) aims to improve the generalization of several related tasks by learning them jointly. As a comparison, in addition to the joint training scheme, modern meta-learning allows unseen tasks with limited labels during…

Machine Learning · Computer Science 2021-06-17 Haoxiang Wang , Han Zhao , Bo Li

Multi-Task Learning (MTL) involves the concurrent training of multiple tasks, offering notable advantages for dense prediction tasks in computer vision. MTL not only reduces training and inference time as opposed to having multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Maxime Fontana , Michael Spratling , Miaojing Shi

The multi-task learning (MTL) paradigm can be traced back to an early paper of Caruana (1997) in which it was argued that data from multiple tasks can be used with the aim to obtain a better performance over learning each task…

Machine Learning · Computer Science 2021-12-10 Andrea Ponti

Despite the recent progress in deep learning, most approaches still go for a silo-like solution, focusing on learning each task in isolation: training a separate neural network for each individual task. Many real-world problems, however,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Simon Vandenhende

Multi-task learning (MTL) refers to the paradigm of learning multiple related tasks together. In contrast, in single-task learning (STL) each individual task is learned independently. MTL often leads to better trained models because they…

Machine Learning · Statistics 2019-07-03 Jian Liang , Ziqi Liu , Jiayu Zhou , Xiaoqian Jiang , Changshui Zhang , Fei Wang

With the advent of deep learning, many dense prediction tasks, i.e. tasks that produce pixel-level predictions, have seen significant performance improvements. The typical approach is to learn these tasks in isolation, that is, a separate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Simon Vandenhende , Stamatios Georgoulis , Wouter Van Gansbeke , Marc Proesmans , Dengxin Dai , Luc Van Gool

Multi-task learning (MTL) improves prediction performance in different contexts by learning models jointly on multiple different, but related tasks. Network data, which are a priori data with a rich relational structure, provide an…

Machine Learning · Statistics 2014-11-11 Chen Fang , Daniel N. Rockmore
‹ Prev 1 2 3 10 Next ›