中文
相关论文

相关论文: Controllable Pareto Multi-Task Learning

200 篇论文

Existing deep multitask learning (MTL) approaches align layers shared between tasks in a parallel ordering. Such an organization significantly constricts the types of shared structure that can be learned. The necessity of parallel ordering…

机器学习 · 计算机科学 2018-02-14 Elliot Meyerson , Risto Miikkulainen

Multi-task learning (MTL) aims to improve the performance of multiple related prediction tasks by leveraging useful information from them. Due to their flexibility and ability to reduce unknown coefficients substantially, the…

机器学习 · 计算机科学 2022-12-01 Yuzhao Zhang , Yifan Sun

For a control problem with multiple conflicting objectives, there exists a set of Pareto-optimal policies called the Pareto set instead of a single optimal policy. When a multi-objective control problem is continuous and complex,…

人工智能 · 计算机科学 2024-06-28 Tianye Shu , Ke Shang , Cheng Gong , Yang Nan , Hisao Ishibuchi

Multi-task learning (MTL) optimizes several learning tasks simultaneously and leverages their shared information to improve generalization and the prediction of the model for each task. Auxiliary tasks can be added to the main task to…

机器学习 · 计算机科学 2020-07-03 Partoo Vafaeikia , Khashayar Namdar , Farzad Khalvati

Traditionally, multitask learning (MTL) assumes that all the tasks are related. This can lead to negative transfer when tasks are indeed incoherent. Recently, a number of approaches have been proposed that alleviate this problem by…

机器学习 · 计算机科学 2012-06-22 Wenliang Zhong , James Kwok

Multi-task learning aims to learn multiple tasks jointly by exploiting their relatedness to improve the generalization performance for each task. Traditionally, to perform multi-task learning, one needs to centralize data from all the tasks…

机器学习 · 计算机科学 2017-06-21 Sulin Liu , Sinno Jialin Pan , Qirong Ho

To date, the multi-objective optimization literature has mainly focused on conflicting objectives, studying the Pareto front, or requiring users to balance tradeoffs. Yet, in machine learning practice, there are many scenarios where such…

机器学习 · 计算机科学 2025-03-05 Yonathan Efroni , Ben Kretzu , Daniel Jiang , Jalaj Bhandari , Zheqing , Zhu , Karen Ullrich

Multi-task learning (MTL) has led to successes in many applications of machine learning, from natural language processing and speech recognition to computer vision and drug discovery. This article aims to give a general overview of MTL,…

机器学习 · 计算机科学 2017-06-19 Sebastian Ruder

Multi-task learning (MTL) is an inductive transfer mechanism designed to leverage useful information from multiple tasks to improve generalization performance compared to single-task learning. It has been extensively explored in traditional…

机器学习 · 计算机科学 2025-01-13 Varun Kumar , Somdatta Goswami , Katiana Kontolati , Michael D. Shields , George Em Karniadakis

Multi-objective reinforcement learning (MORL) is a structured approach for optimizing tasks with multiple objectives. However, it often relies on pre-defined reward functions, which can be hard to design for balancing conflicting goals and…

机器学习 · 计算机科学 2025-07-21 Ni Mu , Yao Luan , Qing-Shan Jia

Multi-task learning (MTL) has shown great potential in medical image analysis, improving the generalizability of the learned features and the performance in individual tasks. However, most of the work on MTL focuses on either architecture…

计算机视觉与模式识别 · 计算机科学 2023-09-22 Fuping Wu , Le Zhang , Yang Sun , Yuanhan Mo , Thomas Nichols , Bartlomiej W. Papiez

Multi-task learning (MTL) has become increasingly popular in natural language processing (NLP) because it improves the performance of related tasks by exploiting their commonalities and differences. Nevertheless, it is still not understood…

计算与语言 · 计算机科学 2023-02-16 Zhihan Zhang , Wenhao Yu , Mengxia Yu , Zhichun Guo , Meng Jiang

Many problems in machine learning rely on multi-task learning (MTL), in which the goal is to solve multiple related machine learning tasks simultaneously. MTL is particularly relevant for privacy-sensitive applications in areas such as…

机器学习 · 计算机科学 2023-10-18 Shengyuan Hu , Zhiwei Steven Wu , Virginia Smith

Multi-task learning, in which several tasks are jointly learned by a single model, allows NLP models to share information from multiple annotations and may facilitate better predictions when the tasks are inter-related. This technique,…

计算与语言 · 计算机科学 2022-10-31 Guy Rotman , Roi Reichart

Multi-task learning (MTL) algorithms typically rely on schemes that combine different task losses or their gradients through weighted averaging. These methods aim to find Pareto stationary points by using heuristics that require access to…

机器学习 · 计算机科学 2026-02-03 Surya Murthy , Kushagra Gupta , Mustafa O. Karabag , David Fridovich-Keil , Ufuk Topcu

Constructing useful representations across a large number of tasks is a key requirement for sample-efficient intelligent systems. A traditional idea in multitask learning (MTL) is building a shared representation across tasks which can then…

机器学习 · 计算机科学 2023-03-09 Yingcong Li , Samet Oymak

Recent advances in Federated Learning (FL) have paved the way towards the design of novel strategies for solving multiple learning tasks simultaneously, by leveraging cooperation among networked devices. Multi-Task Learning (MTL) exploits…

机器学习 · 计算机科学 2022-12-23 Stefano Savazzi , Vittorio Rampa , Sanaz Kianoush , Mehdi Bennis

In the paradigm of multi-task learning, mul- tiple related prediction tasks are learned jointly, sharing information across the tasks. We propose a framework for multi-task learn- ing that enables one to selectively share the information…

机器学习 · 计算机科学 2012-07-03 Abhishek Kumar , Hal Daume

Multi-task reinforcement learning (MTRL) aims to endow a single agent with the ability to perform well on multiple tasks. Recent works have focused on developing novel sophisticated architectures to improve performance, often resulting in…

By searching for shared inductive biases across tasks, meta-learning promises to accelerate learning on novel tasks, but with the cost of solving a complex bilevel optimization problem. We introduce and rigorously define the trade-off…

机器学习 · 计算机科学 2021-04-15 Katelyn Gao , Ozan Sener