中文
相关论文

相关论文: Equitable Multi-task Learning

200 篇论文

Despite the widespread adoption of multi-task training in deep learning, little is understood about how multi-task learning (MTL) affects generalization. Prior work has conjectured that the negative effects of MTL are due to optimization…

机器学习 · 计算机科学 2025-01-31 David Mueller , Mark Dredze , Nicholas Andrews

Many real-world large-scale regression problems can be formulated as Multi-task Learning (MTL) problems with a massive number of tasks, as in retail and transportation domains. However, existing MTL methods still fail to offer both the…

机器学习 · 计算机科学 2018-11-15 Xiao He , Francesco Alesiani , Ammar Shaker

Multi-task learning can leverage information learned by one task to benefit the training of other tasks. Despite this capacity, naively training all tasks together in one model often degrades performance, and exhaustively searching through…

机器学习 · 计算机科学 2021-10-27 Christopher Fifty , Ehsan Amid , Zhe Zhao , Tianhe Yu , Rohan Anil , Chelsea Finn

The generalisation capacity of Multi-Task Learning (MTL) suffers when unrelated tasks negatively impact each other by updating shared parameters with conflicting gradients. This is known as negative transfer and leads to a drop in MTL…

机器学习 · 计算机科学 2024-09-25 Arjun Roy , Christos Koutlis , Symeon Papadopoulos , Eirini Ntoutsi

Multi-task learning (MTL) has become an essential machine learning tool for addressing multiple learning tasks simultaneously and has been effectively applied across fields such as healthcare, marketing, and biomedical research. However, to…

机器学习 · 统计学 2025-06-02 Yang Sui , Qi Xu , Yang Bai , Annie Qu

Multi-Task Learning (MTL) has achieved success in various fields. However, how to balance different tasks to achieve good performance is a key problem. To achieve the task balancing, there are many works to carefully design dynamical…

机器学习 · 计算机科学 2022-07-28 Baijiong Lin , Feiyang Ye , Yu Zhang , Ivor W. Tsang

Learning two tasks in a single shared function has some benefits. Firstly by acquiring information from the second task, the shared function leverages useful information that could have been neglected or underestimated in the first task.…

机器学习 · 计算机科学 2020-08-06 Jonghwa Yim , Sang Hwan Kim

In industrial recommendation systems, multi-task learning (learning multiple tasks simultaneously on a single model) is a predominant approach to save training/serving resources and improve recommendation performance via knowledge transfer…

While robot learning has demonstrated promising results for enabling robots to automatically acquire new skills, a critical challenge in deploying learning-based systems is scale: acquiring enough data for the robot to effectively…

机器人学 · 计算机科学 2020-03-06 Avi Singh , Eric Jang , Alexander Irpan , Daniel Kappler , Murtaza Dalal , Sergey Levine , Mohi Khansari , Chelsea Finn

In recent years, bilevel optimization (BLO) has attracted significant attention for its broad applications in machine learning. However, most existing works on BLO remain confined to the single-task setting and rely on the lower-level…

机器学习 · 计算机科学 2026-05-15 Zhiyao Zhang , Myeung Suk Oh , Zhen Qin , Jiaxiang Li , Xin Zhang , Jia Liu

In multi-task learning (MTL), we improve the performance of key machine learning algorithms by training various tasks jointly. When the number of tasks is large, modeling task structure can further refine the task relationship model. For…

机器学习 · 计算机科学 2020-11-25 Xiangyu Niu , Yifan Sun , Jinyuan Sun

Multi-Task Learning (MTL) is a foundational machine learning problem that has seen extensive development over the past decade. Recently, various optimization-based MTL approaches have been proposed to learn multiple tasks simultaneously by…

机器学习 · 计算机科学 2026-04-13 Zhipeng Zhou , Linxiao Cao , Pengcheng Wu , Peilin Zhao , Chunyan Miao

Multi-task learning (MTL) refers to the paradigm of learning multiple related tasks together. In contrast, in single-task learning (STL) each individual task is learned independently. MTL often leads to better trained models because they…

机器学习 · 统计学 2019-07-03 Jian Liang , Ziqi Liu , Jiayu Zhou , Xiaoqian Jiang , Changshui Zhang , Fei Wang

Scarcity of parallel sentence pairs is a major challenge for training high quality neural machine translation (NMT) models in bilingually low-resource scenarios, as NMT is data-hungry. Multi-task learning is an elegant approach to inject…

计算与语言 · 计算机科学 2020-01-13 Poorya Zaremoodi , Gholamreza Haffari

Multitask learning is a framework that enforces multiple learning tasks to share knowledge to improve their generalization abilities. While shallow multitask learning can learn task relations, it can only handle predefined features. Modern…

机器学习 · 计算机科学 2022-07-05 Guangji Bai , Liang Zhao

Evolutionary multi-task optimization (EMTO) is an advanced optimization paradigm that improves search efficiency by enabling knowledge transfer across multiple tasks solved in parallel. Accordingly, a broad range of knowledge transfer…

神经与进化计算 · 计算机科学 2026-04-01 Xuebin Lyu , Yuxiao Huang , XueFeng Chen , Jing Tang , Liang Feng , Kay Chen Tan

Multi-task learning (MTL) aims to improve the performance of a primary task by jointly learning with related auxiliary tasks. Traditional MTL methods select tasks randomly during training. However, both previous studies and our results…

计算与语言 · 计算机科学 2024-01-12 Xiangheng He , Junjie Chen , Björn W. Schuller

Multi-task learning is a framework that enforces different learning tasks to share their knowledge to improve their generalization performance. It is a hot and active domain that strives to handle several core issues; particularly, which…

机器学习 · 计算机科学 2021-02-23 Johnny Torres , Guangji Bai , Junxiang Wang , Liang Zhao , Carmen Vaca , Cristina Abad

Multi-task learning (MTL) is a novel framework to learn several tasks simultaneously with a single shared network where each task has its distinct personalized header network for fine-tuning. MTL can be implemented in federated learning…

机器学习 · 计算机科学 2022-03-28 Matin Mortaheb , Cemil Vahapoglu , Sennur Ulukus

Efficient machine learning (ML) has become increasingly important as models grow larger and data volumes expand. In this work, we address the trade-off between generalization in multi-task learning (MTL) and precision in single-task…

机器学习 · 计算机科学 2025-05-02 Dong Liu , Yanxuan Yu