中文
相关论文

相关论文: NTKMTL: Mitigating Task Imbalance in Multi-Task Le…

200 篇论文

Multi-task reinforcement learning (MTRL) aims to endow a single agent with the ability to perform well on multiple tasks. Recent works have focused on developing novel sophisticated architectures to improve performance, often resulting in…

Balancing competing objectives remains a fundamental challenge in multi-task learning (MTL), primarily due to conflicting gradients across individual tasks. A common solution relies on computing a dynamic gradient update vector that…

Multi-task learning (MTL) is a supervised learning paradigm in which the prediction models for several related tasks are learned jointly to achieve better generalization performance. When there are only a few training examples per task, MTL…

机器学习 · 计算机科学 2017-06-07 Azad Naik , Anveshi Charuvaka , Huzefa Rangwala

Multi-task learning (MTL) is a powerful machine learning paradigm designed to leverage shared knowledge across tasks to improve generalization and performance. Previous works have proposed approaches to MTL that can be divided into feature…

机器学习 · 计算机科学 2024-06-13 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

Wireless signal recognition is becoming increasingly more significant for spectrum monitoring, spectrum management, and secure communications. Consequently, it will become a key enabler with the emerging fifth-generation (5G) and beyond 5G…

机器学习 · 计算机科学 2021-02-23 Anu Jagannath , Jithin Jagannath

The Multi-Task Learning (MTL) technique has been widely studied by word-wide researchers. The majority of current MTL studies adopt the hard parameter sharing structure, where hard layers tend to learn general representations over all tasks…

信息检索 · 计算机科学 2021-01-25 Dehong Gao , Wenjing Yang , Huiling Zhou , Yi Wei , Yi Hu , Hao Wang

Over the past decades, researchers have primarily focused on improving the generalization abilities of models, with limited attention given to regulating such generalization. However, the ability of models to generalize to unintended data…

机器学习 · 计算机科学 2025-03-10 Ziming Hong , Yongli Xiang , Tongliang Liu

Multi-task learning (MTL) has achieved remarkable success in natural language processing applications. In this work, we study a multi-task learning model with multiple decoders on varieties of biomedical and clinical natural language…

计算与语言 · 计算机科学 2020-05-07 Yifan Peng , Qingyu Chen , Zhiyong Lu

Distributed multi-task learning (DMTL) effectively improves model generalization performance through the collaborative training of multiple related models. However, in large-scale learning scenarios, communication bottlenecks severely limit…

信息论 · 计算机科学 2025-07-25 Minquan Cheng , Yongkang Wang , Lingyu Zhang , Youlong Wu

Multi-task learning (MTL) paradigm focuses on jointly learning two or more tasks, aiming for significant improvement w.r.t model's generalizability, performance, and training/inference memory footprint. The aforementioned benefits become…

计算机视觉与模式识别 · 计算机科学 2022-10-27 Nitin Bansal , Pan Ji , Junsong Yuan , Yi Xu

Tree-structured multi-task architectures have been employed to jointly tackle multiple vision tasks in the context of multi-task learning (MTL). The major challenge is to determine where to branch out for each task given a backbone model to…

机器学习 · 计算机科学 2022-05-26 Lijun Zhang , Xiao Liu , Hui Guan

We introduce CAMRL, the first curriculum-based asymmetric multi-task learning (AMTL) algorithm for dealing with multiple reinforcement learning (RL) tasks altogether. To mitigate the negative influence of customizing the one-off training…

机器学习 · 计算机科学 2022-11-08 Hanchi Huang , Deheng Ye , Li Shen , Wei Liu

In recent years, Multi-Task Learning (MTL) has attracted much attention due to its good performance in many applications. However, many existing MTL models cannot guarantee that their performance is no worse than their single-task…

机器学习 · 计算机科学 2022-10-04 Zhixiong Yue , Feiyang Ye , Yu Zhang , Christy Liang , Ivor W. Tsang

While the promises of Multi-Task Learning (MTL) are attractive, characterizing the conditions of its success is still an open problem in Deep Learning. Some tasks may benefit from being learned together while others may be detrimental to…

机器学习 · 计算机科学 2023-01-10 Raphael Azorin , Massimo Gallo , Alessandro Finamore , Dario Rossi , Pietro Michiardi

A multi-task learning (MTL) system aims at solving multiple related tasks at the same time. With a fixed model capacity, the tasks would be conflicted with each other, and the system usually has to make a trade-off among learning all of…

机器学习 · 计算机科学 2021-02-16 Xi Lin , Zhiyuan Yang , Qingfu Zhang , Sam Kwong

The problem of learning simultaneously several related tasks has received considerable attention in several domains, especially in machine learning with the so-called multitask learning problem or learning to learn problem [1], [2].…

信号处理 · 电气工程与系统科学 2021-09-29 Roula Nassif , Stefan Vlaski , Cedric Richard , Jie Chen , Ali H. Sayed

Since its inception, the modus operandi of multi-task learning (MTL) has been to minimize the task-wise mean of the empirical risks. We introduce a generalized loss-compositional paradigm for MTL that includes a spectrum of formulations as…

机器学习 · 计算机科学 2012-09-14 Nishant A. Mehta , Dongryeol Lee , Alexander G. Gray

This paper investigates the use of nonparametric kernel-regression to obtain a tasksimilarity aware meta-learning algorithm. Our hypothesis is that the use of tasksimilarity helps meta-learning when the available tasks are limited and may…

机器学习 · 计算机科学 2020-10-13 Arun Venkitaraman , Anders Hansson , Bo Wahlberg

We are beginning to see progress in language model assisted scientific discovery. Motivated by the use of LLMs as a general scientific assistant, this paper assesses the domain knowledge of LLMs through its understanding of different…

人工智能 · 计算机科学 2024-05-27 Siyuan Guo , Aniket Didolkar , Nan Rosemary Ke , Anirudh Goyal , Ferenc Huszár , Bernhard Schölkopf

Multi-task learning (MTL) is an efficient solution to solve multiple tasks simultaneously in order to get better speed and performance than handling each single-task in turn. The most current methods can be categorized as either: (i) hard…

计算机视觉与模式识别 · 计算机科学 2019-12-02 Yifan Liu , Bohan Zhuang , Chunhua Shen , Hao Chen , Wei Yin