中文
相关论文

相关论文: A Brief Review of Deep Multi-task Learning and Aux…

200 篇论文

Multi-task learning (MTL) is a methodology that aims to improve the general performance of estimation and prediction by sharing common information among related tasks. In the MTL, there are several assumptions for the relationships and…

统计方法学 · 统计学 2023-04-27 Akira Okazaki , Shuichi Kawano

In recent years, Multi-Task Learning (MTL) has attracted much attention due to its good performance in many applications. However, many existing MTL models cannot guarantee that their performance is no worse than their single-task…

机器学习 · 计算机科学 2022-10-04 Zhixiong Yue , Feiyang Ye , Yu Zhang , Christy Liang , Ivor W. Tsang

We investigate whether and where multi-task learning (MTL) can improve performance on NLP problems related to argumentation mining (AM), in particular argument component identification. Our results show that MTL performs particularly well…

计算与语言 · 计算机科学 2018-05-07 Claudia Schulz , Steffen Eger , Johannes Daxenberger , Tobias Kahse , Iryna Gurevych

Multi-task learning (MTL) has achieved great success in various research domains, such as CV, NLP and IR etc. Due to the complex and competing task correlation, naive training all tasks may lead to inequitable learning, i.e. some tasks are…

机器学习 · 计算机科学 2023-06-21 Jun Yuan , Rui Zhang

In multi-task learning (MTL), we improve the performance of key machine learning algorithms by training various tasks jointly. When the number of tasks is large, modeling task structure can further refine the task relationship model. For…

机器学习 · 计算机科学 2020-11-25 Xiangyu Niu , Yifan Sun , Jinyuan Sun

Multitask learning (MTL) aims to learn multiple tasks simultaneously through the interdependence between different tasks. The way to measure the relatedness between tasks is always a popular issue. There are mainly two ways to measure…

机器学习 · 计算机科学 2019-04-04 Ya Li , Xinmei Tian , Tongliang Liu , Dacheng Tao

Multi-task learning (MTL) is an active field in deep learning in which we train a model to jointly learn multiple tasks by exploiting relationships between the tasks. It has been shown that MTL helps the model share the learned features…

计算机视觉与模式识别 · 计算机科学 2021-11-30 Akihiro Nakano , Shi Chen , Kazuyuki Demachi

In order to create machine learning systems that serve a variety of users well, it is vital to not only achieve high average performance but also ensure equitable outcomes across diverse groups. However, most machine learning methods are…

机器学习 · 计算机科学 2024-03-01 Atharva Kulkarni , Lucio Dery , Amrith Setlur , Aditi Raghunathan , Ameet Talwalkar , Graham Neubig

Multi-task learning (MTL) aims to improve generalization performance by learning multiple related tasks simultaneously. While sometimes the underlying task relationship structure is known, often the structure needs to be estimated from data…

We study three general multi-task learning (MTL) approaches on 11 sequence tagging tasks. Our extensive empirical results show that in about 50% of the cases, jointly learning all 11 tasks improves upon either independent or pairwise…

计算与语言 · 计算机科学 2018-08-14 Soravit Changpinyo , Hexiang Hu , Fei Sha

Multi-task learning (MTL) aims at achieving a better model by leveraging data and knowledge from multiple tasks. However, MTL does not always work -- sometimes negative transfer occurs between tasks, especially when aggregating loosely…

计算与语言 · 计算机科学 2023-05-24 Jingwei Ni , Zhijing Jin , Qian Wang , Mrinmaya Sachan , Markus Leippold

Multi-task learning aims to learn multiple tasks jointly by exploiting their relatedness to improve the generalization performance for each task. Traditionally, to perform multi-task learning, one needs to centralize data from all the tasks…

机器学习 · 计算机科学 2017-06-21 Sulin Liu , Sinno Jialin Pan , Qirong Ho

Multi-task learning (MTL) considers learning a joint model for multiple tasks by optimizing a convex combination of all task losses. To solve the optimization problem, existing methods use an adaptive weight updating scheme, where task…

机器学习 · 计算机科学 2024-07-22 Yifei He , Shiji Zhou , Guojun Zhang , Hyokun Yun , Yi Xu , Belinda Zeng , Trishul Chilimbi , Han Zhao

Auxiliary tasks facilitate learning in situations where data is scarce or the principal task of interest is extremely complex. This idea is primarily inspired by the improved generalization capability induced by solving multiple tasks…

机器学习 · 计算机科学 2025-07-28 Geri Skenderi , Luigi Capogrosso , Andrea Toaiari , Matteo Denitto , Franco Fummi , Simone Melzi

Multi-task learning (MTL) jointly learns a set of tasks by sharing parameters among tasks. It is a promising approach for reducing storage costs while improving task accuracy for many computer vision tasks. The effective adoption of MTL…

机器学习 · 计算机科学 2022-10-03 Lijun Zhang , Xiao Liu , Hui Guan

Multi-Task Learning (MTL) is a framework, where multiple related tasks are learned jointly and benefit from a shared representation space, or parameter transfer. To provide sufficient learning support, modern MTL uses annotated data with…

计算机视觉与模式识别 · 计算机科学 2024-01-04 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

Efficient machine learning (ML) has become increasingly important as models grow larger and data volumes expand. In this work, we address the trade-off between generalization in multi-task learning (MTL) and precision in single-task…

机器学习 · 计算机科学 2025-05-02 Dong Liu , Yanxuan Yu

Deep multitask learning boosts performance by sharing learned structure across related tasks. This paper adapts ideas from deep multitask learning to the setting where only a single task is available. The method is formalized as pseudo-task…

机器学习 · 计算机科学 2018-06-13 Elliot Meyerson , Risto Miikkulainen

This work proposes Multi-task Meta Learning (MTML), integrating two learning paradigms Multi-Task Learning (MTL) and meta learning, to bring together the best of both worlds. In particular, it focuses simultaneous learning of multiple…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Richa Upadhyay , Prakash Chandra Chhipa , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

Multi-Task Learning (MTL) is a foundational machine learning problem that has seen extensive development over the past decade. Recently, various optimization-based MTL approaches have been proposed to learn multiple tasks simultaneously by…

机器学习 · 计算机科学 2026-04-13 Zhipeng Zhou , Linxiao Cao , Pengcheng Wu , Peilin Zhao , Chunyan Miao