English
Related papers

Related papers: Multitask Learning Can Improve Worst-Group Outcome…

200 papers

Multi-Task Learning (MTL) is widely-accepted in Natural Language Processing as a standard technique for learning multiple related tasks in one model. Training an MTL model requires having the training data for all tasks available at the…

Computation and Language · Computer Science 2023-02-23 Sudipta Kar , Giuseppe Castellucci , Simone Filice , Shervin Malmasi , Oleg Rokhlenko

Representation multi-task learning (MTL) has achieved tremendous success in practice. However, the theoretical understanding of these methods is still lacking. Most existing theoretical works focus on cases where all tasks share the same…

Machine Learning · Statistics 2025-07-08 Ye Tian , Yuqi Gu , Yang Feng

End-to-end speech-to-text translation typically suffers from the scarcity of paired speech-text data. One way to overcome this shortcoming is to utilize the bitext data from the Machine Translation (MT) task and perform Multi-Task Learning…

Computation and Language · Computer Science 2025-09-15 JungHo Jung , Junhyun Lee

Multi-task learning is a learning paradigm which seeks to improve the generalization performance of a learning task with the help of some other related tasks. In this paper, we propose a regularization formulation for learning the…

Machine Learning · Computer Science 2012-03-19 Yu Zhang , Dit-Yan Yeung

This paper addresses a critical societal consideration in the application of Reinforcement Learning (RL): ensuring equitable outcomes across different demographic groups in multi-task settings. While previous work has explored fairness in…

Machine Learning · Computer Science 2025-03-12 Kefan Song , Runnan Jiang , Rohan Chandra , Shangtong Zhang

Purpose: Surgery scene understanding with tool-tissue interaction recognition and automatic report generation can play an important role in intra-operative guidance, decision-making and postoperative analysis in robotic surgery. However,…

Artificial Intelligence · Computer Science 2022-11-29 Lalithkumar Seenivasan , Mobarakol Islam , Mengya Xu , Chwee Ming Lim , Hongliang Ren

Diagnosis of adverse neonatal outcomes is crucial for preterm survival since it enables doctors to provide timely treatment. Machine learning (ML) algorithms have been demonstrated to be effective in predicting adverse neonatal outcomes.…

We propose a multi-task learning (MTL) model for jointly performing three tasks that are commonly solved in a text-to-speech (TTS) front-end: text normalization (TN), part-of-speech (POS) tagging, and homograph disambiguation (HD). Our…

Computation and Language · Computer Science 2024-04-04 Wonjune Kang , Yun Wang , Shun Zhang , Arthur Hinsvark , Qing He

Multi-task learning (MTL) can improve performance on a task by sharing representations with one or more related auxiliary-tasks. Usually, MTL-networks are trained on a composite loss function formed by a constant weighted combination of the…

Machine Learning · Computer Science 2020-08-31 Sam Verboven , Muhammad Hafeez Chaudhary , Jeroen Berrevoets , Wouter Verbeke

Multi-Task Learning (MTL) aims to boost predictive performance by sharing information across related tasks, yet conventional methods often suffer from negative transfer when unrelated or noisy tasks are forced to share representations. We…

Machine Learning · Computer Science 2026-02-17 Seyedsaman Emami , Daniel Hernández-Lobato , Gonzalo Martínez-Muñoz

Multi-Task Learning is a learning paradigm that uses correlated tasks to improve performance generalization. A common way to learn multiple tasks is through the hard parameter sharing approach, in which a single architecture is used to…

Machine Learning · Computer Science 2022-04-15 Angelica Tiemi Mizuno Nakamura , Denis Fernando Wolf , Valdir Grassi

Multi-task learning (MTL) has become an essential machine learning tool for addressing multiple learning tasks simultaneously and has been effectively applied across fields such as healthcare, marketing, and biomedical research. However, to…

Machine Learning · Statistics 2025-06-02 Yang Sui , Qi Xu , Yang Bai , Annie Qu

Reinforcement learning (RL) has shown great effectiveness in quadrotor control, enabling specialized policies to develop even human-champion-level performance in single-task scenarios. However, these specialized policies often struggle with…

Robotics · Computer Science 2024-12-18 Jiaxu Xing , Ismail Geles , Yunlong Song , Elie Aljalbout , Davide Scaramuzza

Multi-Task Learning has emerged as a methodology in which multiple tasks are jointly learned by a shared learning algorithm, such as a DNN. MTL is based on the assumption that the tasks under consideration are related; therefore it exploits…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

The application of large language models (LLMs) in domain-specific contexts, including finance, has expanded rapidly. Domain-specific LLMs are typically evaluated based on their performance in various downstream tasks relevant to the…

Artificial Intelligence · Computer Science 2024-12-06 Meni Brief , Oded Ovadia , Gil Shenderovitz , Noga Ben Yoash , Rachel Lemberg , Eitam Sheetrit

Multi-task learning has the potential to improve generalization by maximizing positive transfer between tasks while reducing task interference. Fully achieving this potential is hindered by manually designed architectures that remain static…

Machine Learning · Computer Science 2023-05-02 Naresh Kumar Gurulingan , Bahram Zonooz , Elahe Arani

Adapting models pre-trained on large-scale datasets to a variety of downstream tasks is a common strategy in deep learning. Consequently, parameter-efficient fine-tuning methods have emerged as a promising way to adapt pre-trained models to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Ahmed Agiza , Marina Neseem , Sherief Reda

In recent years, Multi-task Learning (MTL) has yielded immense success in Recommender System (RS) applications. However, current MTL-based recommendation models tend to disregard the session-wise patterns of user-item interactions because…

Information Retrieval · Computer Science 2023-03-13 Ziru Liu , Jiejie Tian , Qingpeng Cai , Xiangyu Zhao , Jingtong Gao , Shuchang Liu , Dayou Chen , Tonghao He , Dong Zheng , Peng Jiang , Kun Gai

Multi-task learning (MTL) has been widely used in recommender systems, wherein predicting each type of user feedback on items (e.g, click, purchase) are treated as individual tasks and jointly trained with a unified model. Our key…

Information Retrieval · Computer Science 2022-03-29 Chenxiao Yang , Junwei Pan , Xiaofeng Gao , Tingyu Jiang , Dapeng Liu , Guihai Chen

In recent years, Multi-Task Learning (MTL) has attracted much attention due to its good performance in many applications. However, many existing MTL models cannot guarantee that their performance is no worse than their single-task…

Machine Learning · Computer Science 2022-10-04 Zhixiong Yue , Feiyang Ye , Yu Zhang , Christy Liang , Ivor W. Tsang