English
Related papers

Related papers: Deep Safe Multi-Task Learning

200 papers

Multi-task learning (MTL) enables simultaneous training across related tasks, leveraging shared information to improve generalization, efficiency, and robustness, especially in data-scarce or high-dimensional scenarios. While deep learning…

Machine Learning · Computer Science 2025-10-31 Fatemeh Bazikar , Hossein Moosaei , Atefeh Hemmati , Panos M. Pardalos

Multi-task learning (MTL) has gained significant popularity in recommender systems as it enables simultaneous optimization of multiple objectives. A key challenge in MTL is negative transfer, but existing studies explored negative transfer…

Information Retrieval · Computer Science 2024-01-09 Liangcai Su , Junwei Pan , Ximei Wang , Xi Xiao , Shijie Quan , Xihua Chen , Jie Jiang

Multi-Task Learning (MTL) has shown its importance at user products for fast training, data efficiency, reduced overfitting etc. MTL achieves it by sharing the network parameters and training a network for multiple tasks simultaneously.…

Machine Learning · Computer Science 2022-12-08 Brijraj Singh , Swati Gupta , Mayukh Das , Praveen Doreswamy Naidu , Sharan Kumar Allur

In recent years, multi-task learning has turned out to be of great success in various applications. Though single model training has promised great results throughout these years, it ignores valuable information that might help us estimate…

Machine Learning · Computer Science 2022-09-28 Yeshwant Singh , Anupam Biswas , Angshuman Bora , Debashish Malakar , Subham Chakraborty , Suman Bera

Deep neural networks trained for predicting cellular events from DNA sequence have become emerging tools to help elucidate the biological mechanism underlying the associations identified in genome-wide association studies. To enhance the…

Machine Learning · Computer Science 2022-09-27 Mohammad Shiri , Jiangwen Sun

Multi-task learning (MTL) considers learning a joint model for multiple tasks by optimizing a convex combination of all task losses. To solve the optimization problem, existing methods use an adaptive weight updating scheme, where task…

Machine Learning · Computer Science 2024-07-22 Yifei He , Shiji Zhou , Guojun Zhang , Hyokun Yun , Yi Xu , Belinda Zeng , Trishul Chilimbi , Han Zhao

Sharing knowledge between tasks is vital for efficient learning in a multi-task setting. However, most research so far has focused on the easier case where knowledge transfer is not harmful, i.e., where knowledge from one task cannot…

Machine Learning · Computer Science 2019-07-08 Timo Bram , Gino Brunner , Oliver Richter , Roger Wattenhofer

Connected autonomous vehicles (CAVs) must simultaneously perform multiple tasks, such as object detection, semantic segmentation, depth estimation, trajectory prediction, motion prediction, and behaviour prediction, to ensure safe and…

Robotics · Computer Science 2025-08-07 Jiayuan Wang , Farhad Pourpanah , Q. M. Jonathan Wu , Ning Zhang

When a number of similar tasks have to be learned simultaneously, multi-task learning (MTL) models can attain significantly higher accuracy than single-task learning (STL) models. However, the advantage of MTL depends on various factors,…

Machine Learning · Computer Science 2023-10-26 Afiya Ayman , Ayan Mukhopadhyay , Aron Laszka

Multi-task learning (MTL) has recently contributed to learning better representations in service of various NLP tasks. MTL aims at improving the performance of a primary task, by jointly training on a secondary task. This paper introduces…

Machine Learning · Computer Science 2017-09-21 Davis Liang , Yan Shu

In multi-task learning, difficulty levels of different tasks are varying. There are many works to handle this situation and we classify them into five categories, including the direct sum approach, the weighted sum approach, the maximum…

Machine Learning · Computer Science 2020-02-13 Sicong Liang , Yu Zhang

Multi-task learning (MTL) is an inductive transfer mechanism designed to leverage useful information from multiple tasks to improve generalization performance compared to single-task learning. It has been extensively explored in traditional…

Machine Learning · Computer Science 2025-01-13 Varun Kumar , Somdatta Goswami , Katiana Kontolati , Michael D. Shields , George Em Karniadakis

Multitask learning (MTL) has emerged as a powerful paradigm that leverages similarities among multiple learning tasks, each with insufficient samples to train a standalone model, to solve them simultaneously while minimizing data sharing…

Machine Learning · Computer Science 2025-06-23 John Abascal , Nicolás Berrios , Alina Oprea , Jonathan Ullman , Adam Smith , Matthew Jagielski

Multi-Task Learning (MTL) aims to learn multiple tasks simultaneously while exploiting their mutual relationships. By using shared resources to simultaneously calculate multiple outputs, this learning paradigm has the potential to have…

Machine Learning · Computer Science 2024-08-29 Maxime Fontana , Michael Spratling , Miaojing Shi

Multi-task learning aims to learn multiple tasks jointly by exploiting their relatedness to improve the generalization performance for each task. Traditionally, to perform multi-task learning, one needs to centralize data from all the tasks…

Machine Learning · Computer Science 2017-06-21 Sulin Liu , Sinno Jialin Pan , Qirong Ho

Multi-task learning aims to learn multiple related tasks simultaneously and has achieved great success in various fields. However, the disparity in loss and gradient scales among tasks often leads to performance compromises, and the…

Machine Learning · Computer Science 2025-11-27 Baijiong Lin , Weisen Jiang , Feiyang Ye , Yu Zhang , Pengguang Chen , Ying-Cong Chen , Shu Liu , Ivor W. Tsang , James T. Kwok

Multi-task learning (MTL) has become increasingly popular in natural language processing (NLP) because it improves the performance of related tasks by exploiting their commonalities and differences. Nevertheless, it is still not understood…

Computation and Language · Computer Science 2023-02-16 Zhihan Zhang , Wenhao Yu , Mengxia Yu , Zhichun Guo , Meng Jiang

Multi-task learning (MTL) has achieved great success in various research domains, such as CV, NLP and IR etc. Due to the complex and competing task correlation, naive training all tasks may lead to inequitable learning, i.e. some tasks are…

Machine Learning · Computer Science 2023-06-21 Jun Yuan , Rui Zhang

Multi-task learning (MTL) aims to build general-purpose vision systems by training a single network to perform multiple tasks jointly. While promising, its potential is often hindered by "unbalanced optimization", where task interference…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yihang Guo , Tianyuan Yu , Liang Bai , Yanming Guo , Yirun Ruan , William Li , Weishi Zheng

Multi-task learning is an open and challenging problem in computer vision. The typical way of conducting multi-task learning with deep neural networks is either through handcrafted schemes that share all initial layers and branch out at an…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Ximeng Sun , Rameswar Panda , Rogerio Feris , Kate Saenko