English
Related papers

Related papers: Analytical Uncertainty-Based Loss Weighting in Mul…

200 papers

Multi-Task Learning is a learning paradigm that uses correlated tasks to improve performance generalization. A common way to learn multiple tasks is through the hard parameter sharing approach, in which a single architecture is used to…

Machine Learning · Computer Science 2022-04-15 Angelica Tiemi Mizuno Nakamura , Denis Fernando Wolf , Valdir Grassi

Multi-task learning aims to explore task relatedness to improve individual tasks, which is of particular significance in the challenging scenario that only limited data is available for each task. To tackle this challenge, we propose…

Machine Learning · Computer Science 2021-11-10 Jiayi Shen , Xiantong Zhen , Marcel Worring , Ling Shao

Many interesting tasks in machine learning and computer vision are learned by optimising an objective function defined as a weighted linear combination of multiple losses. The final performance is sensitive to choosing the correct…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Rick Groenendijk , Sezer Karaoglu , Theo Gevers , Thomas Mensink

Multi-task learning (MTL) seeks to improve the generalized performance of learning specific tasks, exploiting useful information incorporated in related tasks. As a promising area, this paper studies an MTL-based control approach…

Systems and Control · Electrical Eng. & Systems 2024-08-01 Andres Arias , Chuangchuang Sun

Multi-task learning (MTL) has become increasingly popular in natural language processing (NLP) because it improves the performance of related tasks by exploiting their commonalities and differences. Nevertheless, it is still not understood…

Computation and Language · Computer Science 2023-02-16 Zhihan Zhang , Wenhao Yu , Mengxia Yu , Zhichun Guo , Meng Jiang

A central goal of algorithmic fairness is to reduce bias in automated decision making. An unavoidable tension exists between accuracy gains obtained by using sensitive information (e.g., gender or ethnic group) as part of a statistical…

Machine Learning · Statistics 2020-02-03 Luca Oneto , Michele Donini , Amon Elders , Massimiliano Pontil

The Evidential regression network (ENet) estimates a continuous target and its predictive uncertainty without costly Bayesian model averaging. However, it is possible that the target is inaccurately predicted due to the gradient shrinkage…

Machine Learning · Computer Science 2021-12-20 Dongpin Oh , Bonggun Shin

Meta-learning methods aim to build learning algorithms capable of quickly adapting to new tasks in low-data regime. One of the most difficult benchmarks of such algorithms is a one-shot learning problem. In this setting many algorithms face…

Machine Learning · Computer Science 2022-10-04 Andrei Boiarov , Kostiantyn Khabarlak , Igor Yastrebov

We propose an approach to Multitask Learning (MTL) to make deep learning models faster and lighter for applications in which multiple tasks need to be solved simultaneously, which is particularly useful in embedded, real-time systems. We…

Computer Vision and Pattern Recognition · Computer Science 2017-11-02 Miquel Martí , Atsuto Maki

Delivering meaningful uncertainty estimates is essential for a successful deployment of machine learning models in the clinical practice. A central aspect of uncertainty quantification is the ability of a model to return predictions that…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Adrian Galdran , Johan Verjans , Gustavo Carneiro , Miguel A. González Ballester

Multi-task learning (MTL) aims to leverage shared knowledge across tasks to improve generalization and parameter efficiency, yet balancing resources and mitigating interference remain open challenges. Architectural solutions often introduce…

Machine Learning · Computer Science 2025-12-24 Mihai Suteu , Ovidiu Serban

Multi-task learning is a method for improving the generalizability of multiple tasks. In order to perform multiple classification tasks with one neural network model, the losses of each task should be combined. Previous studies have mostly…

Machine Learning · Computer Science 2018-10-03 Myungsu Chae , Tae-Ho Kim , Young Hoon Shin , June-Woo Kim , Soo-Young Lee

A multi-task learning (MTL) system aims at solving multiple related tasks at the same time. With a fixed model capacity, the tasks would be conflicted with each other, and the system usually has to make a trade-off among learning all of…

Machine Learning · Computer Science 2021-02-16 Xi Lin , Zhiyuan Yang , Qingfu Zhang , Sam Kwong

Scarcity of parallel sentence pairs is a major challenge for training high quality neural machine translation (NMT) models in bilingually low-resource scenarios, as NMT is data-hungry. Multi-task learning is an elegant approach to inject…

Computation and Language · Computer Science 2020-01-13 Poorya Zaremoodi , Gholamreza Haffari

Multi-parametric mapping of MRI relaxations in liver has the potential of revealing pathological information of the liver. A self-supervised learning based multi-parametric mapping method is proposed to map T$T_{1\rho}$ and T$_2$…

Multi-task learning for dense prediction is limited by the need for extensive annotation for every task, though recent works have explored training with partial task labels. Leveraging the generalization power of diffusion models, we extend…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Anh-Quan Cao , Ivan Lopes , Raoul de Charette

Recent multi-task learning studies suggest that linear scalarization, when using well-chosen fixed task weights, can achieve comparable to or even better performance than complex multi-task optimization (MTO) methods. It remains unclear why…

Machine Learning · Computer Science 2025-08-20 Yi Yang , Kei Ikemura , Qingwen Zhang , Xiaomeng Zhu , Ci Li , Nazre Batool , Sina Sharif Mansouri , John Folkesson

Modern artificial intelligence is supported by machine learning models (e.g., foundation models) that are pretrained on a massive data corpus and then adapted to solve a variety of downstream tasks. To summarize performance across multiple…

Machine Learning · Statistics 2025-01-09 Rachel Longjohn , Giri Gopalan , Emily Casleton

Existing deep multitask learning (MTL) approaches align layers shared between tasks in a parallel ordering. Such an organization significantly constricts the types of shared structure that can be learned. The necessity of parallel ordering…

Machine Learning · Computer Science 2018-02-14 Elliot Meyerson , Risto Miikkulainen

Current person image retrieval methods have achieved great improvements in accuracy metrics. However, they rarely describe the reliability of the prediction. In this paper, we propose an Uncertainty-Aware Learning (UAL) method to remedy…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Zhaopeng Dou , Zhongdao Wang , Weihua Chen , Yali Li , Shengjin Wang