English
Related papers

Related papers: MultiBalance: Multi-Objective Gradient Balancing i…

200 papers

Reinforcement learning fine-tuning has become the dominant approach for aligning diffusion models with human preferences. However, assessing images is intrinsically a multi-dimensional task, and multiple evaluation criteria need to be…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Canyu Zhao , Hao Chen , Yunze Tong , Yu Qiao , Jiacheng Li , Chunhua Shen

Multi-task learning has been widely applied in computational vision, natural language processing and other fields, which has achieved well performance. In recent years, a lot of work about multi-task learning recommender system has been…

Information Retrieval · Computer Science 2023-05-24 Mingzhu Zhang , Ruiping Yin , Zhen Yang , Yipeng Wang , Kan Li

Understanding the structure of multiple related tasks allows for multi-task learning to improve the generalisation ability of one or all of them. However, it usually requires training each pairwise combination of tasks together in order to…

Machine Learning · Computer Science 2022-06-03 Shikun Liu , Stephen James , Andrew J. Davison , Edward Johns

Multi-task learning (MTL) is an efficient solution to solve multiple tasks simultaneously in order to get better speed and performance than handling each single-task in turn. The most current methods can be categorized as either: (i) hard…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Yifan Liu , Bohan Zhuang , Chunhua Shen , Hao Chen , Wei Yin

Multi-task ranking models have become essential for modern real-world recommendation systems. While most recommendation researches focus on designing sophisticated models for specific scenarios, achieving performance improvement for…

Information Retrieval · Computer Science 2025-02-13 Jun Yuan , Guohao Cai , Zhenhua Dong

Learning multiple domains/tasks with a single model is important for improving data efficiency and lowering inference cost for numerous vision tasks, especially on resource-constrained mobile devices. However, hand-crafting a…

Computer Vision and Pattern Recognition · Computer Science 2021-01-11 Qifei Wang , Junjie Ke , Joshua Greaves , Grace Chu , Gabriel Bender , Luciano Sbaiz , Alec Go , Andrew Howard , Feng Yang , Ming-Hsuan Yang , Jeff Gilbert , Peyman Milanfar

In the case of an imbalance between positive and negative samples, hard negative mining strategies have been shown to help models learn more subtle differences between positive and negative samples, thus improving recognition performance.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Jiahan Zhang , Dayong Tian

Multi-Task Learning (MTL) enables multiple tasks to be learned within a shared network, but differences in objectives across tasks can cause negative transfer, where the learning of one task degrades another task's performance. While…

Machine Learning · Computer Science 2025-07-22 Wooseong Jeong , Kuk-Jin Yoon

A central goal of algorithmic fairness is to reduce bias in automated decision making. An unavoidable tension exists between accuracy gains obtained by using sensitive information (e.g., gender or ethnic group) as part of a statistical…

Machine Learning · Statistics 2020-02-03 Luca Oneto , Michele Donini , Amon Elders , Massimiliano Pontil

Learning-to-learn or meta-learning leverages data-driven inductive bias to increase the efficiency of learning on a novel task. This approach encounters difficulty when transfer is not advantageous, for instance, when tasks are considerably…

Machine Learning · Computer Science 2019-06-20 Ghassen Jerfel , Erin Grant , Thomas L. Griffiths , Katherine Heller

Sharing knowledge between tasks is vital for efficient learning in a multi-task setting. However, most research so far has focused on the easier case where knowledge transfer is not harmful, i.e., where knowledge from one task cannot…

Machine Learning · Computer Science 2019-07-08 Timo Bram , Gino Brunner , Oliver Richter , Roger Wattenhofer

Multi-Task Learning has emerged as a methodology in which multiple tasks are jointly learned by a shared learning algorithm, such as a DNN. MTL is based on the assumption that the tasks under consideration are related; therefore it exploits…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

Real-world image super-resolution (Real-SR) is a challenging problem due to the complex degradation patterns in low-resolution images. Unlike approaches that assume a broadly encompassing degradation space, we focus specifically on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Shuchen Lin , Mingtao Feng , Weisheng Dong , Fangfang Wu , Jianqiao Luo , Yaonan Wang , Guangming Shi

When a number of similar tasks have to be learned simultaneously, multi-task learning (MTL) models can attain significantly higher accuracy than single-task learning (STL) models. However, the advantage of MTL depends on various factors,…

Machine Learning · Computer Science 2023-10-26 Afiya Ayman , Ayan Mukhopadhyay , Aron Laszka

Multi-task learning (MTL) benefits the fine-tuning of large language models (LLMs) by providing a single model with improved performance and generalization ability across tasks, presenting a resource-efficient alternative to developing…

Computation and Language · Computer Science 2024-10-29 Zi Gong , Hang Yu , Cong Liao , Bingchang Liu , Chaoyu Chen , Jianguo Li

Multi-task reinforcement learning (MTRL) aims to endow a single agent with the ability to perform well on multiple tasks. Recent works have focused on developing novel sophisticated architectures to improve performance, often resulting in…

Machine Learning · Computer Science 2025-03-13 Reginald McLean , Evangelos Chatzaroulas , Jordan Terry , Isaac Woungang , Nariman Farsad , Pablo Samuel Castro

Despite the recent advances in multi-task learning of dense prediction problems, most methods rely on expensive labelled datasets. In this paper, we present a label efficient approach and look at jointly learning of multiple dense…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Wei-Hong Li , Xialei Liu , Hakan Bilen

The terms multi-task learning and multitasking are easily confused. Multi-task learning refers to a paradigm in machine learning in which a network is trained on various related tasks to facilitate the acquisition of tasks. In contrast,…

Machine Learning · Computer Science 2021-01-06 Sachin Ravi , Sebastian Musslick , Maia Hamin , Theodore L. Willke , Jonathan D. Cohen

Balancing competing objectives remains a fundamental challenge in multi-task learning (MTL), primarily due to conflicting gradients across individual tasks. A common solution relies on computing a dynamic gradient update vector that…

Machine Learning · Computer Science 2025-02-04 Negar Hassanpour , Muhammad Kamran Janjua , Kunlin Zhang , Sepehr Lavasani , Xiaowen Zhang , Chunhua Zhou , Chao Gao

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Qianru Sun , Yaoyao Liu , Zhaozheng Chen , Tat-Seng Chua , Bernt Schiele