中文
相关论文

相关论文: Optimizing Evaluation Metrics for Multi-Task Learn…

200 篇论文

We introduce a two-level trust-region method (TLTR) for solving unconstrained nonlinear optimization problems. Our method uses a composite iteration step, which is based on two distinct search directions. The first search direction is…

数值分析 · 数学 2024-09-10 Andrea Angino , Alena Kopaničáková , Rolf Krause

Multi-task learning (MTL) aims to improve the performance of a primary task by jointly learning with related auxiliary tasks. Traditional MTL methods select tasks randomly during training. However, both previous studies and our results…

计算与语言 · 计算机科学 2024-01-12 Xiangheng He , Junjie Chen , Björn W. Schuller

As an effective learning paradigm against insufficient training samples, Multi-Task Learning (MTL) encourages knowledge sharing across multiple related tasks so as to improve the overall performance. In MTL, a major challenge springs from…

机器学习 · 计算机科学 2020-04-30 Zhiyong Yang , Qianqian Xu , Xiaochun Cao , Qingming Huang

Multi-task learning has been observed by many researchers, which supposes that different tasks can share a low-rank common yet latent subspace. It means learning multiple tasks jointly is better than learning them independently. In this…

机器学习 · 计算机科学 2021-12-10 Wei Chang , Feiping Nie , Rong Wang , Xuelong Li

Multi-task learning (MTL) jointly learns a set of tasks by sharing parameters among tasks. It is a promising approach for reducing storage costs while improving task accuracy for many computer vision tasks. The effective adoption of MTL…

机器学习 · 计算机科学 2022-10-03 Lijun Zhang , Xiao Liu , Hui Guan

In this paper, we study the generalization performance of regularized multi-task learning (RMTL) in a vector-valued framework, where MTL is considered as a learning process for vector-valued functions. We are mainly concerned with two…

机器学习 · 计算机科学 2014-08-29 Chao Zhang , Dacheng Tao , Tao Hu , Xiang Li

Multi-task learning (MTL) is a paradigm that simultaneously learns multiple tasks by sharing information at different levels, enhancing the performance of each individual task. While previous research has primarily focused on feature-level…

机器学习 · 计算机科学 2024-04-02 Xiangming Xi , Feng Gao , Jun Xu , Fangtai Guo , Tianlei Jin

Balancing competing objectives remains a fundamental challenge in multi-task learning (MTL), primarily due to conflicting gradients across individual tasks. A common solution relies on computing a dynamic gradient update vector that…

This paper presents a novel optimization method for maximizing generalization over tasks in meta-learning. The goal of meta-learning is to learn a model for an agent adapting rapidly when presented with previously unseen tasks. Tasks are…

机器学习 · 计算机科学 2018-10-19 Amir Erfan Eshratifar , David Eigen , Massoud Pedram

End-to-end speech-to-text translation typically suffers from the scarcity of paired speech-text data. One way to overcome this shortcoming is to utilize the bitext data from the Machine Translation (MT) task and perform Multi-Task Learning…

计算与语言 · 计算机科学 2025-09-15 JungHo Jung , Junhyun Lee

We consider a problem in Multi-Task Learning (MTL) where multiple linear models are jointly trained on a collection of datasets ("tasks"). A key novelty of our framework is that it allows the sparsity pattern of regression coefficients and…

统计方法学 · 统计学 2025-12-08 Kayhan Behdin , Gabriel Loewinger , Kenneth T. Kishida , Giovanni Parmigiani , Rahul Mazumder

Multi-Task Learning (MTL) enables a single model to learn multiple tasks simultaneously, leveraging knowledge transfer among tasks for enhanced generalization, and has been widely applied across various domains. However, task imbalance…

机器学习 · 计算机科学 2025-10-22 Xiaohan Qin , Xiaoxing Wang , Ning Liao , Junchi Yan

Multi-task reinforcement learning (MTRL) aims to endow a single agent with the ability to perform well on multiple tasks. Recent works have focused on developing novel sophisticated architectures to improve performance, often resulting in…

Multi Task Learning (MTL) efficiently leverages useful information contained in multiple related tasks to help improve the generalization performance of all tasks. This article conducts a large dimensional analysis of a simple but, as we…

机器学习 · 统计学 2020-09-04 Malik Tiomoko , Romain Couillet , Hafiz Tiomoko

This paper investigates, from information theoretic grounds, a learning problem based on the principle that any regularity in a given dataset can be exploited to extract compact features from data, i.e., using fewer bits than needed to…

机器学习 · 统计学 2018-11-14 Matías Vera , Leonardo Rey Vega , Pablo Piantanida

Learning two tasks in a single shared function has some benefits. Firstly by acquiring information from the second task, the shared function leverages useful information that could have been neglected or underestimated in the first task.…

机器学习 · 计算机科学 2020-08-06 Jonghwa Yim , Sang Hwan Kim

We consider the problem of minimizing block-separable convex functions subject to linear constraints. While the Alternating Direction Method of Multipliers (ADMM) for two-block linear constraints has been intensively studied both…

最优化与控制 · 数学 2014-09-15 Huahua Wang , Arindam Banerjee , Zhi-Quan Luo

Multi-task learning (MTL) in materials science relies on the assumption that physically related properties share learnable representations. We challenge this assumption using a 54,028-sample metal alloy dataset exhibiting extreme task-level…

机器学习 · 计算机科学 2026-02-03 Sungwoo Kang

Multi-task learning (MTL) improves prediction performance in different contexts by learning models jointly on multiple different, but related tasks. Network data, which are a priori data with a rich relational structure, provide an…

机器学习 · 统计学 2014-11-11 Chen Fang , Daniel N. Rockmore

Multi-objective optimization (MOO) aims at finding a set of optimal configurations for a given set of objectives. A recent line of work applies MOO methods to the typical Machine Learning (ML) setting, which becomes multi-objective if a…

机器学习 · 计算机科学 2021-10-15 Michael Ruchte , Josif Grabocka