中文
相关论文

相关论文: Multi-Task Learning with Prior Information

200 篇论文

The "fast iterative shrinkage-thresholding algorithm", a.k.a. FISTA, is one of the most well-known first-order optimisation scheme in the literature, as it achieves the worst-case $O(1/k^2)$ optimal convergence rate in terms of objective…

最优化与控制 · 数学 2021-01-21 Jingwei Liang , Tao Luo , Carola-Bibiane Schönlieb

In this paper we consider a problem known as multi-task learning, consisting of fitting a set of classifier or regression functions intended for solving different tasks. In our novel formulation, we couple the parameters of these functions,…

机器学习 · 计算机科学 2021-05-28 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

Data scarcity poses a serious threat to modern machine learning and artificial intelligence, as their practical success typically relies on the availability of big datasets. One effective strategy to mitigate the issue of insufficient data…

机器学习 · 计算机科学 2026-05-14 Chaozhi Zhang , Lin Liu , Xiaoqun Zhang

This paper provides a new way of developing the fast iterative shrinkage/thresholding algorithm (FISTA) that is widely used for minimizing composite convex functions with a nonsmooth term such as the $\ell_1$ regularizer. In particular,…

最优化与控制 · 数学 2019-06-14 Donghwan Kim , Jeffrey A. Fessler

Multi-Task Learning (MTL) aims to learn multiple tasks simultaneously while exploiting their mutual relationships. By using shared resources to simultaneously calculate multiple outputs, this learning paradigm has the potential to have…

机器学习 · 计算机科学 2024-08-29 Maxime Fontana , Michael Spratling , Miaojing Shi

Multi-task learning can leverage information learned by one task to benefit the training of other tasks. Despite this capacity, naively training all tasks together in one model often degrades performance, and exhaustively searching through…

机器学习 · 计算机科学 2021-10-27 Christopher Fifty , Ehsan Amid , Zhe Zhao , Tianhe Yu , Rohan Anil , Chelsea Finn

This paper introduces self-paced task selection to multitask learning, where instances from more closely related tasks are selected in a progression of easier-to-harder tasks, to emulate an effective human education strategy, but applied to…

机器学习 · 统计学 2017-06-20 Keerthiram Murugesan , Jaime Carbonell

We consider a multitask learning problem, in which several predictors are learned jointly. Prior research has shown that learning the relations between tasks, and between the input features, together with the predictor, can lead to better…

机器学习 · 计算机科学 2019-07-11 Han Zhao , Otilia Stretcu , Alex Smola , Geoff Gordon

Multi-task feature learning aims to identity the shared features among tasks to improve generalization. It has been shown that by minimizing non-convex learning models, a better solution than the convex alternatives can be obtained.…

机器学习 · 计算机科学 2015-06-03 Yaru Fan , Yilun Wang

Reducing the amount of human supervision is a key problem in machine learning and a natural approach is that of exploiting the relations (structure) among different tasks. This is the idea at the core of multi-task learning. In this context…

机器学习 · 计算机科学 2015-04-21 Carlo Ciliberto , Youssef Mroueh , Tomaso Poggio , Lorenzo Rosasco

Iterative shrinkage/thresholding algorithm (ISTA) is a well-studied method for finding sparse solutions to ill-posed inverse problems. In this letter, we present a data-driven scheme for learning optimal thresholding functions for ISTA. The…

机器学习 · 计算机科学 2016-05-04 Ulugbek S. Kamilov , Hassan Mansour

The idea of unfolding iterative algorithms as deep neural networks has been widely applied in solving sparse coding problems, providing both solid theoretical analysis in convergence rate and superior empirical performance. However, for…

机器学习 · 计算机科学 2020-10-27 Yuhai Song , Zhong Cao , Kailun Wu , Ziang Yan , Changshui Zhang

Identifying statistical regularities in solutions to some tasks in multi-task reinforcement learning can accelerate the learning of new tasks. Skill learning offers one way of identifying these regularities by decomposing pre-collected…

机器学习 · 计算机科学 2022-12-12 Yiding Jiang , Evan Zheran Liu , Benjamin Eysenbach , Zico Kolter , Chelsea Finn

Multi--task learning seeks to improve the generalization error by leveraging the common information shared by multiple related tasks. One challenge in multi--task learning is identifying formulations capable of uncovering the common…

机器学习 · 计算机科学 2026-03-06 Ayed M. Alrashdi , Oussama Dhifallah , Houssem Sifaou

The ``fast iterative shrinkage-thresholding algorithm'', a.k.a. FISTA, is one of the most widely used algorithms in the literature. However, despite its optimal theoretical $O(1/k^2)$ convergence rate guarantee, oftentimes in practice its…

最优化与控制 · 数学 2018-07-12 Jingwei Liang , Carola-Bibiane Schönlieb

This paper presents a new multitask learning framework that learns a shared representation among the tasks, incorporating both task and feature clusters. The jointly-induced clusters yield a shared latent subspace where task relationships…

机器学习 · 统计学 2017-03-06 Keerthiram Murugesan , Jaime Carbonell , Yiming Yang

Multi-task learning (MTL) aims to improve the performance of multiple related prediction tasks by leveraging useful information from them. Due to their flexibility and ability to reduce unknown coefficients substantially, the…

机器学习 · 计算机科学 2022-12-01 Yuzhao Zhang , Yifan Sun

Multitask Learning is a Machine Learning paradigm that aims to train a range of (usually related) tasks with the help of a shared model. While the goal is often to improve the joint performance of all training tasks, another approach is to…

机器学习 · 计算机科学 2024-05-14 Rafael Kourdis , Gabriel Gordon-Hall , Philip John Gorinski

When a number of similar tasks have to be learned simultaneously, multi-task learning (MTL) models can attain significantly higher accuracy than single-task learning (STL) models. However, the advantage of MTL depends on various factors,…

机器学习 · 计算机科学 2023-10-26 Afiya Ayman , Ayan Mukhopadhyay , Aron Laszka

Multi-task learning (MTL) aims to improve the generalization of several related tasks by learning them jointly. As a comparison, in addition to the joint training scheme, modern meta-learning allows unseen tasks with limited labels during…

机器学习 · 计算机科学 2021-06-17 Haoxiang Wang , Han Zhao , Bo Li