中文
相关论文

相关论文: Sign-regularized Multi-task Learning

200 篇论文

There is growing body of learning problems for which it is natural to organize the parameters into matrix, so as to appropriately regularize the parameters under some matrix norm (in order to impose some more sophisticated prior knowledge).…

机器学习 · 计算机科学 2010-10-19 Sham M. Kakade , Shai Shalev-Shwartz , Ambuj Tewari

Multi-task learning is a very challenging problem in reinforcement learning. While training multiple tasks jointly allow the policies to share parameters across different tasks, the optimization problem becomes non-trivial: It remains…

机器学习 · 计算机科学 2020-12-08 Ruihan Yang , Huazhe Xu , Yi Wu , Xiaolong Wang

We consider multi-task learning, which simultaneously learns related prediction tasks, to improve generalization performance. We factorize a coefficient matrix as the product of two matrices based on a low-rank assumption. These matrices…

机器学习 · 统计学 2018-08-14 Jun-Yong Jeong , Chi-Hyuck Jun

Multi-task learning (MTL) aims to improve generalization performance by learning multiple related tasks simultaneously. While sometimes the underlying task relationship structure is known, often the structure needs to be estimated from data…

Deep neural networks have become a standard building block for designing models that can perform multiple dense computer vision tasks such as depth estimation and semantic segmentation thanks to their ability to capture complex correlations…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Wei-Hong Li , Steven McDonagh , Ales Leonardis , Hakan Bilen

The problem of learning simultaneously several related tasks has received considerable attention in several domains, especially in machine learning with the so-called multitask learning problem or learning to learn problem [1], [2].…

信号处理 · 电气工程与系统科学 2021-09-29 Roula Nassif , Stefan Vlaski , Cedric Richard , Jie Chen , Ali H. Sayed

This paper introduces self-paced task selection to multitask learning, where instances from more closely related tasks are selected in a progression of easier-to-harder tasks, to emulate an effective human education strategy, but applied to…

机器学习 · 统计学 2017-06-20 Keerthiram Murugesan , Jaime Carbonell

Multi-task learning is to improve the performance of the model by transferring and exploiting common knowledge among tasks. Existing MTL works mainly focus on the scenario where label sets among multiple tasks (MTs) are usually the same,…

机器学习 · 计算机科学 2022-01-10 Quan Feng , Songcan Chen

Traditionally, multitask learning (MTL) assumes that all the tasks are related. This can lead to negative transfer when tasks are indeed incoherent. Recently, a number of approaches have been proposed that alleviate this problem by…

机器学习 · 计算机科学 2012-06-22 Wenliang Zhong , James Kwok

As deep learning applications continue to become more diverse, an interesting question arises: Can general problem solving arise from jointly learning several such diverse tasks? To approach this question, deep multi-task learning is…

机器学习 · 计算机科学 2019-10-29 Elliot Meyerson , Risto Miikkulainen

We investigate a general framework of multiplicative multitask feature learning which decomposes each task's model parameters into a multiplication of two components. One of the components is used across all tasks and the other component is…

机器学习 · 计算机科学 2016-10-25 Xin Wang , Jinbo Bi , Shipeng Yu , Jiangwen Sun

Multi-task learning (MTL) considers learning a joint model for multiple tasks by optimizing a convex combination of all task losses. To solve the optimization problem, existing methods use an adaptive weight updating scheme, where task…

机器学习 · 计算机科学 2024-07-22 Yifei He , Shiji Zhou , Guojun Zhang , Hyokun Yun , Yi Xu , Belinda Zeng , Trishul Chilimbi , Han Zhao

Multi-task learning (MTL) has achieved great success in various research domains, such as CV, NLP and IR etc. Due to the complex and competing task correlation, naive training all tasks may lead to inequitable learning, i.e. some tasks are…

机器学习 · 计算机科学 2023-06-21 Jun Yuan , Rui Zhang

Multi-task learning solves multiple correlated tasks. However, conflicts may exist between them. In such circumstances, a single solution can rarely optimize all the tasks, leading to performance trade-offs. To arrive at a set of optimized…

人工智能 · 计算机科学 2024-03-26 Lu Bai , Abhishek Gupta , Yew-Soon Ong

Multi-Task Learning (MTL) aims to learn multiple tasks simultaneously while exploiting their mutual relationships. By using shared resources to simultaneously calculate multiple outputs, this learning paradigm has the potential to have…

机器学习 · 计算机科学 2024-08-29 Maxime Fontana , Michael Spratling , Miaojing Shi

Reducing the amount of human supervision is a key problem in machine learning and a natural approach is that of exploiting the relations (structure) among different tasks. This is the idea at the core of multi-task learning. In this context…

机器学习 · 计算机科学 2015-04-21 Carlo Ciliberto , Youssef Mroueh , Tomaso Poggio , Lorenzo Rosasco

Trace norm regularization is a popular method of multitask learning. We give excess risk bounds with explicit dependence on the number of tasks, the number of examples per task and properties of the data distribution. The bounds are…

机器学习 · 统计学 2013-01-15 Andreas Maurer , Massimiliano Pontil

Multi--task learning seeks to improve the generalization error by leveraging the common information shared by multiple related tasks. One challenge in multi--task learning is identifying formulations capable of uncovering the common…

机器学习 · 计算机科学 2026-03-06 Ayed M. Alrashdi , Oussama Dhifallah , Houssem Sifaou

Transfer and multi-task learning have traditionally focused on either a single source-target pair or very few, similar tasks. Ideally, the linguistic levels of morphology, syntax and semantics would benefit each other by being trained in a…

计算与语言 · 计算机科学 2017-07-25 Kazuma Hashimoto , Caiming Xiong , Yoshimasa Tsuruoka , Richard Socher

In this paper, we propose a novel semi-supervised feature selection framework by mining correlations among multiple tasks and apply it to different multimedia applications. Instead of independently computing the importance of features for…

机器学习 · 计算机科学 2017-07-11 Xiaojun Chang , Yi Yang