中文
相关论文

相关论文: Saliency-Regularized Deep Multi-Task Learning

200 篇论文

Multi-task learning (MTL) has become increasingly popular in natural language processing (NLP) because it improves the performance of related tasks by exploiting their commonalities and differences. Nevertheless, it is still not understood…

计算与语言 · 计算机科学 2023-02-16 Zhihan Zhang , Wenhao Yu , Mengxia Yu , Zhichun Guo , Meng Jiang

Multi-task learning (MTL) has achieved great success in various research domains, such as CV, NLP and IR etc. Due to the complex and competing task correlation, naive training all tasks may lead to inequitable learning, i.e. some tasks are…

机器学习 · 计算机科学 2023-06-21 Jun Yuan , Rui Zhang

Multi-modal brain functional connectivity (FC) data have shown great potential for providing insights into individual variations in behavioral and cognitive traits. The joint learning of multi-modal imaging data can utilize the intrinsic…

定量方法 · 定量生物学 2019-01-18 Li Xiao , Julia M. Stephen , Tony W. Wilson , Vince D. Calhoun , Yu-Ping Wang

Multi-task learning (MTL) aims to improve the generalization of several related tasks by learning them jointly. As a comparison, in addition to the joint training scheme, modern meta-learning allows unseen tasks with limited labels during…

机器学习 · 计算机科学 2021-06-17 Haoxiang Wang , Han Zhao , Bo Li

Availability of labelled data is the major obstacle to the deployment of deep learning algorithms for computer vision tasks in new domains. The fact that many frameworks adopted to solve different tasks share the same architecture suggests…

计算机视觉与模式识别 · 计算机科学 2023-01-27 Pierluigi Zama Ramirez , Adriano Cardace , Luca De Luigi , Alessio Tonioni , Samuele Salti , Luigi Di Stefano

Multi-task learning (MTL) is a methodology that aims to improve the general performance of estimation and prediction by sharing common information among related tasks. In the MTL, there are several assumptions for the relationships and…

统计方法学 · 统计学 2023-04-27 Akira Okazaki , Shuichi Kawano

Can deep learning solve multiple tasks simultaneously, even when they are unrelated and very different? We investigate how the representations of the underlying tasks affect the ability of a single neural network to learn them jointly. We…

机器学习 · 计算机科学 2021-03-30 Atish Agarwala , Abhimanyu Das , Brendan Juba , Rina Panigrahy , Vatsal Sharan , Xin Wang , Qiuyi Zhang

In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them. Multi-task learning is inherently a multi-objective problem because different tasks may conflict, necessitating a trade-off. A common compromise…

机器学习 · 计算机科学 2019-01-14 Ozan Sener , Vladlen Koltun

Data-Free Meta-Learning (DFML) aims to derive knowledge from a collection of pre-trained models without accessing their original data, enabling the rapid adaptation to new unseen tasks. Current methods often overlook the heterogeneity among…

机器学习 · 计算机科学 2024-12-10 Yongxian Wei , Zixuan Hu , Li Shen , Zhenyi Wang , Yu Li , Chun Yuan , Dacheng Tao

We investigate a general framework of multiplicative multitask feature learning which decomposes each task's model parameters into a multiplication of two components. One of the components is used across all tasks and the other component is…

机器学习 · 计算机科学 2016-10-25 Xin Wang , Jinbo Bi , Shipeng Yu , Jiangwen Sun

Multi-task learning (MTL) is an efficient solution to solve multiple tasks simultaneously in order to get better speed and performance than handling each single-task in turn. The most current methods can be categorized as either: (i) hard…

计算机视觉与模式识别 · 计算机科学 2019-12-02 Yifan Liu , Bohan Zhuang , Chunhua Shen , Hao Chen , Wei Yin

Traditionally, multitask learning (MTL) assumes that all the tasks are related. This can lead to negative transfer when tasks are indeed incoherent. Recently, a number of approaches have been proposed that alleviate this problem by…

机器学习 · 计算机科学 2012-06-22 Wenliang Zhong , James Kwok

This paper targets the problem of multi-task dense prediction which aims to achieve simultaneous learning and inference on a bunch of multiple dense prediction tasks in a single framework. A core objective in design is how to effectively…

计算机视觉与模式识别 · 计算机科学 2023-07-18 Siwei Yang , Hanrong Ye , Dan Xu

In multi-task learning (MTL), we improve the performance of key machine learning algorithms by training various tasks jointly. When the number of tasks is large, modeling task structure can further refine the task relationship model. For…

机器学习 · 计算机科学 2020-11-25 Xiangyu Niu , Yifan Sun , Jinyuan Sun

The success of gradient-based meta-learning is primarily attributed to its ability to leverage related tasks to learn task-invariant information. However, the absence of interactions between different tasks in the inner loop leads to…

机器学习 · 计算机科学 2023-12-15 Oscar Chang , Hod Lipson

Multi-task learning (MTL) in deep neural networks for NLP has recently received increasing interest due to some compelling benefits, including its potential to efficiently regularize models and to reduce the need for labeled data. While it…

计算与语言 · 计算机科学 2017-02-28 Joachim Bingel , Anders Søgaard

This paper presents a novel multitask multiple kernel learning framework that efficiently learns the kernel weights leveraging the relationship across multiple tasks. The idea is to automatically infer this task relationship in the…

机器学习 · 统计学 2017-03-06 Keerthiram Murugesan , Jaime Carbonell

Many computer vision applications require solving multiple tasks in real-time. A neural network can be trained to solve multiple tasks simultaneously using multi-task learning. This can save computation at inference time as only a single…

计算机视觉与模式识别 · 计算机科学 2020-09-04 Trevor Standley , Amir R. Zamir , Dawn Chen , Leonidas Guibas , Jitendra Malik , Silvio Savarese

Accurate forecasting of multivariate time series data is important in many engineering and scientific applications. Recent state-of-the-art works ignore the inter-relations between variates, using their model on each variate independently.…

机器学习 · 计算机科学 2025-03-18 Liran Nochumsohn , Hedi Zisling , Omri Azencot

Neural processes have recently emerged as a class of powerful neural latent variable models that combine the strengths of neural networks and stochastic processes. As they can encode contextual data in the network's function space, they…

机器学习 · 计算机科学 2021-12-03 Jiayi Shen , Xiantong Zhen , Marcel Worring , Ling Shao