中文
相关论文

相关论文: Efficacy of regularized multi-task learning based …

200 篇论文

Multi-task learning (MTL) has recently contributed to learning better representations in service of various NLP tasks. MTL aims at improving the performance of a primary task, by jointly training on a secondary task. This paper introduces…

机器学习 · 计算机科学 2017-09-21 Davis Liang , Yan Shu

Despite the recent progress in deep learning, most approaches still go for a silo-like solution, focusing on learning each task in isolation: training a separate neural network for each individual task. Many real-world problems, however,…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Simon Vandenhende

Traditionally, Multi-task Learning (MTL) models optimize the average of task-related objective functions, which is an intuitive approach and which we will be referring to as Average MTL. However, a more general framework, referred to as…

机器学习 · 计算机科学 2014-08-21 Cong Li , Michael Georgiopoulos , Georgios C. Anagnostopoulos

Multi-task learning (MTL) is a subfield of machine learning in which multiple tasks are simultaneously learned by a shared model. Such approaches offer advantages like improved data efficiency, reduced overfitting through shared…

机器学习 · 计算机科学 2020-09-22 Michael Crawshaw

Multi-task learning (MTL) is an active field in deep learning in which we train a model to jointly learn multiple tasks by exploiting relationships between the tasks. It has been shown that MTL helps the model share the learned features…

计算机视觉与模式识别 · 计算机科学 2021-11-30 Akihiro Nakano , Shi Chen , Kazuyuki Demachi

While the promises of Multi-Task Learning (MTL) are attractive, characterizing the conditions of its success is still an open problem in Deep Learning. Some tasks may benefit from being learned together while others may be detrimental to…

机器学习 · 计算机科学 2023-01-10 Raphael Azorin , Massimo Gallo , Alessandro Finamore , Dario Rossi , Pietro Michiardi

Multi-Task Learning (MTL) aims at boosting the overall performance of each individual task by leveraging useful information contained in multiple related tasks. It has shown great success in natural language processing (NLP). Currently, a…

计算与语言 · 计算机科学 2020-08-10 Jianquan Li , Xiaokang Liu , Wenpeng Yin , Min Yang , Liqun Ma , Yaohong Jin

Typical multi-task learning (MTL) methods rely on architectural adjustments and a large trainable parameter set to jointly optimize over several tasks. However, when the number of tasks increases so do the complexity of the architectural…

计算机视觉与模式识别 · 计算机科学 2019-03-29 Gjorgji Strezoski , Nanne van Noord , Marcel Worring

Multitask learning (MTL) leverages task-relatedness to enhance performance. With the emergence of multimodal data, tasks can now be referenced by multiple indices. In this paper, we employ high-order tensors, with each mode corresponding to…

机器学习 · 计算机科学 2023-08-31 Jiani Liu , Qinghua Tao , Ce Zhu , Yipeng Liu , Xiaolin Huang , Johan A. K. Suykens

Multi-task learning (MTL) is a machine learning technique aiming to improve model performance by leveraging information across many tasks. It has been used extensively on various data modalities, including electronic health record (EHR)…

Contrastive self-supervised learning has gained attention for its ability to create high-quality representations from large unlabelled data sets. A key reason that these powerful features enable data-efficient learning of downstream tasks…

机器学习 · 计算机科学 2024-01-29 Calum Heggan , Tim Hospedales , Sam Budgett , Mehrdad Yaghoobi

Multi-task learning (MTL) aims to improve generalization performance by learning multiple related tasks simultaneously. While sometimes the underlying task relationship structure is known, often the structure needs to be estimated from data…

Multi-task learning (MTL) aims to leverage shared information among tasks to improve learning efficiency and accuracy. However, MTL often struggles to effectively manage positive and negative transfer between tasks, which can hinder…

机器学习 · 计算机科学 2025-05-19 Chenguang Wang , Xuanhao Pan , Tianshu Yu

Continual and multi-task learning are common machine learning approaches to learning from multiple tasks. The existing works in the literature often assume multi-task learning as a sensible performance upper bound for various continual…

机器学习 · 计算机科学 2022-10-27 Zihao Wu , Huy Tran , Hamed Pirsiavash , Soheil Kolouri

We consider a problem of learning kernels for use in SVM classification in the multi-task and lifelong scenarios and provide generalization bounds on the error of a large margin classifier. Our results show that, under mild conditions on…

机器学习 · 统计学 2016-08-19 Anastasia Pentina , Shai Ben-David

In recent years, Multi-Task Learning (MTL) has attracted much attention due to its good performance in many applications. However, many existing MTL models cannot guarantee that their performance is no worse than their single-task…

机器学习 · 计算机科学 2022-10-04 Zhixiong Yue , Feiyang Ye , Yu Zhang , Christy Liang , Ivor W. Tsang

Multi-task learning (MTL) has become increasingly popular in natural language processing (NLP) because it improves the performance of related tasks by exploiting their commonalities and differences. Nevertheless, it is still not understood…

计算与语言 · 计算机科学 2023-02-16 Zhihan Zhang , Wenhao Yu , Mengxia Yu , Zhichun Guo , Meng Jiang

Large language models (LLMs) achieve remarkable advancements by leveraging tools to interact with environments, a critical step toward generalized AI. However, the standard supervised fine-tuning (SFT) approach, which relies on large-scale…

Multi-task learning (MTL) is a subfield of machine learning with important applications, but the multi-objective nature of optimization in MTL leads to difficulties in balancing training between tasks. The best MTL optimization methods…

机器学习 · 计算机科学 2021-09-20 Michael Crawshaw , Jana Košecká

By leveraging large amounts of product data collected across hundreds of live e-commerce websites, we construct 1000 unique classification tasks that share similarly-structured input data, comprised of both text and images. These…

人工智能 · 计算机科学 2021-07-29 Cameron R. Wolfe , Keld T. Lundgaard