English
Related papers

Related papers: Sample-Level Weighting for Multi-Task Learning wit…

200 papers

Given the ubiquity of multi-task in practical systems, Multi-Task Learning (MTL) has found widespread application across diverse domains. In real-world scenarios, these tasks often have different priorities. For instance, In web search,…

Machine Learning · Computer Science 2024-12-17 Zhengxing Cheng , Yuheng Huang , Zhixuan Zhang , Dan Ou , Qingwen Liu

Meta-learning aims to learn general knowledge with diverse training tasks conducted from limited data, and then transfer it to new tasks. It is commonly believed that increasing task diversity will enhance the generalization ability of…

Machine Learning · Computer Science 2024-06-04 Jingyao Wang , Wenwen Qiang , Xingzhe Su , Changwen Zheng , Fuchun Sun , Hui Xiong

Multi-task learning (MTL) aims to leverage shared knowledge across tasks to improve generalization and parameter efficiency, yet balancing resources and mitigating interference remain open challenges. Architectural solutions often introduce…

Machine Learning · Computer Science 2025-12-24 Mihai Suteu , Ovidiu Serban

Synthetic data augmentation via large language models (LLMs) allows researchers to leverage additional training data, thus enhancing the performance of downstream tasks, especially when real-world data is scarce. However, the generated data…

Machine Learning · Computer Science 2025-03-25 Hsun-Yu Kuo , Yin-Hsiang Liao , Yu-Chieh Chao , Wei-Yun Ma , Pu-Jen Cheng

Deep neural networks trained for predicting cellular events from DNA sequence have become emerging tools to help elucidate the biological mechanism underlying the associations identified in genome-wide association studies. To enhance the…

Machine Learning · Computer Science 2022-09-27 Mohammad Shiri , Jiangwen Sun

The goal of multi-task learning is to enable more efficient learning than single task learning by sharing model structures for a diverse set of tasks. A standard multi-task learning objective is to minimize the average loss across all…

Machine Learning · Computer Science 2024-02-22 Bo Liu , Xingchao Liu , Xiaojie Jin , Peter Stone , Qiang Liu

Multi-task learning (MTL) has shown effectiveness in exploiting shared information across tasks to improve generalization. MTL assumes tasks share similarities that can improve performance. In addition, boosting algorithms have demonstrated…

Machine Learning · Computer Science 2025-12-09 Seyedsaman Emami , Gonzalo Martínez-Muñoz , Daniel Hernández-Lobato

Multi-Task Learning (MTL) aims to boost predictive performance by sharing information across related tasks, yet conventional methods often suffer from negative transfer when unrelated or noisy tasks are forced to share representations. We…

Machine Learning · Computer Science 2026-02-17 Seyedsaman Emami , Daniel Hernández-Lobato , Gonzalo Martínez-Muñoz

This paper presents a novel optimization method for maximizing generalization over tasks in meta-learning. The goal of meta-learning is to learn a model for an agent adapting rapidly when presented with previously unseen tasks. Tasks are…

Machine Learning · Computer Science 2018-10-19 Amir Erfan Eshratifar , David Eigen , Massoud Pedram

Many real-world large-scale regression problems can be formulated as Multi-task Learning (MTL) problems with a massive number of tasks, as in retail and transportation domains. However, existing MTL methods still fail to offer both the…

Machine Learning · Computer Science 2018-11-15 Xiao He , Francesco Alesiani , Ammar Shaker

We propose a multi-task learning (MTL) model for jointly performing three tasks that are commonly solved in a text-to-speech (TTS) front-end: text normalization (TN), part-of-speech (POS) tagging, and homograph disambiguation (HD). Our…

Computation and Language · Computer Science 2024-04-04 Wonjune Kang , Yun Wang , Shun Zhang , Arthur Hinsvark , Qing He

In deep multi-task learning, weights of task-specific networks are shared between tasks to improve performance on each single one. Since the question, which weights to share between layers, is difficult to answer, human-designed…

Machine Learning · Computer Science 2020-03-24 Jonas Prellberg , Oliver Kramer

Auxiliary Learning (AL) is a form of multi-task learning in which a model trains on auxiliary tasks to boost performance on a primary objective. While AL has improved generalization across domains such as navigation, image classification,…

Machine Learning · Computer Science 2025-11-05 Judah Goldfeder , Matthew So , Hod Lipson

The quality of datasets is one of the key factors that affect the accuracy of aerodynamic data models. For example, in the uniformly sampled Burgers' dataset, the insufficient high-speed data is overwhelmed by massive low-speed data.…

Machine Learning · Computer Science 2020-10-20 Liwei Hu , Yu Xiang , Jun Zhan , Zifang Shi , Wenzheng Wang

We propose a multi-task learning framework to learn a joint Machine Reading Comprehension (MRC) model that can be applied to a wide range of MRC tasks in different domains. Inspired by recent ideas of data selection in machine translation,…

Computation and Language · Computer Science 2019-04-02 Yichong Xu , Xiaodong Liu , Yelong Shen , Jingjing Liu , Jianfeng Gao

Multi-task learning (MTL) enables simultaneous training across related tasks, leveraging shared information to improve generalization, efficiency, and robustness, especially in data-scarce or high-dimensional scenarios. While deep learning…

Machine Learning · Computer Science 2025-10-31 Fatemeh Bazikar , Hossein Moosaei , Atefeh Hemmati , Panos M. Pardalos

Recent works have shown that deep neural networks benefit from multi-task learning by learning a shared representation across several related tasks. However, performance of such systems depend on relative weighting between various losses…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Pavan Kumar Anasosalu Vasu , Shreyas Saxena , Oncel Tuzel

Multitask learning (MTL) aims to learn multiple tasks simultaneously through the interdependence between different tasks. The way to measure the relatedness between tasks is always a popular issue. There are mainly two ways to measure…

Machine Learning · Computer Science 2019-04-04 Ya Li , Xinmei Tian , Tongliang Liu , Dacheng Tao

Multi-task learning and self-training are two common ways to improve a machine learning model's performance in settings with limited training data. Drawing heavily on ideas from those two approaches, we suggest transductive auxiliary task…

Computation and Language · Computer Science 2019-09-24 Johannes Bjerva , Katharina Kann , Isabelle Augenstein

Multi-task learning (MTL) has been widely applied in online advertising and recommender systems. To address the negative transfer issue, recent studies have proposed optimization methods that thoroughly focus on the gradient alignment of…

Information Retrieval · Computer Science 2023-03-13 Xuanhua Yang , Jianxin Zhao , Shaoguo Liu , Liang Wang , Bo Zheng