English
Related papers

Related papers: Multi-task learning on the edge: cost-efficiency a…

200 papers

Representation multi-task learning (MTL) has achieved tremendous success in practice. However, the theoretical understanding of these methods is still lacking. Most existing theoretical works focus on cases where all tasks share the same…

Machine Learning · Statistics 2025-07-08 Ye Tian , Yuqi Gu , Yang Feng

Jointly learning multiple tasks with a unified model can improve accuracy and data efficiency, but it faces the challenge of task interference, where optimizing one task objective may inadvertently compromise the performance of another. A…

Multi-task clustering (MTC) has attracted a lot of research attentions in machine learning due to its ability in utilizing the relationship among different tasks. Despite the success of traditional MTC models, they are either easy to stuck…

Machine Learning · Computer Science 2018-08-27 Yazhou Ren , Xiaofan Que , Dezhong Yao , Zenglin Xu

In multi-task reinforcement learning (RL) under Markov decision processes (MDPs), the presence of shared latent structures among multiple MDPs has been shown to yield significant benefits to the sample efficiency compared to single-task RL.…

Machine Learning · Computer Science 2023-10-23 Ruiquan Huang , Yuan Cheng , Jing Yang , Vincent Tan , Yingbin Liang

As machine learning becomes more prominent there is a growing demand to perform several inference tasks in parallel. Running a dedicated model for each task is computationally expensive and therefore there is a great interest in multi-task…

Machine Learning · Computer Science 2024-05-14 Idan Achituve , Idit Diamant , Arnon Netzer , Gal Chechik , Ethan Fetaya

Methods for supervised principal component analysis (SPCA) aim to incorporate label information into principal component analysis (PCA), so that the extracted features are more useful for a prediction task of interest. Prior work on SPCA…

Machine Learning · Statistics 2022-08-18 Alexander Ritchie , Laura Balzano , Daniel Kessler , Chandra S. Sripada , Clayton Scott

Multi Task Learning (MTL) efficiently leverages useful information contained in multiple related tasks to help improve the generalization performance of all tasks. This article conducts a large dimensional analysis of a simple but, as we…

Machine Learning · Statistics 2020-09-04 Malik Tiomoko , Romain Couillet , Hafiz Tiomoko

Federated learning (FL) enables distributed model training from local data collected by users. In distributed systems with constrained resources and potentially high dynamics, e.g., mobile edge networks, the efficiency of FL is an important…

Machine Learning · Computer Science 2022-12-19 Shiqiang Wang , Jake Perazzone , Mingyue Ji , Kevin S. Chan

In recent years, meta-reinforcement learning (meta-RL) algorithm has been proposed to improve sample efficiency in the field of decision-making and control, enabling agents to learn new knowledge from a small number of samples. However,…

Machine Learning · Computer Science 2025-01-14 Chenyang Qi , Huiping Li , Panfeng Huang

Despite the recent progress in deep learning, most approaches still go for a silo-like solution, focusing on learning each task in isolation: training a separate neural network for each individual task. Many real-world problems, however,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Simon Vandenhende

Multi-task learning is a powerful method for solving multiple correlated tasks simultaneously. However, it is often impossible to find one single solution to optimize all the tasks, since different tasks might conflict with each other.…

Machine Learning · Computer Science 2020-01-01 Xi Lin , Hui-Ling Zhen , Zhenhua Li , Qingfu Zhang , Sam Kwong

Multi-task learning (MTL) has led to successes in many applications of machine learning, from natural language processing and speech recognition to computer vision and drug discovery. This article aims to give a general overview of MTL,…

Machine Learning · Computer Science 2017-06-19 Sebastian Ruder

Multi-task learning (MTL) can improve the generalization performance of neural networks by sharing representations with related tasks. Nonetheless, MTL can also degrade performance through harmful interference between tasks. Recent work has…

Machine Learning · Computer Science 2023-06-08 Emilie Grégoire , Hafeez Chaudhary , Sam Verboven

Multi-task learning (MTL) is a common machine learning technique that allows the model to share information across different tasks and improve the accuracy of recommendations for all of them. Many existing MTL implementations suffer from…

Information Retrieval · Computer Science 2025-04-09 Luyang Wang , Cangcheng Tang , Chongyang Zhang , Jun Ruan , Kai Huang , Jason Dai

Aggregated data is commonplace in areas such as epidemiology and demography. For example, census data for a population is usually given as averages defined over time periods or spatial resolutions (cities, regions or countries). In this…

Machine Learning · Statistics 2020-02-20 Fariba Yousefi , Michael Thomas Smith , Mauricio A. Álvarez

Multi-task learning (MTL) has emerged as a pivotal paradigm in machine learning by leveraging shared structures across multiple related tasks. Despite its empirical success, the development of likelihood-based efficiently solvable…

Machine Learning · Computer Science 2026-05-07 Shihong Ding , Fangyu Du , Cong Fang

Multi-task learning (MTL) aims to improve the generalization of several related tasks by learning them jointly. As a comparison, in addition to the joint training scheme, modern meta-learning allows unseen tasks with limited labels during…

Machine Learning · Computer Science 2021-06-17 Haoxiang Wang , Han Zhao , Bo Li

The performance of finetuned large language models (LLMs) hinges critically on the composition of the training mixture. However, selecting an optimal blend of task datasets remains a largely manual, heuristic driven process, with…

This paper introduces self-paced task selection to multitask learning, where instances from more closely related tasks are selected in a progression of easier-to-harder tasks, to emulate an effective human education strategy, but applied to…

Machine Learning · Statistics 2017-06-20 Keerthiram Murugesan , Jaime Carbonell

In the rapidly evolving research on artificial intelligence (AI) the demand for fast, computationally efficient, and scalable solutions has increased in recent years. The problem of optimizing the computing resources for distributed machine…

Machine Learning · Computer Science 2025-10-30 Mohammadreza Doostmohammadian , Zulfiya R. Gabidullina , Hamid R. Rabiee