English
Related papers

Related papers: Efficient Multitask Feature and Relationship Learn…

200 papers

Federated learning poses new statistical and systems challenges in training machine learning models over distributed networks of devices. In this work, we show that multi-task learning is naturally suited to handle the statistical…

Machine Learning · Computer Science 2018-02-28 Virginia Smith , Chao-Kai Chiang , Maziar Sanjabi , Ameet Talwalkar

Multi-task learning can leverage information learned by one task to benefit the training of other tasks. Despite this capacity, naive formulations often degrade performance and in particular, identifying the tasks that would benefit from…

Machine Learning · Computer Science 2021-09-13 Christopher Fifty , Ehsan Amid , Zhe Zhao , Tianhe Yu , Rohan Anil , Chelsea Finn

Standard meta-learning for representation learning aims to find a common representation to be shared across multiple tasks. The effectiveness of these methods is often limited when the nuances of the tasks' distribution cannot be captured…

Machine Learning · Computer Science 2021-03-31 Giulia Denevi , Massimiliano Pontil , Carlo Ciliberto

Multi-Task Learning (MTL) is a framework, where multiple related tasks are learned jointly and benefit from a shared representation space, or parameter transfer. To provide sufficient learning support, modern MTL uses annotated data with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

Although multi-task learning is widely applied in intelligent services, traditional multi-task modeling methods often require customized designs based on specific task combinations, resulting in a cumbersome modeling process. Inspired by…

Machine Learning · Computer Science 2025-04-15 Jingxuan Zhou , Weidong Bao , Ji Wang , Zhengyi Zhong , Dayu Zhang

We study and quantify the generalization patterns of multitask learning (MTL) models for sequence labeling tasks. MTL models are trained to optimize a set of related tasks jointly. Although multitask learning has achieved improved…

Machine Learning · Computer Science 2020-09-29 Gabriele Bettgenhäuser , Michael A. Hedderich , Dietrich Klakow

Training a single model on multiple input domains and/or output tasks allows for compressing information from multiple sources into a unified backbone hence improves model efficiency. It also enables potential positive knowledge transfer…

Machine Learning · Computer Science 2023-10-16 Amelie Royer , Tijmen Blankevoort , Babak Ehteshami Bejnordi

We study the problem of distributed multi-task learning with shared representation, where each machine aims to learn a separate, but related, task in an unknown shared low-dimensional subspaces, i.e. when the predictor matrix has low rank.…

Machine Learning · Computer Science 2016-03-08 Jialei Wang , Mladen Kolar , Nathan Srebro

We consider the problem of conversational question answering over a large-scale knowledge base. To handle huge entity vocabulary of a large-scale knowledge base, recent neural semantic parsing based approaches usually decompose the task…

Computation and Language · Computer Science 2019-10-14 Tao Shen , Xiubo Geng , Tao Qin , Daya Guo , Duyu Tang , Nan Duan , Guodong Long , Daxin Jiang

In pursuit of reinforcement learning systems that could train in physical environments, we investigate multi-task approaches as a means to alleviate the need for massive data acquisition. In a tabular scenario where the Q-functions are…

Machine Learning · Computer Science 2025-01-22 Sergio Rozada , Santiago Paternain , Juan Andres Bazerque , Antonio G. Marques

One of the main challenges in real-world reinforcement learning is to learn successfully from limited training samples. We show that in certain settings, the available data can be dramatically increased through a form of multi-task…

Machine Learning · Computer Science 2021-02-19 Desmond Cai , Shiau Hong Lim , Laura Wynter

One of the main arguments behind studying disentangled representations is the assumption that they can be easily reused in different tasks. At the same time finding a joint, adaptable representation of data is one of the key challenges in…

Machine Learning · Computer Science 2021-10-08 Łukasz Maziarka , Aleksandra Nowak , Maciej Wołczyk , Andrzej Bedychaj

Multi-task learning (MTL) is a subfield of machine learning in which multiple tasks are simultaneously learned by a shared model. Such approaches offer advantages like improved data efficiency, reduced overfitting through shared…

Machine Learning · Computer Science 2020-09-22 Michael Crawshaw

Multi-task learning (MTL) is a methodology that aims to improve the general performance of estimation and prediction by sharing common information among related tasks. In the MTL, there are several assumptions for the relationships and…

Methodology · Statistics 2023-04-27 Akira Okazaki , Shuichi Kawano

It is still challenging to build an AI system that can perform tasks that involve vision and language at human level. So far, researchers have singled out individual tasks separately, for each of which they have designed networks and…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Duy-Kien Nguyen , Takayuki Okatani

The terms multi-task learning and multitasking are easily confused. Multi-task learning refers to a paradigm in machine learning in which a network is trained on various related tasks to facilitate the acquisition of tasks. In contrast,…

Machine Learning · Computer Science 2021-01-06 Sachin Ravi , Sebastian Musslick , Maia Hamin , Theodore L. Willke , Jonathan D. Cohen

Pareto optimization via evolutionary multi-objective algorithms has been shown to efficiently solve constrained monotone submodular functions. Traditionally when solving multiple problems, the algorithm is run for each problem separately.…

Neural and Evolutionary Computing · Computer Science 2026-04-17 Liam Wigney , Frank Neumann

Multi-task learning aims at solving multiple machine learning tasks at the same time. A good solution to a multi-task learning problem should be generalizable in addition to being Pareto optimal. In this paper, we provide some insights on…

Machine Learning · Computer Science 2020-08-14 Yuyan Wang , Zhe Zhao , Bo Dai , Christopher Fifty , Dong Lin , Lichan Hong , Ed H. Chi

Multi-task problem solving has been shown to improve the accuracy of the individual tasks, which is an important feature for robots, as they have a limited resource. However, when the number of labels for each task is not equal, namely…

Robotics · Computer Science 2026-02-03 Ozgur Erkent

Multi-task learning is a powerful method for solving multiple correlated tasks simultaneously. However, it is often impossible to find one single solution to optimize all the tasks, since different tasks might conflict with each other.…

Machine Learning · Computer Science 2020-01-01 Xi Lin , Hui-Ling Zhen , Zhenhua Li , Qingfu Zhang , Sam Kwong
‹ Prev 1 3 4 5 6 7 10 Next ›