English
Related papers

Related papers: Multi-task manifold learning for small sample size…

200 papers

Multi-Task Learning is a learning paradigm that uses correlated tasks to improve performance generalization. A common way to learn multiple tasks is through the hard parameter sharing approach, in which a single architecture is used to…

Machine Learning · Computer Science 2022-04-15 Angelica Tiemi Mizuno Nakamura , Denis Fernando Wolf , Valdir Grassi

Although face analysis has achieved remarkable improvements in the past few years, designing a multi-task face analysis model is still challenging. Most face analysis tasks are studied as separate problems and do not benefit from the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Haomiao Sun , Mingjie He , Shiguang Shan , Hu Han , Xilin Chen

Single-task learning in artificial neural networks will be able to learn the model very well, and the benefits brought by transferring knowledge thus become limited. In this regard, when the number of tasks increases (e.g., semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Mohammad R. Bayanlou , Mehdi Khoshboresh-Masouleh

Transfer learning enables to re-use knowledge learned on a source task to help learning a target task. A simple form of transfer learning is common in current state-of-the-art computer vision models, i.e. pre-training a model for image…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Thomas Mensink , Jasper Uijlings , Alina Kuznetsova , Michael Gygli , Vittorio Ferrari

Multi-task learning (MTL) allows deep neural networks to learn from related tasks by sharing parameters with other networks. In practice, however, MTL involves searching an enormous space of possible parameter sharing architectures to find…

Machine Learning · Statistics 2018-11-20 Sebastian Ruder , Joachim Bingel , Isabelle Augenstein , Anders Søgaard

Multi-label learning studies the problem where an instance is associated with a set of labels. By treating single-label learning problem as one task, the multi-label learning problem can be casted as solving multiple related tasks…

Machine Learning · Computer Science 2019-11-20 Lu Bai , Yew-Soon Ong , Tiantian He , Abhishek Gupta

Learning-to-learn or meta-learning leverages data-driven inductive bias to increase the efficiency of learning on a novel task. This approach encounters difficulty when transfer is not advantageous, for instance, when tasks are considerably…

Machine Learning · Computer Science 2019-06-20 Ghassen Jerfel , Erin Grant , Thomas L. Griffiths , Katherine Heller

We present three related ways of using Transfer Learning to improve feature selection. The three methods address different problems, and hence share different kinds of information between tasks or feature classes, but all three are based on…

Machine Learning · Computer Science 2009-05-26 Paramveer S. Dhillon , Dean Foster , Lyle Ungar

The benefit of multi-task learning over single-task learning relies on the ability to use relations across tasks to improve performance on any single task. While sharing representations is an important mechanism to share information across…

Machine Learning · Computer Science 2021-06-14 Shagun Sodhani , Amy Zhang , Joelle Pineau

Recent work has found that multi-task training with a large number of diverse tasks can uniformly improve downstream performance on unseen target tasks. In contrast, literature on task transferability has established that the choice of…

Computation and Language · Computer Science 2022-07-13 Vishakh Padmakumar , Leonard Lausen , Miguel Ballesteros , Sheng Zha , He He , George Karypis

Multi-task learning (MTL) optimizes several learning tasks simultaneously and leverages their shared information to improve generalization and the prediction of the model for each task. Auxiliary tasks can be added to the main task to…

Machine Learning · Computer Science 2020-07-03 Partoo Vafaeikia , Khashayar Namdar , Farzad Khalvati

Multi-task learning has emerged as a powerful machine learning paradigm for integrating data from multiple sources, leveraging similarities between tasks to improve overall model performance. However, the application of multi-task learning…

Methodology · Statistics 2024-02-09 Parker Knight , Rui Duan

We propose a meta-learning method for semi-supervised learning that learns from multiple tasks with heterogeneous attribute spaces. The existing semi-supervised meta-learning methods assume that all tasks share the same attribute space,…

Machine Learning · Computer Science 2023-11-10 Tomoharu Iwata , Atsutoshi Kumagai

Multi-task learning (MTL) aims to improve the performance of a primary task by jointly learning with related auxiliary tasks. Traditional MTL methods select tasks randomly during training. However, both previous studies and our results…

Computation and Language · Computer Science 2024-01-12 Xiangheng He , Junjie Chen , Björn W. Schuller

Traditionally, multitask learning (MTL) assumes that all the tasks are related. This can lead to negative transfer when tasks are indeed incoherent. Recently, a number of approaches have been proposed that alleviate this problem by…

Machine Learning · Computer Science 2012-06-22 Wenliang Zhong , James Kwok

We investigate multi-task learning approaches that use a shared feature representation for all tasks. To better understand the transfer of task information, we study an architecture with a shared module for all tasks and a separate output…

Machine Learning · Computer Science 2020-05-05 Sen Wu , Hongyang R. Zhang , Christopher Ré

Deep learning methods such as multitask neural networks have recently been applied to ligand-based virtual screening and other drug discovery applications. Using a set of industrial ADMET datasets, we compare neural networks to standard…

Machine Learning · Statistics 2017-01-16 Steven Kearnes , Brian Goldman , Vijay Pande

Optimization-based meta-learning typically assumes tasks are sampled from a single distribution - an assumption oversimplifies and limits the diversity of tasks that meta-learning can model. Handling tasks from multiple different…

Machine Learning · Computer Science 2021-09-29 Zhe Wang , Jake Grigsby , Arshdeep Sekhon , Yanjun Qi

We propose Manifold Free-Form Flows (M-FFF), a simple new generative model for data on manifolds. The existing approaches to learning a distribution on arbitrary manifolds are expensive at inference time, since sampling requires solving a…

Machine Learning · Computer Science 2024-11-26 Peter Sorrenson , Felix Draxler , Armand Rousselot , Sander Hummerich , Ullrich Köthe

Multi-task learning (MTL) is a powerful machine learning paradigm designed to leverage shared knowledge across tasks to improve generalization and performance. Previous works have proposed approaches to MTL that can be divided into feature…

Machine Learning · Computer Science 2024-06-13 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli