English
Related papers

Related papers: Multi-task manifold learning for small sample size…

200 papers

Standard meta-learning for representation learning aims to find a common representation to be shared across multiple tasks. The effectiveness of these methods is often limited when the nuances of the tasks' distribution cannot be captured…

Machine Learning · Computer Science 2021-03-31 Giulia Denevi , Massimiliano Pontil , Carlo Ciliberto

This paper proposes a new principled multi-task representation learning framework (InfoMTL) to extract noise-invariant sufficient representations for all tasks. It ensures sufficiency of shared representations for all tasks and mitigates…

Computation and Language · Computer Science 2025-03-07 Dou Hu , Lingwei Wei , Wei Zhou , Songlin Hu

Integrating knowledge across different domains is an essential feature of human learning. Learning paradigms such as transfer learning, meta-learning, and multi-task learning reflect the human learning process by exploiting the prior…

Machine Learning · Computer Science 2024-10-17 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

In the field of medical imaging, AI-assisted techniques such as object detection, segmentation, and classification are widely employed to alleviate the workload of physicians and doctors. However, single-task models are predominantly used,…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Fan Li , Arun Iyengar , Lanyu Xu

Numerous deep learning applications benefit from multi-task learning with multiple regression and classification objectives. In this paper we make the observation that the performance of such systems is strongly dependent on the relative…

Computer Vision and Pattern Recognition · Computer Science 2018-04-25 Alex Kendall , Yarin Gal , Roberto Cipolla

Gradient-based meta-learners such as MAML are able to learn a meta-prior from similar tasks to adapt to novel tasks from the same distribution with few gradient updates. One important limitation of such frameworks is that they seek a common…

Machine Learning · Computer Science 2018-12-19 Risto Vuorio , Shao-Hua Sun , Hexiang Hu , Joseph J. Lim

Learning two tasks in a single shared function has some benefits. Firstly by acquiring information from the second task, the shared function leverages useful information that could have been neglected or underestimated in the first task.…

Machine Learning · Computer Science 2020-08-06 Jonghwa Yim , Sang Hwan Kim

The increasing use of machine-learning (ML) enabled systems in critical tasks fuels the quest for novel verification and validation techniques yet grounded in accepted system assurance principles. In traditional system development,…

Machine Learning · Computer Science 2020-02-11 Taejoon Byun , Sanjai Rayadurgam

A common way of learning to perform a task is to observe how it is carried out by experts. However, it is well known that for most tasks there is no unique way to perform them. This is especially noticeable the more complex the task is…

Artificial Intelligence · Computer Science 2024-04-04 David Nieves , María José Ramírez-Quintana , Carlos Monserrat , César Ferri , José Hernández-Orallo

Manifold alignment is a type of data fusion technique that creates a shared low-dimensional representation of data collected from multiple domains, enabling cross-domain learning and improved performance in downstream tasks. This paper…

Machine Learning · Computer Science 2024-11-26 Jake S. Rhodes , Adam G. Rustad

In human learning, it is common to use multiple sources of information jointly. However, most existing feature learning approaches learn from only a single task. In this paper, we propose a novel multi-task deep network to learn…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Zhongzheng Ren , Yong Jae Lee

We propose Deep Asymmetric Multitask Feature Learning (Deep-AMTFL) which can learn deep representations shared across multiple tasks while effectively preventing negative transfer that may happen in the feature sharing process.…

Machine Learning · Computer Science 2018-07-03 Hae Beom Lee , Eunho Yang , Sung Ju Hwang

This paper studies transfer learning for estimating the mean of random functions based on discretely sampled data, where, in addition to observations from the target distribution, auxiliary samples from similar but distinct source…

Statistics Theory · Mathematics 2024-03-29 T. Tony Cai , Dongwoo Kim , Hongming Pu

It is still challenging to build an AI system that can perform tasks that involve vision and language at human level. So far, researchers have singled out individual tasks separately, for each of which they have designed networks and…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Duy-Kien Nguyen , Takayuki Okatani

Consider a Machine Learning Service Provider (MLSP) designed to rapidly create highly accurate learners for a never-ending stream of new tasks. The challenge is to produce task-specific learners that can be trained from few labeled samples,…

Machine Learning · Computer Science 2014-07-10 Ouais Alsharif , Philip Bachman , Joelle Pineau

Graph Neural Networks (GNNs) are a framework for graph representation learning, where a model learns to generate low dimensional node embeddings that encapsulate structural and feature-related information. GNNs are usually trained in an…

Machine Learning · Computer Science 2020-12-15 Davide Buffelli , Fabio Vandin

We explore the benefits that multitask learning offer to speech processing as we train models on dual objectives with automatic speech recognition and intent classification or sentiment classification. Our models, although being of modest…

Computation and Language · Computer Science 2022-11-28 Quentin Meeus , Marie-Francine Moens , Hugo Van hamme

In this paper we consider a problem known as multi-task learning, consisting of fitting a set of classifier or regression functions intended for solving different tasks. In our novel formulation, we couple the parameters of these functions,…

Machine Learning · Computer Science 2021-05-28 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

We propose probabilistic task modelling -- a generative probabilistic model for collections of tasks used in meta-learning. The proposed model combines variational auto-encoding and latent Dirichlet allocation to model each task as a…

Machine Learning · Computer Science 2022-03-21 Cuong C. Nguyen , Thanh-Toan Do , Gustavo Carneiro

Multi-task learning (MTL) is often achieved by merging datasets before fine-tuning, but the growing availability of fine-tuned models has led to new approaches such as model merging via task arithmetic. A major challenge in this setting is…

Machine Learning · Computer Science 2025-09-15 Brahim Touayouch , Loïc Fosse , Géraldine Damnati , Gwénolé Lecorvé