English
Related papers

Related papers: Multi-task Learning for Heterogeneous Multi-source…

200 papers

Multi-task learning has the potential to improve generalization by maximizing positive transfer between tasks while reducing task interference. Fully achieving this potential is hindered by manually designed architectures that remain static…

Machine Learning · Computer Science 2023-05-02 Naresh Kumar Gurulingan , Bahram Zonooz , Elahe Arani

Hand-crafted features extracted from dynamic contrast-enhanced magnetic resonance images (DCE-MRIs) have shown strong predictive abilities in characterization of breast lesions. However, heterogeneity across medical image datasets hinders…

Medical Physics · Physics 2017-01-17 Natalia Antropova , Benjamin Huynh , Maryellen Giger

In this paper, we consider a hierarchical distributed multi-task learning (MTL) system where distributed users wish to jointly learn different models orchestrated by a central server with the help of a layer of multiple relays. Since the…

Information Theory · Computer Science 2022-12-19 Haoyang Hu , Songze Li , Minquan Cheng , Youlong Wu

We study the multi-task learning problem that aims to simultaneously analyze multiple datasets collected from different sources and learn one model for each of them. We propose a family of adaptive methods that automatically utilize…

Machine Learning · Statistics 2023-09-19 Yaqi Duan , Kaizheng Wang

Data scarcity poses a serious threat to modern machine learning and artificial intelligence, as their practical success typically relies on the availability of big datasets. One effective strategy to mitigate the issue of insufficient data…

Machine Learning · Computer Science 2026-05-14 Chaozhi Zhang , Lin Liu , Xiaoqun Zhang

The Multi-Task Learning (MTL) technique has been widely studied by word-wide researchers. The majority of current MTL studies adopt the hard parameter sharing structure, where hard layers tend to learn general representations over all tasks…

Information Retrieval · Computer Science 2021-01-25 Dehong Gao , Wenjing Yang , Huiling Zhou , Yi Wei , Yi Hu , Hao Wang

While many machine learning methods have been used for medical prediction and risk factor analysis on healthcare data, most prior research has involved single-task learning (STL) methods. However, healthcare research often involves multiple…

Machine Learning · Computer Science 2021-03-08 Lu Wang , Haoyan Jiang , Mark Chignell

Modern Augmented reality applications require performing multiple tasks on each input frame simultaneously. Multi-task learning (MTL) represents an effective approach where multiple tasks share an encoder to extract representative features…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Marina Neseem , Ahmed Agiza , Sherief Reda

Deep neural networks trained for predicting cellular events from DNA sequence have become emerging tools to help elucidate the biological mechanism underlying the associations identified in genome-wide association studies. To enhance the…

Machine Learning · Computer Science 2022-09-27 Mohammad Shiri , Jiangwen Sun

Multi-domain learning (MDL) refers to simultaneously constructing a model or a set of models on datasets collected from different domains. Conventional approaches emphasize domain-shared information extraction and domain-private information…

Machine Learning · Computer Science 2023-07-31 Rui He , Shengcai Liu , Jiahao Wu , Shan He , Ke Tang

Multi-task learning, in which several tasks are jointly learned by a single model, allows NLP models to share information from multiple annotations and may facilitate better predictions when the tasks are inter-related. This technique,…

Computation and Language · Computer Science 2022-10-31 Guy Rotman , Roi Reichart

We propose a meta-learning method for semi-supervised learning that learns from multiple tasks with heterogeneous attribute spaces. The existing semi-supervised meta-learning methods assume that all tasks share the same attribute space,…

Machine Learning · Computer Science 2023-11-10 Tomoharu Iwata , Atsutoshi Kumagai

In real-world scenarios we often need to perform multiple tasks simultaneously. Multi-Task Learning (MTL) is an adequate method to do so, but usually requires datasets labeled for all tasks. We propose a method that can leverage datasets…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Federica Spinola , Philipp Benz , Minhyeong Yu , Tae-hoon Kim

Integrating knowledge across different domains is an essential feature of human learning. Learning paradigms such as transfer learning, meta-learning, and multi-task learning reflect the human learning process by exploiting the prior…

Machine Learning · Computer Science 2024-10-17 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

Future communication networks must address the scarce spectrum to accommodate extensive growth of heterogeneous wireless devices. Wireless signal recognition is becoming increasingly more significant for spectrum monitoring, spectrum…

Signal Processing · Electrical Eng. & Systems 2022-06-22 Anu Jagannath , Jithin Jagannath

A multi-task learning (MTL) system aims at solving multiple related tasks at the same time. With a fixed model capacity, the tasks would be conflicted with each other, and the system usually has to make a trade-off among learning all of…

Machine Learning · Computer Science 2021-02-16 Xi Lin , Zhiyuan Yang , Qingfu Zhang , Sam Kwong

Anomaly detection in medical images is a challenging task, since anomalies are not typically available during training. Recent methods leverage a single pretext task coupled with a large-scale pre-trained model to reach state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Bogdan Alexandru Bercean , Florinel Alin Croitoru , Vlad Hondru , Ciprian Mihai Ceausescu , Andreea Iuliana Ionescu , Radu Tudor Ionescu

Multi-task learning for dense prediction is limited by the need for extensive annotation for every task, though recent works have explored training with partial task labels. Leveraging the generalization power of diffusion models, we extend…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Anh-Quan Cao , Ivan Lopes , Raoul de Charette

Learning-based solutions for vision tasks require a large amount of labeled training data to ensure their performance and reliability. In single-task vision-based settings, inconsistency-based active learning has proven to be effective in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Aral Hekimoglu , Philipp Friedrich , Walter Zimmer , Michael Schmidt , Alvaro Marcos-Ramiro , Alois C. Knoll

Multi-task learning (MTL) algorithms typically rely on schemes that combine different task losses or their gradients through weighted averaging. These methods aim to find Pareto stationary points by using heuristics that require access to…

Machine Learning · Computer Science 2026-02-03 Surya Murthy , Kushagra Gupta , Mustafa O. Karabag , David Fridovich-Keil , Ufuk Topcu