English
Related papers

Related papers: A Feature Transfer Enabled Multi-Task Deep Learnin…

200 papers

The innovative Federated Multi-Task Learning (FMTL) approach consolidates the benefits of Federated Learning (FL) and Multi-Task Learning (MTL), enabling collaborative model training on multi-task learning datasets. However, a comprehensive…

Machine Learning · Computer Science 2024-04-17 Yuwen Yang , Yuxiang Lu , Suizhi Huang , Shalayiding Sirejiding , Hongtao Lu , Yue Ding

Object recognition is a key enabler across industry and defense. As technology changes, algorithms must keep pace with new requirements and data. New modalities and higher resolution sensors should allow for increased algorithm robustness.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Samuel Rivera , Joel Klipfel , Deborah Weeks

Multi-task learning (MTL) aims to improve generalization performance by learning multiple related tasks simultaneously. While sometimes the underlying task relationship structure is known, often the structure needs to be estimated from data…

We consider Heterogeneous Transfer Learning (HTL) from a source to a new target domain for high-dimensional regression with differing feature sets. Most homogeneous TL methods assume that target and source domains share the same feature…

Machine Learning · Statistics 2025-12-02 Jae Ho Chang , Massimiliano Russo , Subhadeep Paul

Multi-task learning (MTL) has achieved remarkable success in natural language processing applications. In this work, we study a multi-task learning model with multiple decoders on varieties of biomedical and clinical natural language…

Computation and Language · Computer Science 2020-05-07 Yifan Peng , Qingyu Chen , Zhiyong Lu

Multi-task learning (MTL) is a novel framework to learn several tasks simultaneously with a single shared network where each task has its distinct personalized header network for fine-tuning. MTL can be implemented in federated learning…

Machine Learning · Computer Science 2022-03-28 Matin Mortaheb , Cemil Vahapoglu , Sennur Ulukus

The pretraining-finetuning paradigm has become the prevailing trend in modern deep learning. In this work, we discover an intriguing linear phenomenon in models that are initialized from a common pretrained checkpoint and finetuned on…

Machine Learning · Computer Science 2024-05-29 Zhanpeng Zhou , Zijun Chen , Yilan Chen , Bo Zhang , Junchi Yan

Multi-task learning (MTL) is a supervised learning paradigm in which the prediction models for several related tasks are learned jointly to achieve better generalization performance. When there are only a few training examples per task, MTL…

Machine Learning · Computer Science 2017-06-07 Azad Naik , Anveshi Charuvaka , Huzefa Rangwala

Deep learning-based automated contouring and treatment planning has been proven to improve the efficiency and accuracy of radiotherapy. However, conventional radiotherapy treatment planning process has the automated contouring and treatment…

Medical Physics · Physics 2024-12-02 Sangwook Kim , Aly Khalifa , Thomas G. Purdie , Chris McIntosh

Multi-target tracking (MTT) is a classical signal processing task, where the goal is to estimate the states of an unknown number of moving targets from noisy sensor measurements. In this paper, we revisit MTT from a deep learning…

Signal Processing · Electrical Eng. & Systems 2024-05-15 Damian Owerko , Charilaos I. Kanatsoulis , Jennifer Bondarchuk , Donald J. Bucci , Alejandro Ribeiro

Lung cancer and covid-19 have one of the highest morbidity and mortality rates in the world. For physicians, the identification of lesions is difficult in the early stages of the disease and time-consuming. Therefore, multi-task learning is…

Image and Video Processing · Electrical Eng. & Systems 2024-04-10 Weronika Hryniewska-Guzik , Maria Kędzierska , Przemysław Biecek

Limited availability of annotated medical imaging data poses a challenge for deep learning algorithms. Although transfer learning minimizes this hurdle in general, knowledge transfer across disparate domains is shown to be less effective.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Jitender Singh Virk , Deepti R. Bathula

Multi-task learning (MTL) is an efficient solution to solve multiple tasks simultaneously in order to get better speed and performance than handling each single-task in turn. The most current methods can be categorized as either: (i) hard…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Yifan Liu , Bohan Zhuang , Chunhua Shen , Hao Chen , Wei Yin

Multi-task learning (MTL) is a learning paradigm that enables the simultaneous training of multiple communicating algorithms. Although MTL has been successfully applied to ether regression or classification tasks alone, incorporating mixed…

Machine Learning · Computer Science 2024-05-17 Han Cao , Sivanesan Rajan , Bianka Hahn , Ersoy Kocak , Daniel Durstewitz , Emanuel Schwarz , Verena Schneider-Lindner

This paper explores and enhances the application of Transfer Learning (TL) for multilabel image classification in medical imaging, focusing on brain tumor class and diabetic retinopathy stage detection. The effectiveness of TL-using…

Image and Video Processing · Electrical Eng. & Systems 2024-12-31 Md. Zehan Alam , Tonmoy Roy , H. M. Nahid Kawsar , Iffat Rimi

Deep learning models tend to underperform in the presence of domain shifts. Domain transfer has recently emerged as a promising approach wherein images exhibiting a domain shift are transformed into other domains for augmentation or…

Image and Video Processing · Electrical Eng. & Systems 2022-10-27 Weinan Song , Gaurav Fotedar , Nima Tajbakhsh , Ziheng Zhou , Lei He , Xiaowei Ding

The integration of Federated Learning (FL) and Multi-Task Learning (MTL) has been explored to address client heterogeneity, with Federated Multi-Task Learning (FMTL) treating each client as a distinct task. However, most existing research…

Machine Learning · Computer Science 2025-10-06 Chao Feng , Nicolas Fazli Kohler , Zhi Wang , Weijie Niu , Alberto Huertas Celdran , Gerome Bovet , Burkhard Stiller

In multi-task learning (MTL) for visual scene understanding, it is crucial to transfer useful information between multiple tasks with minimal interferences. In this paper, we propose a novel architecture that effectively transfers…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Sunkyung Kim , Hyesong Choi , Dongbo Min

Motivation: Tumor classification using Imaging Mass Spectrometry (IMS) data has a high potential for future applications in pathology. Due to the complexity and size of the data, automated feature extraction and classification steps are…

Machine Learning · Statistics 2018-06-28 Jens Behrmann , Christian Etmann , Tobias Boskamp , Rita Casadonte , Jörg Kriegsmann , Peter Maass

Multitask learning (MTL) has emerged as a powerful paradigm that leverages similarities among multiple learning tasks, each with insufficient samples to train a standalone model, to solve them simultaneously while minimizing data sharing…

Machine Learning · Computer Science 2025-06-23 John Abascal , Nicolás Berrios , Alina Oprea , Jonathan Ullman , Adam Smith , Matthew Jagielski