English
Related papers

Related papers: Transfer or Self-Supervised? Bridging the Performa…

200 papers

This work investigates the unexplored usability of self-supervised representation learning in the direction of functional knowledge transfer. In this work, functional knowledge transfer is achieved by joint optimization of self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Prakash Chandra Chhipa , Muskaan Chopra , Gopal Mengi , Varun Gupta , Richa Upadhyay , Meenakshi Subhash Chippa , Kanjar De , Rajkumar Saini , Seiichi Uchida , Marcus Liwicki

Integrating knowledge across different domains is an essential feature of human learning. Learning paradigms such as transfer learning, meta-learning, and multi-task learning reflect the human learning process by exploiting the prior…

Machine Learning · Computer Science 2024-10-17 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

As a subset of machine learning, meta-learning, or learning to learn, aims at improving the model's capabilities by employing prior knowledge and experience. A meta-learning paradigm can appropriately tackle the conventional challenges of…

Machine Learning · Computer Science 2024-08-14 Alireza Rafiei , Ronald Moore , Sina Jahromi , Farshid Hajati , Rishikesan Kamaleswaran

Transfer learning is a burgeoning concept in statistical machine learning that seeks to improve inference and/or predictive accuracy on a domain of interest by leveraging data from related domains. While the term "transfer learning" has…

Machine Learning · Statistics 2023-12-22 Piotr M. Suder , Jason Xu , David B. Dunson

Deep learning has yet to revolutionize general practices in healthcare, despite promising results for some specific tasks. This is partly due to data being in insufficient quantities hurting the training of the models. To address this…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Maxime De Bois , Mounîm A. El Yacoubi , Mehdi Ammi

Many machine learning and data mining algorithms rely on the assumption that the training and testing data share the same feature space and distribution. However, this assumption may not always hold. For instance, there are situations where…

Cryptography and Security · Computer Science 2024-03-05 Adrian Shuai Li , Arun Iyengar , Ashish Kundu , Elisa Bertino

Transfer learning has become a powerful tool to initialize deep learning models to achieve faster convergence and higher performance. This is especially useful in the medical imaging analysis domain, where data scarcity limits possible…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Ibrahim Almakky , Santosh Sanjeev , Anees Ur Rehman Hashmi , Mohammad Areeb Qazi , Hu Wang , Mohammad Yaqub

Limited availability of annotated medical imaging data poses a challenge for deep learning algorithms. Although transfer learning minimizes this hurdle in general, knowledge transfer across disparate domains is shown to be less effective.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Jitender Singh Virk , Deepti R. Bathula

Recent work on deep learning for tabular data demonstrates the strong performance of deep tabular models, often bridging the gap between gradient boosted decision trees and neural networks. Accuracy aside, a major advantage of neural models…

Self-supervised learning has demonstrated considerable potential in hyperspectral representation, yet its application in cross-domain transfer scenarios remains under-explored. Existing methods, however, still rely on source domain…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Jianshu Chao , Tianhua Lv , Qiqiong Ma , Yunfei Qiu , Li Fang , Huifang Shen , Wei Yao

Transfer learning boosts the performance of medical image analysis by enabling deep learning (DL) on small datasets through the knowledge acquired from large ones. As the number of DL architectures explodes, exhaustively attempting all…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Levy Chaves , Alceu Bissoto , Eduardo Valle , Sandra Avila

Data fusion and transfer learning are rapidly growing fields that enhance model performance for a target population by leveraging other related data sources or tasks. The challenges lie in the various potential heterogeneities between the…

Machine Learning · Statistics 2025-08-19 Jing Wang , HaiYing Wang , Kun Chen

In this work we examine the performance enhancement in classification of medical imaging data when image features are combined with associated non-image data. We compare the performance of eight state-of-the-art deep neural networks in…

Image and Video Processing · Electrical Eng. & Systems 2021-11-30 Spencer A. Thomas

Transfer learning is a recent field of machine learning research that aims to resolve the challenge of dealing with insufficient training data in the domain of interest. This is a particular issue with traditional deep neural networks where…

Computer Vision and Pattern Recognition · Computer Science 2015-12-21 Mohammad Javad Shafiee , Parthipan Siva , Paul Fieguth , Alexander Wong

One desired capability for machines is the ability to transfer their knowledge of one domain to another where data is (usually) scarce. Despite ample adaptation of transfer learning in various deep learning applications, we yet do not…

Machine Learning · Computer Science 2021-01-18 Behnam Neyshabur , Hanie Sedghi , Chiyuan Zhang

Self-supervised learning (SSL) has emerged as a promising paradigm in medical imaging, addressing the chronic challenge of limited labeled data in healthcare settings. While SSL has shown impressive results, existing studies in the medical…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Valay Bundele , Karahan Sarıtaş , Bora Kargi , Oğuz Ata Çal , Kıvanç Tezören , Zohreh Ghaderi , Hendrik Lensch

Self-supervised learning has emerged as a powerful tool for pretraining deep networks on unlabeled data, prior to transfer learning of target tasks with limited annotation. The relevance between the pretraining pretext and target tasks is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Tianwei Zhang , Dong Wei , Mengmeng Zhu , Shi Gu , Yefeng Zheng

In recent years self-supervised learning has emerged as a promising candidate for unsupervised representation learning. In the visual domain its applications are mostly studied in the context of images of natural scenes. However, its…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Vladan Stojnić , Vladimir Risojević

Supervised learning is limited both by the quantity and quality of the labeled data. In the field of medical record tagging, writing styles between hospitals vary drastically. The knowledge learned from one hospital might not transfer well…

Computation and Language · Computer Science 2018-11-30 Yuhui Zhang , Allen Nie , James Zou

All famous machine learning algorithms that comprise both supervised and semi-supervised learning work well only under a common assumption: the training and test data follow the same distribution. When the distribution changes, most…

Machine Learning · Computer Science 2022-07-15 Ievgen Redko , Emilie Morvant , Amaury Habrard , Marc Sebban , Younès Bennani