English
Related papers

Related papers: Domain Adaptation and Transfer Learning in Stochas…

200 papers

Meta-Learning is a subarea of Machine Learning that aims to take advantage of prior knowledge to learn faster and with fewer data [1]. There are different scenarios where meta-learning can be applied, and one of the most common is algorithm…

Machine Learning · Computer Science 2019-10-17 Gean Trindade Pereira , Moisés dos Santos , Edesio Alcobaça , Rafael Mantovani , André Carvalho

Classical machine learning assumes that the training and test sets come from the same distributions. Therefore, a model learned from the labeled training data is expected to perform well on the test data. However, This assumption may not…

Machine Learning · Computer Science 2020-10-12 Abolfazl Farahani , Sahar Voghoei , Khaled Rasheed , Hamid R. Arabnia

The use of transfer learning with deep neural networks has increasingly become widespread for deploying well-tested computer vision systems to newer domains, especially those with limited datasets. We describe a transfer learning use case…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Rashik Shadman , M. G. Sarwar Murshed , Edward Verenich , Alvaro Velasquez , Faraz Hussain

Transfer learning has emerged as a powerful methodology for adapting pre-trained deep neural networks on image recognition tasks to new domains. This process consists of taking a neural network pre-trained on a large feature-rich source…

Machine Learning · Computer Science 2021-04-27 Francisco Utrera , Evan Kravitz , N. Benjamin Erichson , Rajiv Khanna , Michael W. Mahoney

Transfer learning is one of the subjects undergoing intense study in the area of machine learning. In object recognition and object detection there are known experiments for the transferability of parameters, but not for neural networks…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Ioannis Athanasiadis , Panagiotis Mousouliotis , Loukas Petrou

Transfer learning allows practitioners to recognize and apply knowledge learned in previous tasks (source task) to new tasks or new domains (target task), which share some commonality. The two important factors impacting the performance of…

Computer Vision and Pattern Recognition · Computer Science 2018-06-01 Michael Bernico , Yuntao Li , Dingchao Zhang

Transfer learning is a popular approach to bypassing data limitations in one domain by leveraging data from another domain. This is especially useful in robotics, as it allows practitioners to reduce data collection with physical robots,…

Machine Learning · Computer Science 2020-05-22 Liam Schramm , Avishai Sintov , Abdeslam Boularias

Getting deep convolutional neural networks to perform well requires a large amount of training data. When the available labelled data is small, it is often beneficial to use transfer learning to leverage a related larger dataset (source) in…

Machine Learning · Computer Science 2021-10-26 Lukas Hedegaard Morsing , Omar Ali Sheikh-Omar , Alexandros Iosifidis

Transfer learning is an important field of machine learning in general, and particularly in the context of fully autonomous driving, which needs to be solved simultaneously for many different domains, such as changing weather conditions and…

Machine Learning · Computer Science 2020-04-28 Oliver Scheel , Loren Schwarz , Nassir Navab , Federico Tombari

Transfer learning is widely used to adapt large pretrained models to new tasks with only a small amount of new data. However, a challenge persists -- the features from the original task often do not fully cover what is needed for unseen…

Machine Learning · Computer Science 2026-02-10 Xingyu Alice Yang , Jianyu Zhang , Léon Bottou

Transfer learning research attempts to make model induction transferable across different domains. This method assumes that specific information regarding to which domain each instance belongs is known. This paper helps to extend the…

Machine Learning · Computer Science 2025-06-04 Xinshun Liu , He Xin , Mao Hui , Liu Jing , Lai Weizhong , Ye Qingwen

Deep models must learn robust and transferable representations in order to perform well on new domains. While domain transfer methods (e.g., domain adaptation, domain generalization) have been proposed to learn transferable representations…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Donghyun Kim , Kaihong Wang , Stan Sclaroff , Kate Saenko

As the application of deep learning has expanded to real-world problems with insufficient volume of training data, transfer learning recently has gained much attention as means of improving the performance in such small-data regime.…

Machine Learning · Computer Science 2019-05-16 Yunhun Jang , Hankook Lee , Sung Ju Hwang , Jinwoo Shin

Modern deep neural network (DNN) systems are highly configurable with large a number of options that significantly affect their non-functional behavior, for example inference time and energy consumption. Performance models allow to…

Machine Learning · Computer Science 2019-04-08 Md Shahriar Iqbal , Lars Kotthoff , Pooyan Jamshidi

Reinforcement learning is a learning paradigm for solving sequential decision-making problems. Recent years have witnessed remarkable progress in reinforcement learning upon the fast development of deep neural networks. Along with the…

Machine Learning · Computer Science 2023-07-06 Zhuangdi Zhu , Kaixiang Lin , Anil K. Jain , Jiayu Zhou

Transfer learning, also referred as knowledge transfer, aims at reusing knowledge from a source dataset to a similar target one. While many empirical studies illustrate the benefits of transfer learning, few theoretical results are…

Statistics Theory · Mathematics 2021-02-19 David Obst , Badih Ghattas , Jairo Cugliari , Georges Oppenheim , Sandra Claudel , Yannig Goude

Recently, transfer learning and self-supervised learning have gained significant attention within the medical field due to their ability to mitigate the challenges posed by limited data availability, improve model generalisation, and reduce…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Zehui Zhao , Laith Alzubaidi , Jinglan Zhang , Ye Duan , Usman Naseem , Yuantong Gu

Existing transfer learning-based beam prediction approaches primarily rely on simple fine-tuning. When there is a significant difference in data distribution between the target domain and the source domain, simple fine-tuning limits the…

Information Theory · Computer Science 2025-09-26 Zhiqiang Xiao , Yuwen Cao , Mondher Bouazizi , Tomoaki Ohtsuki , Shahid Mumtaz

We introduce a new representation learning algorithm suited to the context of domain adaptation, in which data at training and test time come from similar but different distributions. Our algorithm is directly inspired by theory on domain…

Machine Learning · Statistics 2015-02-10 Hana Ajakan , Pascal Germain , Hugo Larochelle , François Laviolette , Mario Marchand

Learning from small amounts of labeled data is a challenge in the area of deep learning. This is currently addressed by Transfer Learning where one learns the small data set as a transfer task from a larger source dataset. Transfer Learning…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Parijat Dube , Bishwaranjan Bhattacharjee , Elisabeth Petit-Bois , Matthew Hill