English
Related papers

Related papers: Improving Generalization of Transfer Learning Acro…

200 papers

Transfer Learning is concerned with the application of knowledge gained from solving a problem to a different but related problem domain. In this paper, we propose a method and efficient algorithm for ranking and selecting representations…

Machine Learning · Computer Science 2014-05-29 Son N. Tran , Artur d'Avila Garcez

Transfer learning allows practitioners to recognize and apply knowledge learned in previous tasks (source task) to new tasks or new domains (target task), which share some commonality. The two important factors impacting the performance of…

Computer Vision and Pattern Recognition · Computer Science 2018-06-01 Michael Bernico , Yuntao Li , Dingchao Zhang

The availability of abundant labeled data in recent years led the researchers to introduce a methodology called transfer learning, which utilizes existing data in situations where there are difficulties in collecting new annotated data.…

Machine Learning · Computer Science 2021-04-07 Abolfazl Farahani , Behrouz Pourshojae , Khaled Rasheed , Hamid R. Arabnia

As a recent noticeable topic, domain generalization (DG) aims to first learn a generic model on multiple source domains and then directly generalize to an arbitrary unseen target domain without any additional adaption. In previous DG…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Yue Wang , Lei Qi , Yinghuan Shi , Yang Gao

Medical image segmentation plays a crucial role in clinical workflows, but domain shift often leads to performance degradation when models are applied to unseen clinical domains. This challenge arises due to variations in imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Yingkai Wang , Yaoyao Zhu , Xiuding Cai , Yuhao Xiao , Haotian Wu , Yu Yao

It is common to observe performance degradation when transferring models trained on some (source) datasets to target testing data due to a domain gap between them. Existing methods for bridging this gap, such as domain adaptation (DA), may…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Hyoungseob Park , Anjali Gupta , Alex Wong

In deep learning, transfer learning (TL) has become the de facto approach when dealing with image related tasks. Visual features learnt for one task have been shown to be reusable for other tasks, improving performance significantly. By…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Adrian Tormos , Dario Garcia-Gasulla , Victor Gimenez-Abalos , Sergio Alvarez-Napagao

The use of transfer learning with deep neural networks has increasingly become widespread for deploying well-tested computer vision systems to newer domains, especially those with limited datasets. We describe a transfer learning use case…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Rashik Shadman , M. G. Sarwar Murshed , Edward Verenich , Alvaro Velasquez , Faraz Hussain

Reliable perception during fast motion maneuvers or in high dynamic range environments is crucial for robotic systems. Since event cameras are robust to these challenging conditions, they have great potential to increase the reliability of…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Nico Messikommer , Daniel Gehrig , Mathias Gehrig , Davide Scaramuzza

Value iteration networks (VINs) have been demonstrated to have a good generalization ability for reinforcement learning tasks across similar domains. However, based on our experiments, a policy learned by VINs still fail to generalize well…

Machine Learning · Computer Science 2019-11-28 Junyi Shen , Hankz Hankui Zhuo , Jin Xu , Bin Zhong , Sinno Jialin Pan

Semi-supervised domain adaptation (SSDA) adapts a learner to a new domain by effectively utilizing source domain data and a few labeled target samples. It is a practical yet under-investigated research topic. In this paper, we analyze the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Wenqiao Zhang , Changshuo Liu , Can Cui , Beng Chin Ooi

Despite significant advances in deep learning, models often struggle to generalize well to new, unseen domains, especially when training data is limited. To address this challenge, we propose a novel approach for distribution-aware latent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Ran Liu , Sahil Khose , Jingyun Xiao , Lakshmi Sathidevi , Keerthan Ramnath , Zsolt Kira , Eva L. Dyer

Domain Adaptation has been widely used to deal with the distribution shift in vision, language, multimedia etc. Most domain adaptation methods learn domain-invariant features with data from both domains available. However, such a strategy…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Ning Ma , Jiajun Bu , Lixian Lu , Jun Wen , Zhen Zhang , Sheng Zhou , Xifeng Yan

It has been demonstrated that deep neural networks outperform traditional machine learning. However, deep networks lack generalisability, that is, they will not perform as good as in a new (testing) set drawn from a different distribution…

Machine Learning · Computer Science 2022-06-28 Bruno Casella , Alessio Barbaro Chisari , Sebastiano Battiato , Mario Valerio Giuffrida

Encrypted traffic classification (TC) methods must adapt to new protocols and extensions as well as to advancements in other machine learning fields. In this paper, we adopt a transfer learning setup best known from computer vision. We…

Machine Learning · Computer Science 2026-01-21 Jan Luxemburk , Karel Hynek , Richard Plný , Tomáš Čejka

Direct image-to-graph transformation is a challenging task that involves solving object detection and relationship prediction in a single model. Due to this task's complexity, large training datasets are rare in many domains, making the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Alexander H. Berger , Laurin Lux , Suprosanna Shit , Ivan Ezhov , Georgios Kaissis , Martin J. Menten , Daniel Rueckert , Johannes C. Paetzold

Feature-based transfer is one of the most effective methodologies for transfer learning. Existing studies usually assume that the learned new feature representation is \emph{domain-invariant}, and thus train a transfer model $\mathcal{M}$…

Machine Learning · Computer Science 2022-04-22 Pengfei Wei , Xinghua Qu , Yew Soon Ong , Zejun Ma

Although spatial prediction is widely used for urban and environmental monitoring, its accuracy is often unsatisfactory if only a small number of samples are available in the study area. The objective of this study was to improve the…

Applications · Statistics 2022-11-22 Daisuke Murakami , Mami Kajita , Seiji Kajita

Generalizability of deep learning models may be severely affected by the difference in the distributions of the train (source domain) and the test (target domain) sets, e.g., when the sets are produced by different hardware. As a…

Image and Video Processing · Electrical Eng. & Systems 2022-08-02 Ivan Zakazov , Vladimir Shaposhnikov , Iaroslav Bespalov , Dmitry V. Dylov

We propose a transfer learning method that utilizes data representations in a semiparametric regression model. Our aim is to perform statistical inference on the parameter of primary interest in the target model while accounting for…

Methodology · Statistics 2024-06-21 Baihua He , Huihang Liu , Xinyu Zhang , Jian Huang