English
Related papers

Related papers: Model-based Transfer Learning for Automatic Optica…

200 papers

Classical Domain Adaptation methods acquire transferability by regularizing the overall distributional discrepancies between features in the source domain (labeled) and features in the target domain (unlabeled). They often do not…

Machine Learning · Computer Science 2023-06-01 Shumin Ma , Zhiri Yuan , Qi Wu , Yiyan Huang , Xixu Hu , Cheuk Hang Leung , Dongdong Wang , Zhixiang Huang

This paper presents Adaptive Meta-Domain Transfer Learning (AMDTL), a novel methodology that combines principles of meta-learning with domain-specific adaptations to enhance the transferability of artificial intelligence models across…

Machine Learning · Computer Science 2024-09-12 Michele Laurelli

Transfer learning is an important field of machine learning in general, and particularly in the context of fully autonomous driving, which needs to be solved simultaneously for many different domains, such as changing weather conditions and…

Machine Learning · Computer Science 2020-04-28 Oliver Scheel , Loren Schwarz , Nassir Navab , Federico Tombari

Domain adaptation seeks to mitigate the shift between training on the \emph{source} domain and testing on the \emph{target} domain. Most adaptation methods rely on the source data by joint optimization over source data and target data.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Dequan Wang , Shaoteng Liu , Sayna Ebrahimi , Evan Shelhamer , Trevor Darrell

Transfer learning (TL) has been widely used in motor imagery (MI) based brain-computer interfaces (BCIs) to reduce the calibration effort for a new subject, and demonstrated promising performance. While a closed-loop MI-based BCI system,…

Signal Processing · Electrical Eng. & Systems 2023-05-04 Dongrui Wu , Xue Jiang , Ruimin Peng , Wanzeng Kong , Jian Huang , Zhigang Zeng

Transfer learning refers to the process of adapting a model trained on a source task to a target task. While kernel methods are conceptually and computationally simple machine learning models that are competitive on a variety of tasks, it…

Machine Learning · Computer Science 2022-11-02 Adityanarayanan Radhakrishnan , Max Ruiz Luyten , Neha Prasad , Caroline Uhler

We propose a novel framework that unifies and extends existing methods of transfer learning (TL) for regression. To bridge a pretrained source model to the model on a target task, we introduce a density-ratio reweighting function, which is…

Machine Learning · Statistics 2020-12-18 Shunya Minami , Song Liu , Stephen Wu , Kenji Fukumizu , Ryo Yoshida

Transfer Learning aims to optimally aggregate samples from a target distribution, with related samples from a so-called source distribution to improve target risk. Multiple procedures have been proposed over the last two decades to address…

Machine Learning · Statistics 2025-04-29 Steve Hanneke , Samory Kpotufe

Transfer learning (TL) utilizes data or knowledge from one or more source domains to facilitate the learning in a target domain. It is particularly useful when the target domain has very few or no labeled data, due to annotation expense,…

Machine Learning · Computer Science 2022-12-13 Wen Zhang , Lingfei Deng , Lei Zhang , Dongrui Wu

In the recommendation systems, there are multiple business domains to meet the diverse interests and needs of users, and the click-through rate(CTR) of each domain can be quite different, which leads to the demand for CTR prediction…

Information Retrieval · Computer Science 2023-06-30 Wei Zhang , Pengye Zhang , Bo Zhang , Xingxing Wang , Dong Wang

Theoretical studies on transfer learning or domain adaptation have so far focused on situations with a known hypothesis class or model; however in practice, some amount of model selection is usually involved, often appearing under the…

Machine Learning · Statistics 2023-10-13 Steve Hanneke , Samory Kpotufe , Yasaman Mahdaviyeh

Due to the existence of dataset shifts, the distributions of data acquired from different working conditions show significant differences in real-world industrial applications, which leads to performance degradation of traditional machine…

Signal Processing · Electrical Eng. & Systems 2021-01-28 Huanjie Wang , Jie Tan , Xiwei Bai , Jiechao Yang

Transfer learning of diffusion models to smaller target domains is challenging, as naively fine-tuning the model often results in poor generalization. Test-time guidance methods help mitigate this by offering controllable improvements in…

Graphics · Computer Science 2026-01-21 Yara Bahram , Mohammadhadi Shateri , Eric Granger

We propose associative domain adaptation, a novel technique for end-to-end domain adaptation with neural networks, the task of inferring class labels for an unlabeled target domain based on the statistical properties of a labeled source…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Philip Haeusser , Thomas Frerix , Alexander Mordvintsev , Daniel Cremers

Performance of neural network models relies on the availability of large datasets with minimal levels of uncertainty. Transfer Learning (TL) models have been proposed to resolve the issue of small dataset size by letting the model train on…

Transfer-learning methods aim to improve performance in a data-scarce target domain using a model pretrained on a data-rich source domain. A cost-efficient strategy, linear probing, involves freezing the source model and training a new…

Machine Learning · Computer Science 2022-07-27 Utku Evci , Vincent Dumoulin , Hugo Larochelle , Michael C. Mozer

Transfer learning (TL) has emerged as a powerful tool for improving estimation and prediction performance by leveraging information from related datasets, with the offset TL (O-TL) being a prevailing implementation. In this paper, we adapt…

Methodology · Statistics 2026-03-12 Yuping Yang , Zhiyang Zhou

Active learning (AL) aims to reduce labeling costs by querying the examples most beneficial for model learning. While the effectiveness of AL for fine-tuning transformer-based pre-trained language models (PLMs) has been demonstrated, it is…

Machine Learning · Computer Science 2023-10-02 Fran Jelenić , Josip Jukić , Nina Drobac , Jan Šnajder

Deep learning (DL) techniques are highly effective for defect detection from images. Training DL classification models, however, requires vast amounts of labeled data which is often expensive to collect. In many cases, not only the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Adrian Shuai Li , Elisa Bertino , Rih-Teng Wu , Ting-Yan Wu

Supervised transfer learning has received considerable attention due to its potential to boost the predictive power of machine learning in scenarios where data are scarce. Generally, a given set of source models and a dataset from a target…

Machine Learning · Statistics 2024-01-23 Shunya Minami , Kenji Fukumizu , Yoshihiro Hayashi , Ryo Yoshida