English
Related papers

Related papers: Sample Complexity of Transfer Learning: An Optimal…

200 papers

Multi-source transfer learning provides an effective solution to data scarcity in real-world supervised learning scenarios by leveraging multiple source tasks. In this field, existing works typically use all available samples from sources…

Machine Learning · Computer Science 2025-10-29 Qingyue Zhang , Haohao Fu , Guanbo Huang , Yaoyuan Liang , Chang Chu , Tianren Peng , Yanru Wu , Qi Li , Yang Li , Shao-Lun Huang

We consider the transfer of experience samples (i.e., tuples < s, a, s', r >) in reinforcement learning (RL), collected from a set of source tasks to improve the learning process in a given target task. Most of the related approaches focus…

Machine Learning · Computer Science 2018-05-29 Andrea Tirinzoni , Andrea Sessa , Matteo Pirotta , Marcello Restelli

Transferring representation for multitask imitation learning has the potential to provide improved sample efficiency on learning new tasks, when compared to learning from scratch. In this work, we provide a statistical guarantee indicating…

Machine Learning · Computer Science 2023-11-06 Bryan Chan , Karime Pereida , James Bergstra

Transfer learning is a burgeoning concept in statistical machine learning that seeks to improve inference and/or predictive accuracy on a domain of interest by leveraging data from related domains. While the term "transfer learning" has…

Machine Learning · Statistics 2023-12-22 Piotr M. Suder , Jason Xu , David B. Dunson

In practice, it is very demanding and sometimes impossible to collect datasets of tagged data large enough to successfully train a machine learning model, and one possible solution to this problem is transfer learning. This study aims to…

Machine Learning · Computer Science 2022-01-13 Erik Otović , Marko Njirjak , Dario Jozinović , Goran Mauša , Alberto Michelini , Ivan Štajduhar

Transferability estimation is a fundamental problem in transfer learning to predict how good the performance is when transferring a source model (or source task) to a target task. With the guidance of transferability score, we can…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Yang Tan , Yang Li , Shao-Lun Huang

Many tasks in natural language understanding require learning relationships between two sequences for various tasks such as natural language inference, paraphrasing and entailment. These aforementioned tasks are similar in nature, yet they…

Machine Learning · Statistics 2018-09-18 James O' Neill , Danushka Bollegala

Classification has been a major task for building intelligent systems as it enables decision-making under uncertainty. Classifier design aims at building models from training data for representing feature-label distributions--either…

Machine Learning · Statistics 2023-01-31 Omar Maddouri , Xiaoning Qian , Francis J. Alexander , Edward R. Dougherty , Byung-Jun Yoon

Latent space model plays a crucial role in network analysis, and accurate estimation of latent variables is essential for downstream tasks such as link prediction. However, the large number of parameters to be estimated presents a…

Methodology · Statistics 2025-09-22 Kuangnan Fang , Ruixuan Qin , Xinyan Fan

Transfer Learning, a technique where a model/agent can use the knowledge/expertise that it gained from one task and exploit that to solve another closely-related task, is often used in tackling problems in deep learning. Through this…

Robotics · Computer Science 2026-05-19 Benedict Florance Arockiaraj , Richard Chang , Wesley Yee

Transfer learning methods endeavor to leverage relevant knowledge from existing source pre-trained models or datasets to solve downstream target tasks. With the increase in the scale and quantity of available pre-trained models nowadays, it…

Machine Learning · Computer Science 2024-02-26 Yuhe Ding , Bo Jiang , Aijing Yu , Aihua Zheng , Jian Liang

Transfer learning is a useful technique for achieving improved performance and reducing training costs by leveraging the knowledge gained from source tasks and applying it to target tasks. Assessing the effectiveness of transfer learning…

Machine Learning · Computer Science 2023-06-12 Peizhong Ju , Sen Lin , Mark S. Squillante , Yingbin Liang , Ness B. Shroff

Transfer learning seeks to improve the generalization performance of a target task by exploiting the knowledge learned from a related source task. Central questions include deciding what information one should transfer and when transfer can…

Machine Learning · Computer Science 2021-04-07 Oussama Dhifallah , Yue M. Lu

Deep neural networks produce state-of-the-art results when trained on a large number of labeled examples but tend to overfit when small amounts of labeled examples are used for training. Creating a large number of labeled examples requires…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Attaullah Sahito , Eibe Frank , Bernhard Pfahringer

Transfer learning leverages pre-trained model features from a large dataset to save time and resources when training new models for various tasks, potentially enhancing performance. Due to the lack of large datasets in the medical imaging…

Image and Video Processing · Electrical Eng. & Systems 2023-11-10 Gabriel Efrain Humpire-Mamani , Colin Jacobs , Mathias Prokop , Bram van Ginneken , Nikolas Lessmann

Transfer learning has become an essential technique to exploit information from the source domain to boost performance of the target task. Despite the prevalence in high-dimensional data, heterogeneity and heavy tails are insufficiently…

Machine Learning · Statistics 2023-11-07 Jiayu Huang , Mingqiu Wang , Yuanshan Wu

Transfer learning is a promising method for AOI applications since it can significantly shorten sample collection time and improve efficiency in today's smart manufacturing. However, related research enhanced the network models by applying…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Erik Isai Valle Salgado , Haoxin Yan , Yue Hong , Peiyuan Zhu , Shidong Zhu , Chengwei Liao , Yanxiang Wen , Xiu Li , Xiang Qian , Xiaohao Wang , Xinghui Li

Massive data is often considered essential for deep learning applications, but it also incurs significant computational and infrastructural costs. Therefore, dataset pruning (DP) has emerged as an effective way to improve data efficiency by…

Machine Learning · Computer Science 2023-11-21 Yihua Zhang , Yimeng Zhang , Aochuan Chen , Jinghan Jia , Jiancheng Liu , Gaowen Liu , Mingyi Hong , Shiyu Chang , Sijia Liu

We address the problem of ensemble selection in transfer learning: Given a large pool of source models we want to select an ensemble of models which, after fine-tuning on the target training set, yields the best performance on the target…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Andrea Agostinelli , Jasper Uijlings , Thomas Mensink , Vittorio Ferrari

We study the sample complexity of entropic optimal transport in high dimensions using computationally efficient plug-in estimators. We significantly advance the state of the art by establishing dimension-free, parametric rates for…

Statistics Theory · Mathematics 2022-06-28 Philippe Rigollet , Austin J. Stromme