English
Related papers

Related papers: Transferability Estimation Based On Principal Grad…

200 papers

We introduce a new measure to evaluate the transferability of representations learned by classifiers. Our measure, the Log Expected Empirical Prediction (LEEP), is simple and easy to compute: when given a classifier trained on a source data…

Machine Learning · Computer Science 2020-08-17 Cuong V. Nguyen , Tal Hassner , Matthias Seeger , Cedric Archambeau

Task transfer learning is a popular technique in image processing applications that uses pre-trained models to reduce the supervision cost of related tasks. An important question is to determine task transferability, i.e. given a common…

Machine Learning · Computer Science 2022-12-21 Yajie Bao , Yang Li , Shao-Lun Huang , Lin Zhang , Lizhong Zheng , Amir Zamir , Leonidas Guibas

Transfer learning, also referred as knowledge transfer, aims at reusing knowledge from a source dataset to a similar target one. While many empirical studies illustrate the benefits of transfer learning, few theoretical results are…

Statistics Theory · Mathematics 2021-02-19 David Obst , Badih Ghattas , Jairo Cugliari , Georges Oppenheim , Sandra Claudel , Yannig Goude

We study a fundamental transfer learning process from source to target linear regression tasks, including overparameterized settings where there are more learned parameters than data samples. The target task learning is addressed by using…

Machine Learning · Computer Science 2024-06-03 Yehuda Dar , Daniel LeJeune , Richard G. Baraniuk

Transfer learning is a popular paradigm for utilizing existing knowledge from previous learning tasks to improve the performance of new ones. It has enjoyed numerous empirical successes and inspired a growing number of theoretical studies.…

Machine Learning · Computer Science 2023-05-23 Haoyang Cao , Haotian Gu , Xin Guo

Transfer learning is an emerging and popular paradigm for utilizing existing knowledge from previous learning tasks to improve the performance of new ones. In this paper, we propose a novel concept of transfer risk and and analyze its…

Mathematical Finance · Quantitative Finance 2023-11-07 Haoyang Cao , Haotian Gu , Xin Guo , Mathieu Rosenbaum

Transfer of pre-trained representations can improve sample efficiency and reduce computational requirements for new tasks. However, representations used for transfer are usually generic, and are not tailored to a particular distribution of…

We address the problem of ensemble selection in transfer learning: Given a large pool of source models we want to select an ensemble of models which, after fine-tuning on the target training set, yields the best performance on the target…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Andrea Agostinelli , Jasper Uijlings , Thomas Mensink , Vittorio Ferrari

Transfer learning is an emerging and popular paradigm for utilizing existing knowledge from previous learning tasks to improve the performance of new ones. Despite its numerous empirical successes, theoretical analysis for transfer learning…

Machine Learning · Computer Science 2023-01-30 Haoyang Cao , Haotian Gu , Xin Guo , Mathieu Rosenbaum

The goal of task transfer in reinforcement learning is migrating the action policy of an agent to the target task from the source task. Given their successes on robotic action planning, current methods mostly rely on two requirements:…

Machine Learning · Computer Science 2019-02-19 Mingxuan Jing , Xiaojian Ma , Wenbing Huang , Fuchun Sun , Huaping Liu

Supervised transfer learning has received considerable attention due to its potential to boost the predictive power of machine learning in scenarios where data are scarce. Generally, a given set of source models and a dataset from a target…

Machine Learning · Statistics 2024-01-23 Shunya Minami , Kenji Fukumizu , Yoshihiro Hayashi , Ryo Yoshida

Transfer learning is a useful technique for achieving improved performance and reducing training costs by leveraging the knowledge gained from source tasks and applying it to target tasks. Assessing the effectiveness of transfer learning…

Machine Learning · Computer Science 2023-06-12 Peizhong Ju , Sen Lin , Mark S. Squillante , Yingbin Liang , Ness B. Shroff

Transfer learning aims at improving the performance of target learners on target domains by transferring the knowledge contained in different but related source domains. In this way, the dependence on a large number of target domain data…

Machine Learning · Computer Science 2020-06-24 Fuzhen Zhuang , Zhiyuan Qi , Keyu Duan , Dongbo Xi , Yongchun Zhu , Hengshu Zhu , Hui Xiong , Qing He

We introduce a transfer learning framework for regression that leverages heterogeneous source domains to improve predictive performance in a data-scarce target domain. Our approach learns a conditional generative model separately for each…

Machine Learning · Statistics 2026-02-03 Yikun Zhang , Steven Wilkins-Reeves , Wesley Lee , Aude Hofleitner

Transfer learning where the behavior of extracting transferable knowledge from the source domain(s) and reusing this knowledge to target domain has become a research area of great interest in the field of artificial intelligence.…

Machine Learning · Computer Science 2021-09-29 Junyu Xuan , Jie Lu , Guangquan Zhang

Leveraging a transferability estimation metric facilitates the non-trivial challenge of selecting the optimal model for the downstream task from a pool of pre-trained models. Most existing metrics primarily focus on identifying the…

Machine Learning · Computer Science 2025-02-25 Prafful Kumar Khoba , Zijian Wang , Chetan Arora , Mahsa Baktashmotlagh

Transfer learning for partial differential equations (PDEs) is to develop a pre-trained neural network that can be used to solve a wide class of PDEs. Existing transfer learning approaches require much information of the target PDEs such as…

Numerical Analysis · Mathematics 2023-01-30 Zezhong Zhang , Feng Bao , Lili Ju , Guannan Zhang

In transfer learning, transferability is one of the most fundamental problems, which aims to evaluate the effectiveness of arbitrary transfer tasks. Existing research focuses on classification tasks and neglects domain or task differences.…

Machine Learning · Computer Science 2026-02-10 Qianshan Zhan , Xiao-Jun Zeng

The availability of abundant labeled data in recent years led the researchers to introduce a methodology called transfer learning, which utilizes existing data in situations where there are difficulties in collecting new annotated data.…

Machine Learning · Computer Science 2021-04-07 Abolfazl Farahani , Behrouz Pourshojae , Khaled Rasheed , Hamid R. Arabnia

Recent years, transfer learning has attracted much attention in the community of machine learning. In this paper, we mainly focus on the tasks of parameter transfer under the framework of extreme learning machine (ELM). Unlike the existing…

Machine Learning · Computer Science 2018-10-24 Chao Chen , Boyuan Jiang , Xinyu Jin