中文
相关论文

相关论文: Transferability Estimation Based On Principal Grad…

200 篇论文

We introduce a new measure to evaluate the transferability of representations learned by classifiers. Our measure, the Log Expected Empirical Prediction (LEEP), is simple and easy to compute: when given a classifier trained on a source data…

机器学习 · 计算机科学 2020-08-17 Cuong V. Nguyen , Tal Hassner , Matthias Seeger , Cedric Archambeau

Task transfer learning is a popular technique in image processing applications that uses pre-trained models to reduce the supervision cost of related tasks. An important question is to determine task transferability, i.e. given a common…

机器学习 · 计算机科学 2022-12-21 Yajie Bao , Yang Li , Shao-Lun Huang , Lin Zhang , Lizhong Zheng , Amir Zamir , Leonidas Guibas

Transfer learning, also referred as knowledge transfer, aims at reusing knowledge from a source dataset to a similar target one. While many empirical studies illustrate the benefits of transfer learning, few theoretical results are…

We study a fundamental transfer learning process from source to target linear regression tasks, including overparameterized settings where there are more learned parameters than data samples. The target task learning is addressed by using…

机器学习 · 计算机科学 2024-06-03 Yehuda Dar , Daniel LeJeune , Richard G. Baraniuk

Transfer learning is a popular paradigm for utilizing existing knowledge from previous learning tasks to improve the performance of new ones. It has enjoyed numerous empirical successes and inspired a growing number of theoretical studies.…

机器学习 · 计算机科学 2023-05-23 Haoyang Cao , Haotian Gu , Xin Guo

Transfer learning is an emerging and popular paradigm for utilizing existing knowledge from previous learning tasks to improve the performance of new ones. In this paper, we propose a novel concept of transfer risk and and analyze its…

数理金融 · 定量金融 2023-11-07 Haoyang Cao , Haotian Gu , Xin Guo , Mathieu Rosenbaum

Transfer of pre-trained representations can improve sample efficiency and reduce computational requirements for new tasks. However, representations used for transfer are usually generic, and are not tailored to a particular distribution of…

We address the problem of ensemble selection in transfer learning: Given a large pool of source models we want to select an ensemble of models which, after fine-tuning on the target training set, yields the best performance on the target…

计算机视觉与模式识别 · 计算机科学 2022-04-01 Andrea Agostinelli , Jasper Uijlings , Thomas Mensink , Vittorio Ferrari

Transfer learning is an emerging and popular paradigm for utilizing existing knowledge from previous learning tasks to improve the performance of new ones. Despite its numerous empirical successes, theoretical analysis for transfer learning…

机器学习 · 计算机科学 2023-01-30 Haoyang Cao , Haotian Gu , Xin Guo , Mathieu Rosenbaum

The goal of task transfer in reinforcement learning is migrating the action policy of an agent to the target task from the source task. Given their successes on robotic action planning, current methods mostly rely on two requirements:…

机器学习 · 计算机科学 2019-02-19 Mingxuan Jing , Xiaojian Ma , Wenbing Huang , Fuchun Sun , Huaping Liu

Supervised transfer learning has received considerable attention due to its potential to boost the predictive power of machine learning in scenarios where data are scarce. Generally, a given set of source models and a dataset from a target…

机器学习 · 统计学 2024-01-23 Shunya Minami , Kenji Fukumizu , Yoshihiro Hayashi , Ryo Yoshida

Transfer learning is a useful technique for achieving improved performance and reducing training costs by leveraging the knowledge gained from source tasks and applying it to target tasks. Assessing the effectiveness of transfer learning…

机器学习 · 计算机科学 2023-06-12 Peizhong Ju , Sen Lin , Mark S. Squillante , Yingbin Liang , Ness B. Shroff

Transfer learning aims at improving the performance of target learners on target domains by transferring the knowledge contained in different but related source domains. In this way, the dependence on a large number of target domain data…

机器学习 · 计算机科学 2020-06-24 Fuzhen Zhuang , Zhiyuan Qi , Keyu Duan , Dongbo Xi , Yongchun Zhu , Hengshu Zhu , Hui Xiong , Qing He

We introduce a transfer learning framework for regression that leverages heterogeneous source domains to improve predictive performance in a data-scarce target domain. Our approach learns a conditional generative model separately for each…

机器学习 · 统计学 2026-02-03 Yikun Zhang , Steven Wilkins-Reeves , Wesley Lee , Aude Hofleitner

Transfer learning where the behavior of extracting transferable knowledge from the source domain(s) and reusing this knowledge to target domain has become a research area of great interest in the field of artificial intelligence.…

机器学习 · 计算机科学 2021-09-29 Junyu Xuan , Jie Lu , Guangquan Zhang

Leveraging a transferability estimation metric facilitates the non-trivial challenge of selecting the optimal model for the downstream task from a pool of pre-trained models. Most existing metrics primarily focus on identifying the…

机器学习 · 计算机科学 2025-02-25 Prafful Kumar Khoba , Zijian Wang , Chetan Arora , Mahsa Baktashmotlagh

Transfer learning for partial differential equations (PDEs) is to develop a pre-trained neural network that can be used to solve a wide class of PDEs. Existing transfer learning approaches require much information of the target PDEs such as…

数值分析 · 数学 2023-01-30 Zezhong Zhang , Feng Bao , Lili Ju , Guannan Zhang

In transfer learning, transferability is one of the most fundamental problems, which aims to evaluate the effectiveness of arbitrary transfer tasks. Existing research focuses on classification tasks and neglects domain or task differences.…

机器学习 · 计算机科学 2026-02-10 Qianshan Zhan , Xiao-Jun Zeng

The availability of abundant labeled data in recent years led the researchers to introduce a methodology called transfer learning, which utilizes existing data in situations where there are difficulties in collecting new annotated data.…

机器学习 · 计算机科学 2021-04-07 Abolfazl Farahani , Behrouz Pourshojae , Khaled Rasheed , Hamid R. Arabnia

Recent years, transfer learning has attracted much attention in the community of machine learning. In this paper, we mainly focus on the tasks of parameter transfer under the framework of extreme learning machine (ELM). Unlike the existing…

机器学习 · 计算机科学 2018-10-24 Chao Chen , Boyuan Jiang , Xinyu Jin