中文
相关论文

相关论文: Fast and Accurate Transferability Measurement by E…

200 篇论文

Transfer learning is an umbrella term for machine learning approaches that leverage knowledge gained from solving one problem (the source domain) to improve speed, efficiency, and data requirements in solving a different but related problem…

系统与控制 · 电气工程与系统科学 2024-12-03 Alireza Nadali , Bingzhuo Zhong , Ashutosh Trivedi , Majid Zamani

This paper addresses the problem of ranking pre-trained models for object detection and image classification. Selecting the best pre-trained model by fine-tuning is an expensive and time-consuming task. Previous works have proposed…

计算机视觉与模式识别 · 计算机科学 2023-08-07 Mohsen Gholami , Mohammad Akbari , Xinglu Wang , Behnam Kamranian , Yong Zhang

Transfer learning can be applied in deep reinforcement learning to accelerate the training of a policy in a target task by transferring knowledge from a policy learned in a related source task. This is commonly achieved by copying…

机器学习 · 计算机科学 2023-06-22 Joseph Campbell , Yue Guo , Fiona Xie , Simon Stepputtis , Katia Sycara

The increasing of pre-trained models has significantly facilitated the performance on limited data tasks with transfer learning. However, progress on transfer learning mainly focuses on optimizing the weights of pre-trained models, which…

计算机视觉与模式识别 · 计算机科学 2021-03-03 Bingyan Liu , Yifeng Cai , Yao Guo , Xiangqun Chen

Transfer learning is a standard technique to improve performance on tasks with limited data. However, for medical imaging, the value of transfer learning is less clear. This is likely due to the large domain mismatch between the usual…

Transfer learning assumes classifiers of similar tasks share certain parameter structures. Unfortunately, modern classifiers uses sophisticated feature representations with huge parameter spaces which lead to costly transfer. Under the…

机器学习 · 统计学 2015-10-20 Song Liu , Kenji Fukumizu

Modern software systems are built to be used in dynamic environments using configuration capabilities to adapt to changes and external uncertainties. In a self-adaptation context, we are often interested in reasoning about the performance…

软件工程 · 计算机科学 2017-04-24 Pooyan Jamshidi , Miguel Velez , Christian Kästner , Norbert Siegmund , Prasad Kawthekar

Transfer learning has become crucial in computer vision tasks due to the vast availability of pre-trained deep learning models. However, selecting the optimal pre-trained model from a diverse pool for a specific downstream task remains a…

计算机视觉与模式识别 · 计算机科学 2023-08-30 Xiaotong Li , Zixuan Hu , Yixiao Ge , Ying Shan , Ling-Yu Duan

Transfer learning aims to transfer knowledge or information from a source domain to a relevant target domain. In this paper, we understand transfer learning from the perspectives of knowledge transferability and trustworthiness. This…

机器学习 · 计算机科学 2025-11-13 Jun Wu , Jingrui He

Transferring knowledge from one neural network to another has been shown to be helpful for learning tasks with few training examples. Prevailing fine-tuning methods could potentially contaminate pre-trained features by comparably high…

机器学习 · 计算机科学 2019-07-15 Farshid Varno , Behrouz Haji Soleimani , Marzie Saghayi , Lisa Di Jorio , Stan Matwin

In low-resource settings, model transfer can help to overcome a lack of labeled data for many tasks and domains. However, predicting useful transfer sources is a challenging problem, as even the most similar sources might lead to unexpected…

计算与语言 · 计算机科学 2021-11-01 Lukas Lange , Jannik Strötgen , Heike Adel , Dietrich Klakow

Regression prediction plays a crucial role in practical applications and strongly relies on data annotation. However, due to prohibitive annotation costs or domain-specific constraints, labeled data in the target domain is often scarce,…

统计方法学 · 统计学 2025-09-25 Bingbing Wang , Jiaqi Wang , Yu Tang

Transfer learning is a powerful tool enabling model training with limited amounts of data. This technique is particularly useful in real-world problems where data availability is often a serious limitation. The simplest transfer learning…

机器学习 · 计算机科学 2023-03-03 Federica Gerace , Diego Doimo , Stefano Sarao Mannelli , Luca Saglietti , Alessandro Laio

Human learners have the natural ability to use knowledge gained in one setting for learning in a different but related setting. This ability to transfer knowledge from one task to another is essential for effective learning. In this paper,…

统计理论 · 数学 2019-06-10 T. Tony Cai , Hongji Wei

Intermediate task transfer learning can greatly improve model performance. If, for example, one has little training data for emotion detection, first fine-tuning a language model on a sentiment classification dataset may improve performance…

计算与语言 · 计算机科学 2024-10-22 David Schulte , Felix Hamborg , Alan Akbik

The success of deep learning algorithms generally depends on large-scale data, while humans appear to have inherent ability of knowledge transfer, by recognizing and applying relevant knowledge from previous learning experiences when…

机器学习 · 计算机科学 2022-01-19 Junguang Jiang , Yang Shu , Jianmin Wang , Mingsheng Long

Transfer learning allows practitioners to recognize and apply knowledge learned in previous tasks (source task) to new tasks or new domains (target task), which share some commonality. The two important factors impacting the performance of…

计算机视觉与模式识别 · 计算机科学 2018-06-01 Michael Bernico , Yuntao Li , Dingchao Zhang

Transfer learning (TL) leverages previously obtained knowledge to learn new tasks efficiently and has been used to train deep learning (DL) models with limited amount of data. When TL is applied to DL, pretrained (teacher) models are…

Transfer learning enhances prediction accuracy on a target distribution by leveraging data from a source distribution, demonstrating significant benefits in various applications. This paper introduces a novel dissimilarity measure that…

机器学习 · 统计学 2024-12-12 Mitsuhiro Fujikawa , Yohei Akimoto , Jun Sakuma , Kazuto Fukuchi

In this work, we study the transfer learning problem under high-dimensional generalized linear models (GLMs), which aim to improve the fit on target data by borrowing information from useful source data. Given which sources to transfer, we…

机器学习 · 统计学 2022-04-19 Ye Tian , Yang Feng