English
Related papers

Related papers: Transferability Metrics for Selecting Source Model…

200 papers

Considering data insufficiency in metal additive manufacturing (AM), transfer learning (TL) has been adopted to extract knowledge from source domains (e.g., completed printings) to improve the modeling performance in target domains (e.g.,…

Machine Learning · Computer Science 2024-01-18 Yifan Tang , M. Rahmani Dehaghani , Pouyan Sajadi , G. Gary Wang

Transferring knowledge from large source datasets is an effective way to fine-tune the deep neural networks of the target task with a small sample size. A great number of algorithms have been proposed to facilitate deep transfer learning,…

Machine Learning · Computer Science 2020-07-21 Xingjian Li , Haoyi Xiong , Haozhe An , Chengzhong Xu , Dejing Dou

Neural networks are susceptible to adversarial perturbations that are transferable across different models. In this paper, we introduce a novel model alignment technique aimed at improving a given source model's ability in generating…

Machine Learning · Computer Science 2024-07-18 Avery Ma , Amir-massoud Farahmand , Yangchen Pan , Philip Torr , Jindong Gu

Ensemble learning is a process by which multiple base learners are strategically generated and combined into one composite learner. There are two features that are essential to an ensemble's performance, the individual accuracies of the…

Machine Learning · Computer Science 2021-09-30 Wenjing Li , Randy C. Paffenroth , David Berthiaume

Although transfer learning is proven to be effective in computer vision and natural language processing applications, it is rarely investigated in forecasting financial time series. Majority of existing works on transfer learning are based…

Machine Learning · Computer Science 2021-06-29 Qi-Qiao He , Patrick Cheong-Iao Pang , Yain-Whar Si

This paper investigates the accuracy of generative models and the impact of knowledge transfer on their generation precision. Specifically, we examine a generative model for a target task, fine-tuned using a pre-trained model from a source…

Machine Learning · Statistics 2025-06-03 Xinyu Tian , Xiaotong Shen

Quantile regression is increasingly encountered in modern big data applications due to its robustness and flexibility. We consider the scenario of learning the conditional quantiles of a specific target population when the available data…

Statistics Theory · Mathematics 2024-02-27 Jun Jin , Jun Yan , Robert H. Aseltine , Kun Chen

Recent work has shown that models trained to the same objective, and which achieve similar measures of accuracy on consistent test data, may nonetheless behave very differently on individual predictions. This inconsistency is undesirable in…

Machine Learning · Computer Science 2021-11-17 Emily Black , Klas Leino , Matt Fredrikson

Transfer learning is an umbrella term for machine learning approaches that leverage knowledge gained from solving one problem (the source domain) to improve speed, efficiency, and data requirements in solving a different but related problem…

Systems and Control · Electrical Eng. & Systems 2024-12-03 Alireza Nadali , Bingzhuo Zhong , Ashutosh Trivedi , Majid Zamani

Generating 3D city models rapidly is crucial for many applications. Monocular height estimation is one of the most efficient and timely ways to obtain large-scale geometric information. However, existing works focus primarily on training…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Zhitong Xiong , Wei Huang , Jingtao Hu , Xiao Xiang Zhu

Several multi-target regression methods were devel-oped in the last years aiming at improving predictive performanceby exploring inter-target correlation within the problem. However, none of these methods outperforms the others for all…

This paper addresses the problem of ranking pre-trained models for object detection and image classification. Selecting the best pre-trained model by fine-tuning is an expensive and time-consuming task. Previous works have proposed…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Mohsen Gholami , Mohammad Akbari , Xinglu Wang , Behnam Kamranian , Yong Zhang

In practice, it is very demanding and sometimes impossible to collect datasets of tagged data large enough to successfully train a machine learning model, and one possible solution to this problem is transfer learning. This study aims to…

Machine Learning · Computer Science 2022-01-13 Erik Otović , Marko Njirjak , Dario Jozinović , Goran Mauša , Alberto Michelini , Ivan Štajduhar

In continual learning, understanding the properties of task sequences and their relationships to model performance is important for developing advanced algorithms with better accuracy. However, efforts in this direction remain…

Machine Learning · Computer Science 2025-02-11 Thinh Nguyen , Cuong N. Nguyen , Quang Pham , Binh T. Nguyen , Savitha Ramasamy , Xiaoli Li , Cuong V. Nguyen

We work on translation from rich-resource languages to low-resource languages. The main challenges we identify are the lack of low-resource language data, effective methods for cross-lingual transfer, and the variable-binding problem that…

Computation and Language · Computer Science 2021-05-20 Zhong Zhou , Matthias Sperber , Alex Waibel

It is well recognized that the project productivity is a key driver in estimating software project effort from Use Case Point size metric at early software development stages. Although, there are few proposed models for predicting…

Machine Learning · Computer Science 2018-12-18 Mohammad Azzeh , Ali Bou Nassif , Shadi Banitaan , Cuauhtemoc Lopez-Martin

The open-source model ecosystem now contains hundreds of thousands of pretrained models, yet picking the best model for a new dataset is increasingly infeasible: new models and unbenchmarked datasets emerge continuously, leaving…

Machine Learning · Computer Science 2026-05-11 Rui Cai , Weijie Jacky Mo , Xiaofei Wen , Qiyao Ma , Wenhui Zhu , Xiwen Chen , Muhao Chen , Zhe Zhao

Transfer learning refers to the transfer of knowledge or information from a relevant source task to a target task. However, most existing works assume both tasks are sampled from a stationary task distribution, thereby leading to the…

Machine Learning · Computer Science 2022-07-06 Jun Wu , Jingrui He

The capability of accurately determining code similarity is crucial in many tasks related to software development. For example, it might be essential to identify code duplicates for performing software maintenance. This research introduces…

Software Engineering · Computer Science 2025-04-25 Jorge Martinez-Gil

We develop a novel transfer learning framework to tackle the challenge of limited training data in image reconstruction problems. The proposed framework consists of two training steps, both of which are formed as bi-level optimizations. In…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yunmei Chen , Chi Ding , Xiaojing Ye