English
Related papers

Related papers: Transfer Learning Using Feature Selection

200 papers

In deep learning, transfer learning (TL) has become the de facto approach when dealing with image related tasks. Visual features learnt for one task have been shown to be reusable for other tasks, improving performance significantly. By…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Adrian Tormos , Dario Garcia-Gasulla , Victor Gimenez-Abalos , Sergio Alvarez-Napagao

We consider Heterogeneous Transfer Learning (HTL) from a source to a new target domain for high-dimensional regression with differing feature sets. Most homogeneous TL methods assume that target and source domains share the same feature…

Machine Learning · Statistics 2025-12-02 Jae Ho Chang , Massimiliano Russo , Subhadeep Paul

Transfer learning enhances learning across tasks, by leveraging previously learned representations -- if they are properly chosen. We describe an efficient method to accurately estimate the appropriateness of a previously trained model for…

Although achieving remarkable progress, it is very difficult to induce a supervised classifier without any labeled data. Unsupervised domain adaptation is able to overcome this challenge by transferring knowledge from a labeled source…

Machine Learning · Computer Science 2021-06-29 Yuntao Du , Ruiting Zhang , Xiaowen Zhang , Yirong Yao , Hengyang Lu , Chongjun Wang

Latent space model plays a crucial role in network analysis, and accurate estimation of latent variables is essential for downstream tasks such as link prediction. However, the large number of parameters to be estimated presents a…

Methodology · Statistics 2025-09-22 Kuangnan Fang , Ruixuan Qin , Xinyan Fan

Although CNNs have gained the ability to transfer learned knowledge from source task to target task by virtue of large annotated datasets but consume huge processing time to fine-tune without GPU. In this paper, we propose a new…

Computer Vision and Pattern Recognition · Computer Science 2019-03-28 Tasfia Shermin , Manzur Murshed , Guojun Lu , Shyh Wei Teng

Information from related source studies can often enhance the findings of a target study. However, the distribution shift between target and source studies can severely impact the efficiency of knowledge transfer. In the high-dimensional…

Methodology · Statistics 2025-11-26 Ruiqi Bai , Yijiao Zhang , Hanbo Yang , Zhongyi Zhu

In this study, we develop a method for multi-task manifold learning. The method aims to improve the performance of manifold learning for multiple tasks, particularly when each task has a small number of samples. Furthermore, the method also…

Machine Learning · Computer Science 2021-11-25 Hideaki Ishibashi , Kazushi Higa , Tetsuo Furukawa

Transfer reinforcement learning (RL) methods leverage on the experience collected on a set of source tasks to speed-up RL algorithms. A simple and effective approach is to transfer samples from source tasks and include them into the…

Artificial Intelligence · Computer Science 2011-09-02 Alessandro Lazaric , Marcello Restelli

Integrating knowledge across different domains is an essential feature of human learning. Learning paradigms such as transfer learning, meta-learning, and multi-task learning reflect the human learning process by exploiting the prior…

Machine Learning · Computer Science 2024-10-17 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

We develop here a novel transfer learning methodology called Profiled Transfer Learning (PTL). The method is based on the \textit{approximate-linear} assumption between the source and target parameters. Compared with the commonly assumed…

Statistics Theory · Mathematics 2024-06-06 Ziqian Lin , Junlong Zhao , Fang Wang , Hansheng Wang

This paper addresses the problem of transferring useful knowledge from a source network to predict node labels in a newly formed target network. While existing transfer learning research has primarily focused on vector-based data, in which…

Machine Learning · Computer Science 2016-11-15 Meng Fang , Jie Yin , Xingquan Zhu

The application of transfer learning, leveraging knowledge from source domains to enhance model performance in a target domain, has significantly grown, supporting diverse real-world applications. Its success often relies on shared…

Machine Learning · Computer Science 2024-07-19 Runxue Bao , Yiming Sun , Yuhe Gao , Jindong Wang , Qiang Yang , Zhi-Hong Mao , Ye Ye

Despite the large volume of face recognition datasets, there is a significant portion of subjects, of which the samples are insufficient and thus under-represented. Ignoring such significant portion results in insufficient training data.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Xi Yin , Xiang Yu , Kihyuk Sohn , Xiaoming Liu , Manmohan Chandraker

Federated learning has attracted growing interest as it preserves the clients' privacy. As a variant of federated learning, federated transfer learning utilizes the knowledge from similar tasks and thus has also been intensively studied.…

Machine Learning · Computer Science 2022-09-13 Feng Wang , M. Cenk Gursoy , Senem Velipasalar

Ultrahigh lattice thermal conductivity materials hold great importance since they play a critical role in the thermal management of electronic and optical devices. Models using machine learning can search for materials with outstanding…

Materials Science · Physics 2021-05-19 Shenghong Ju , Ryo Yoshida , Chang Liu , Kenta Hongo , Terumasa Tadano , Junichiro Shiomi

Recent advances in NLP demonstrate the effectiveness of training large-scale language models and transferring them to downstream tasks. Can fine-tuning these models on tasks other than language modeling further improve performance? In this…

Computation and Language · Computer Science 2020-10-08 Tu Vu , Tong Wang , Tsendsuren Munkhdalai , Alessandro Sordoni , Adam Trischler , Andrew Mattarella-Micke , Subhransu Maji , Mohit Iyyer

In a Massive Open Online Course (MOOC), predictive models of student behavior can support multiple aspects of learning, including instructor feedback and timely intervention. Ongoing courses, when the student outcomes are yet unknown, must…

Machine Learning · Computer Science 2018-12-19 Mucong Ding , Yanbang Wang , Erik Hemberg , Una-May O'Reilly

Transfer learning has become a central paradigm in modern machine learning, yet it suffers from the long-standing problem of negative transfer, where leveraging source representations can harm rather than help performance on the target…

Machine Learning · Computer Science 2026-04-28 Yichen Xu , Ryumei Nakada , Linjun Zhang , Lexin Li

Task transfer learning is a popular technique in image processing applications that uses pre-trained models to reduce the supervision cost of related tasks. An important question is to determine task transferability, i.e. given a common…

Machine Learning · Computer Science 2022-12-21 Yajie Bao , Yang Li , Shao-Lun Huang , Lin Zhang , Lizhong Zheng , Amir Zamir , Leonidas Guibas