English
Related papers

Related papers: OTCE: A Transferability Metric for Cross-Domain Cr…

200 papers

Large-scale pre-training followed by downstream fine-tuning is an effective solution for transferring deep-learning-based models. Since finetuning all possible pre-trained models is computational costly, we aim to predict the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Zhao Wang , Aoxue Li , Zhenguo Li , Qi Dou

Cross-domain recommendation (CDR) methods are proposed to tackle the sparsity problem in click through rate (CTR) estimation. Existing CDR methods directly transfer knowledge from the source domains to the target domain and ignore the…

Machine Learning · Computer Science 2024-11-15 Ke Xu , Ziliang Wang , Wei Zheng , Yuhao Ma , Chenglin Wang , Nengxue Jiang , Cai Cao

In low-resource settings, model transfer can help to overcome a lack of labeled data for many tasks and domains. However, predicting useful transfer sources is a challenging problem, as even the most similar sources might lead to unexpected…

Computation and Language · Computer Science 2021-11-01 Lukas Lange , Jannik Strötgen , Heike Adel , Dietrich Klakow

We study a fundamental transfer learning process from source to target linear regression tasks, including overparameterized settings where there are more learned parameters than data samples. The target task learning is addressed by using…

Machine Learning · Computer Science 2024-06-03 Yehuda Dar , Daniel LeJeune , Richard G. Baraniuk

Reliable perception during fast motion maneuvers or in high dynamic range environments is crucial for robotic systems. Since event cameras are robust to these challenging conditions, they have great potential to increase the reliability of…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Nico Messikommer , Daniel Gehrig , Mathias Gehrig , Davide Scaramuzza

Deep learning models tend to underperform in the presence of domain shifts. Domain transfer has recently emerged as a promising approach wherein images exhibiting a domain shift are transformed into other domains for augmentation or…

Image and Video Processing · Electrical Eng. & Systems 2022-10-27 Weinan Song , Gaurav Fotedar , Nima Tajbakhsh , Ziheng Zhou , Lei He , Xiaowei Ding

The Self-Optimal-Transport (SOT) feature transform is designed to upgrade the set of features of a data instance to facilitate downstream matching or grouping related tasks. The transformed set encodes a rich representation of high order…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Daniel Shalam , Simon Korman

Domain similarity measures can be used to gauge adaptability and select suitable data for transfer learning, but existing approaches define ad hoc measures that are deemed suitable for respective tasks. Inspired by work on curriculum…

Computation and Language · Computer Science 2017-07-18 Sebastian Ruder , Barbara Plank

This work considers the problem of transferring causal knowledge between tasks for Individual Treatment Effect (ITE) estimation. To this end, we theoretically assess the feasibility of transferring ITE knowledge and present a practical…

Machine Learning · Computer Science 2023-06-07 Ahmed Aloui , Juncheng Dong , Cat P. Le , Vahid Tarokh

In networks of independent entities that face similar predictive tasks, transfer machine learning enables to re-use and improve neural nets using distributed data sets without the exposure of raw data. As the number of data sets in business…

Machine Learning · Computer Science 2020-03-31 Robin Hirt , Akash Srivastava , Carlos Berg , Niklas Kühl

The problem of learning one task using samples from another task is central to transfer learning. In this paper, we focus on answering the following question: when does combining the samples from two related tasks perform better than…

Machine Learning · Statistics 2025-06-11 Fan Yang , Hongyang R. Zhang , Sen Wu , Christopher Ré , Weijie J. Su

Recent advances in NLP demonstrate the effectiveness of training large-scale language models and transferring them to downstream tasks. Can fine-tuning these models on tasks other than language modeling further improve performance? In this…

Computation and Language · Computer Science 2020-10-08 Tu Vu , Tong Wang , Tsendsuren Munkhdalai , Alessandro Sordoni , Adam Trischler , Andrew Mattarella-Micke , Subhransu Maji , Mohit Iyyer

We present three related ways of using Transfer Learning to improve feature selection. The three methods address different problems, and hence share different kinds of information between tasks or feature classes, but all three are based on…

Machine Learning · Computer Science 2009-05-26 Paramveer S. Dhillon , Dean Foster , Lyle Ungar

Collaborative filtering (CF) aims to predict users' ratings on items according to historical user-item preference data. In many real-world applications, preference data are usually sparse, which would make models overfit and fail to give…

Machine Learning · Computer Science 2012-10-29 Zhongqi Lu , Erheng Zhong , Lili Zhao , Wei Xiang , Weike Pan , Qiang Yang

The medical image processing field often encounters the critical issue of scarce annotated data. Transfer learning has emerged as a solution, yet how to select an adequate source task and effectively transfer the knowledge to the target…

Image and Video Processing · Electrical Eng. & Systems 2024-10-10 Jingyun Yang , Jingge Wang , Guoqing Zhang , Yang Li

In today's digital world, we are faced with an explosion of data and models produced and manipulated by numerous large-scale cloud-based applications. Under such settings, existing transfer evolutionary optimization frameworks grapple with…

Neural and Evolutionary Computing · Computer Science 2022-05-13 Mojtaba Shakeri , Erfan Miahi , Abhishek Gupta , Yew-Soon Ong

Lack of sufficient labeled data often limits the applicability of advanced machine learning algorithms to real life problems. However efficient use of Transfer Learning (TL) has been shown to be very useful across domains. TL utilizes…

Computation and Language · Computer Science 2017-08-15 Sunil Kumar Sahu , Ashish Anand

Transfer learning is an essential technique for many machine learning/AI models of complex structures such as large language models and generative AI. The essence of transfer learning is to leverage knowledge from resolved source tasks for…

Machine Learning · Statistics 2026-05-21 Haoyang Cao , Xin Guo , Wenpin Tang , Guan Wang

In the robotics literature, experience transfer has been proposed in different learning-based control frameworks to minimize the costs and risks associated with training robots. While various works have shown the feasibility of transferring…

Robotics · Computer Science 2020-06-30 Michael J. Sorocky , Siqi Zhou , Angela P. Schoellig

Although many studies have successfully applied transfer learning to medical image segmentation, very few of them have investigated the selection strategy when multiple source tasks are available for transfer. In this paper, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2023-01-04 Yicong Li , Yang Tan , Jingyun Yang , Yang Li , Xiao-Ping Zhang