English
Related papers

Related papers: Transferring Knowledge Fragments for Learning Dist…

200 papers

Deep reinforcement learning (RL) algorithms have achieved great success on a wide variety of sequential decision-making tasks. However, many of these algorithms suffer from high sample complexity when learning from scratch using…

Machine Learning · Statistics 2020-06-15 Michael Wan , Tanmay Gangwani , Jian Peng

Transfer learning aims to improve performance on a target task by leveraging information from related source tasks. We propose a nonparametric regression transfer learning framework that explicitly models heterogeneity in the source-target…

Statistics Theory · Mathematics 2026-03-19 Hélène Halconruy , Benjamin Bobbia , Paul Lejamtel

Learning with a limited number of labeled data is a central problem in real-world applications of machine learning, as it is often expensive to obtain annotations. To deal with the scarcity of labeled data, transfer learning is a…

Computation and Language · Computer Science 2024-08-22 Jaehyun Nam , Woomin Song , Seong Hyeon Park , Jihoon Tack , Sukmin Yun , Jaehyung Kim , Kyu Hwan Oh , Jinwoo Shin

The well known domain shift issue causes model performance to degrade when deployed to a new target domain with different statistics to training. Domain adaptation techniques alleviate this, but need some instances from the target domain to…

Machine Learning · Computer Science 2019-06-11 Yiying Li , Yongxin Yang , Wei Zhou , Timothy M. Hospedales

Meta-Learning is a subarea of Machine Learning that aims to take advantage of prior knowledge to learn faster and with fewer data [1]. There are different scenarios where meta-learning can be applied, and one of the most common is algorithm…

Machine Learning · Computer Science 2019-10-17 Gean Trindade Pereira , Moisés dos Santos , Edesio Alcobaça , Rafael Mantovani , André Carvalho

Person re-identification aims at matching pedestrians observed from non-overlapping camera views. Feature descriptor and metric learning are two significant problems in person re-identification. A discriminative metric learning method…

Computer Vision and Pattern Recognition · Computer Science 2015-11-18 Siyuan Huang , Jiwen Lu , Jie Zhou , Anil K. Jain

Deep learning has raised hopes and expectations as a general solution for many applications; indeed it has proven effective, but it also showed a strong dependence on large quantities of data. Luckily, it has been shown that, even when data…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Fabio Maria Carlucci

Transfer learning (TL) is a promising way to improve the sample efficiency of reinforcement learning. However, how to efficiently transfer knowledge across tasks with different state-action spaces is investigated at an early stage. Most…

Machine Learning · Computer Science 2021-05-11 Yu Chen , Yingfeng Chen , Zhipeng Hu , Tianpei Yang , Changjie Fan , Yang Yu , Jianye Hao

The computer vision community is witnessing an unprecedented rate of new tasks being proposed and addressed, thanks to the deep convolutional networks' capability to find complex mappings from X to Y. The advent of each task often…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Junnan Li , Ziwei Xu , Yongkang Wong , Qi Zhao , Mohan Kankanhalli

Knowledge transfer from large teacher models to smaller student models has recently been studied for metric learning, focusing on fine-grained classification. In this work, focusing on instance-level image retrieval, we study an asymmetric…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Mateusz Budnik , Yannis Avrithis

Transfer learning refers to the transfer of knowledge or information from a relevant source domain to a target domain. However, most existing transfer learning theories and algorithms focus on IID tasks, where the source/target samples are…

Machine Learning · Computer Science 2023-03-21 Jun Wu , Jingrui He , Elizabeth Ainsworth

The 3D point cloud (3DPC) has significantly evolved and benefited from the advance of deep learning (DL). However, the latter faces various issues, including the lack of data or annotated data, the existence of a significant gap between…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Shahab Saquib Sohail , Yassine Himeur , Hamza Kheddar , Abbes Amira , Fodil Fadli , Shadi Atalla , Abigail Copiaco , Wathiq Mansoor

Information from related source studies can often enhance the findings of a target study. However, the distribution shift between target and source studies can severely impact the efficiency of knowledge transfer. In the high-dimensional…

Methodology · Statistics 2025-11-26 Ruiqi Bai , Yijiao Zhang , Hanbo Yang , Zhongyi Zhu

Metric and kernel learning are important in several machine learning applications. However, most existing metric learning algorithms are limited to learning metrics over low-dimensional data, while existing kernel learning algorithms are…

Machine Learning · Computer Science 2009-11-02 Prateek Jain , Brian Kulis , Jason V. Davis , Inderjit S. Dhillon

Theoretical works on supervised transfer learning (STL) -- where the learner has access to labeled samples from both source and target distributions -- have for the most part focused on statistical aspects of the problem, while efficient…

Machine Learning · Statistics 2025-07-08 Yuyang Deng , Samory Kpotufe

Transfer learning can address the learning tasks of unlabeled data in the target domain by leveraging plenty of labeled data from a different but related source domain. A core issue in transfer learning is to learn a shared feature space in…

Machine Learning · Computer Science 2019-01-10 Peng Xu , Zhaohong Deng , Jun Wang , Qun Zhang , Shitong Wang

Deep learning has become the leading approach to assisted target recognition. While these methods typically require large amounts of labeled training data, domain adaptation (DA) or transfer learning (TL) enables these algorithms to…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Deborah Weeks , Samuel Rivera

While many deep learning methods have seen significant success in tackling the problem of domain adaptation and few-shot learning separately, far fewer methods are able to jointly tackle both problems in Cross-Domain Few-Shot Learning…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 John Cai , Bill Cai , Sheng Mei Shen

Modern statistical analysis often encounters high dimensional models but with limited sample sizes. This makes the target data based statistical estimation very difficult. Then how to borrow information from another large sized source data…

Methodology · Statistics 2023-04-13 Ziqian Lin , Yuan Gao , Feifei Wang , Hansheng Wang

In the recommendation systems, there are multiple business domains to meet the diverse interests and needs of users, and the click-through rate(CTR) of each domain can be quite different, which leads to the demand for CTR prediction…

Information Retrieval · Computer Science 2023-06-30 Wei Zhang , Pengye Zhang , Bo Zhang , Xingxing Wang , Dong Wang