English
Related papers

Related papers: Transferring Knowledge Fragments for Learning Dist…

200 papers

This paper presents a deep relational metric learning (DRML) framework for image clustering and retrieval. Most existing deep metric learning methods learn an embedding space with a general objective of increasing interclass distances and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Wenzhao Zheng , Borui Zhang , Jiwen Lu , Jie Zhou

In this study, we focus on heterogeneous knowledge transfer across entirely different model architectures, tasks, and modalities. Existing knowledge transfer methods (e.g., backbone sharing, knowledge distillation) often hinge on shared…

Machine Learning · Computer Science 2024-12-30 Kunxi Li , Tianyu Zhan , Kairui Fu , Shengyu Zhang , Kun Kuang , Jiwei Li , Zhou Zhao , Fan Wu , Fei Wu

Cross-domain recommendation (CDR) methods are proposed to tackle the sparsity problem in click through rate (CTR) estimation. Existing CDR methods directly transfer knowledge from the source domains to the target domain and ignore the…

Machine Learning · Computer Science 2024-11-15 Ke Xu , Ziliang Wang , Wei Zheng , Yuhao Ma , Chenglin Wang , Nengxue Jiang , Cai Cao

Memory-based self-evolution has emerged as a promising paradigm for coding agents. However, existing approaches typically restrict memory utilization to homogeneous task domains, failing to leverage the shared infrastructural foundations,…

Artificial Intelligence · Computer Science 2026-04-16 Kangsan Kim , Minki Kang , Taeil Kim , Yanlai Yang , Mengye Ren , Sung Ju Hwang

Transfer learning is widely used for training deep neural networks (DNN) for building a powerful representation. Even after the pre-trained model is adapted for the target task, the representation performance of the feature extractor is…

Machine Learning · Computer Science 2023-08-22 Seunghee Koh , Hyounguk Shon , Janghyeon Lee , Hyeong Gwon Hong , Junmo Kim

Human activity recognition aims to recognize the activities of daily living by utilizing the sensors on different body parts. However, when the labeled data from a certain body position (i.e. target domain) is missing, how to leverage the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-15 Yiqiang Chen , Jindong Wang , Meiyu Huang , Han Yu

Unsupervised domain adaptation person re-identification (Re-ID) aims to identify pedestrian images within an unlabeled target domain with an auxiliary labeled source-domain dataset. Many existing works attempt to recover reliable identity…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Qiong Wu , Jiahan Li , Pingyang Dai , Qixiang Ye , Liujuan Cao , Yongjian Wu , Rongrong Ji

Transfer learning (TL) utilizes data or knowledge from one or more source domains to facilitate the learning in a target domain. It is particularly useful when the target domain has very few or no labeled data, due to annotation expense,…

Machine Learning · Computer Science 2022-12-13 Wen Zhang , Lingfei Deng , Lei Zhang , Dongrui Wu

Meta learning is a promising solution to few-shot learning problems. However, existing meta learning methods are restricted to the scenarios where training and application tasks share the same out-put structure. To obtain a meta model…

Machine Learning · Computer Science 2019-04-22 Yingtian Zou , Jiashi Feng

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Qianru Sun , Yaoyao Liu , Tat-Seng Chua , Bernt Schiele

Transfer learning has become an essential paradigm in artificial intelligence, enabling the transfer of knowledge from a source task to improve performance on a target task. This approach, particularly through techniques such as pretraining…

Transferring knowledge across domains is one of the most fundamental problems in machine learning, but doing so effectively in the context of reinforcement learning remains largely an open problem. Current methods make strong assumptions on…

Machine Learning · Computer Science 2022-11-29 Abhi Gupta , Ted Moskovitz , David Alvarez-Melis , Aldo Pacchiano

Distance Metric Learning (DML) seeks to learn a discriminative embedding where similar examples are closer, and dissimilar examples are apart. In this paper, we address the problem of Semi-Supervised DML (SSDML) that tries to learn a metric…

Machine Learning · Computer Science 2021-05-12 Ujjal Kr Dutta , Mehrtash Harandi , Chellu Chandra Sekhar

We propose a transfer deep learning (TDL) framework that can transfer the knowledge obtained from a single-modal neural network to a network with a different modality. Specifically, we show that we can leverage speech data to fine-tune the…

Neural and Evolutionary Computing · Computer Science 2016-02-19 Seungwhan Moon , Suyoun Kim , Haohan Wang

We propose a novel adaptive transfer learning framework, learning to transfer learn (L2TL), to improve performance on a target dataset by careful extraction of the related information from a source dataset. Our framework considers…

Machine Learning · Computer Science 2020-07-17 Linchao Zhu , Sercan O. Arik , Yi Yang , Tomas Pfister

Transfer learning on tabular data is challenging due to disparate feature spaces across domains, in contrast to the homogeneous structures of image and text. Large language models (LLMs) offer a knowledge base to improve the limited…

Machine Learning · Computer Science 2026-01-26 Ibna Kowsar , Kazi F. Akhter , Manar D. Samad

Transfer learning, also referred as knowledge transfer, aims at reusing knowledge from a source dataset to a similar target one. While many empirical studies illustrate the benefits of transfer learning, few theoretical results are…

Statistics Theory · Mathematics 2021-02-19 David Obst , Badih Ghattas , Jairo Cugliari , Georges Oppenheim , Sandra Claudel , Yannig Goude

In activity recognition, it is often expensive and time-consuming to acquire sufficient activity labels. To solve this problem, transfer learning leverages the labeled samples from the source domain to annotate the target domain which has…

Computer Vision and Pattern Recognition · Computer Science 2018-01-04 Jindong Wang , Yiqiang Chen , Lisha Hu , Xiaohui Peng , Philip S. Yu

Distance metric learning (DML) has been successfully applied to object classification, both in the standard regime of rich training data and in the few-shot scenario, where each category is represented by only a few examples. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Leonid Karlinsky , Joseph Shtok , Sivan Harary , Eli Schwartz , Amit Aides , Rogerio Feris , Raja Giryes , Alex M. Bronstein

Deep metric learning (DML) involves training a network to learn a semantically meaningful representation space. Many current approaches mine n-tuples of examples and model interactions within each tuplets. We present a novel, compositional…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shubhang Bhatnagar , Narendra Ahuja