English
Related papers

Related papers: GenTL: A General Transfer Learning Model for Build…

200 papers

In many practical transfer learning scenarios, the feature distribution is different across the source and target domains (i.e. non-i.i.d.). Maximum mean discrepancy (MMD), as a domain discrepancy metric, has achieved promising performance…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Lei Zhang , Shanshan Wang , Guang-Bin Huang , Wangmeng Zuo , Jian Yang , David Zhang

Multi-Task Learning (MTL) networks have emerged as a promising method for transferring learned knowledge across different tasks. However, MTL must deal with challenges such as: overfitting to low resource tasks, catastrophic forgetting, and…

Machine Learning · Computer Science 2022-04-22 Jonathan Pilault , Amine Elhattami , Christopher Pal

This work aims at unveiling the potential of Transfer Learning (TL) for developing a traffic flow forecasting model in scenarios of absent data. Knowledge transfer from high-quality predictive models becomes feasible under the TL paradigm,…

Machine Learning · Computer Science 2020-05-12 Eric L. Manibardo , Ibai Laña , Javier Del Ser

Human activity recognition aims to recognize the activities of daily living by utilizing the sensors on different body parts. However, when the labeled data from a certain body position (i.e. target domain) is missing, how to leverage the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-15 Yiqiang Chen , Jindong Wang , Meiyu Huang , Han Yu

Deep neural networks can yield good performance on various tasks but often require large amounts of data to train them. Meta-learning received considerable attention as one approach to improve the generalization of these networks from a…

Machine Learning · Computer Science 2023-10-11 Mike Huisman , Aske Plaat , Jan N. van Rijn

The task of building footprint segmentation has been well-studied in the context of remote sensing (RS) as it provides valuable information in many aspects, however, difficulties brought by the nature of RS images such as variations in the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Burak Ekim , Elif Sertel

Transfer learning is a machine learning technique that uses previously acquired knowledge from a source domain to enhance learning in a target domain by reusing learned weights. This technique is ubiquitous because of its great advantages…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Nermeen Abou Baker , Nico Zengeler , Uwe Handmann

This paper presents Adaptive Meta-Domain Transfer Learning (AMDTL), a novel methodology that combines principles of meta-learning with domain-specific adaptations to enhance the transferability of artificial intelligence models across…

Machine Learning · Computer Science 2024-09-12 Michele Laurelli

Vision-and-language pre-training (VLP) models have experienced a surge in popularity recently. By fine-tuning them on specific datasets, significant performance improvements have been observed in various tasks. However, full fine-tuning of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yuan Yuan , Yang Zhan , Zhitong Xiong

Heterogeneous Federated Learning (HtFL) enables task-specific knowledge sharing among clients with different model architectures while preserving privacy. Despite recent research progress, transferring knowledge in HtFL is still difficult…

Artificial Intelligence · Computer Science 2024-08-20 Jianqing Zhang , Yang Liu , Yang Hua , Jian Cao

We propose a learning problem involving adapting a pre-trained source model to the target domain for classifying all classes that appeared in the source data, using target data that covers only a partial label space. This problem is…

Machine Learning · Computer Science 2023-11-03 Cheng-Hao Tu , Hong-You Chen , Zheda Mai , Jike Zhong , Vardaan Pahuja , Tanya Berger-Wolf , Song Gao , Charles Stewart , Yu Su , Wei-Lun Chao

The rapid increase in the volume of data increased the size and complexity of the deep learning models. These models are now more resource-intensive and time-consuming for training than ever. This paper presents a quantum transfer learning…

Quantum Physics · Physics 2024-09-04 Sounak Bhowmik , Himanshu Thapliyal

In recent years, an increasing popularity of deep learning model for intelligent condition monitoring and diagnosis as well as prognostics used for mechanical systems and structures has been observed. In the previous studies, however, a…

Machine Learning · Computer Science 2019-08-14 Te Han , Chao Liu , Wenguang Yang , Dongxiang Jiang

Zero-shot learning (ZSL) is a challenging problem that aims to recognize the target categories without seen data, where semantic information is leveraged to transfer knowledge from some source classes. Although ZSL has made great progress…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Huajie Jiang , Ruiping Wang , Shiguang Shan , Xilin Chen

The availability of abundant labeled data in recent years led the researchers to introduce a methodology called transfer learning, which utilizes existing data in situations where there are difficulties in collecting new annotated data.…

Machine Learning · Computer Science 2021-04-07 Abolfazl Farahani , Behrouz Pourshojae , Khaled Rasheed , Hamid R. Arabnia

In-context learning (ICL) is an effective approach to help large language models (LLMs) adapt to various tasks by providing demonstrations of the target task. Considering the high cost of labeling demonstrations, many methods propose…

Computation and Language · Computer Science 2024-11-04 Dingzirui Wang , Xuanliang Zhang , Qiguang Chen , Longxu Dou , Xiao Xu , Rongyu Cao , Yingwei Ma , Qingfu Zhu , Wanxiang Che , Binhua Li , Fei Huang , Yongbin Li

In modern traffic management, one of the most essential yet challenging tasks is accurately and timely predicting traffic. It has been well investigated and examined that deep learning-based Spatio-temporal models have an edge when…

Machine Learning · Computer Science 2023-03-14 Yunjie Huang , Xiaozhuang Song , Yuanshao Zhu , Shiyao Zhang , James J. Q. Yu

We develop here a novel transfer learning methodology called Profiled Transfer Learning (PTL). The method is based on the \textit{approximate-linear} assumption between the source and target parameters. Compared with the commonly assumed…

Statistics Theory · Mathematics 2024-06-06 Ziqian Lin , Junlong Zhao , Fang Wang , Hansheng Wang

When the available data for a target domain is limited, transfer learning (TL) methods can be used to develop models on related data-rich domains, before deploying them on the target domain. However, these TL methods are typically designed…

Statistical Finance · Quantitative Finance 2025-08-06 Ricardo Ribeiro Pereira , Jacopo Bono , Hugo Ferreira , Pedro Ribeiro , Carlos Soares , Pedro Bizarro

Machine learning relies on the availability of a vast amount of data for training. However, in reality, most data are scattered across different organizations and cannot be easily integrated under many legal and practical constraints. In…

Machine Learning · Computer Science 2020-06-25 Yang Liu , Yan Kang , Chaoping Xing , Tianjian Chen , Qiang Yang