English
Related papers

Related papers: Distant Transfer Learning via Deep Random Walk

200 papers

Transfer learning is a widely used method to build high performing computer vision models. In this paper, we study the efficacy of transfer learning by examining how the choice of data impacts performance. We find that more pre-training…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiquan Ngiam , Daiyi Peng , Vijay Vasudevan , Simon Kornblith , Quoc V. Le , Ruoming Pang

Transfer learning enhances prediction accuracy on a target distribution by leveraging data from a source distribution, demonstrating significant benefits in various applications. This paper introduces a novel dissimilarity measure that…

Machine Learning · Statistics 2024-12-12 Mitsuhiro Fujikawa , Yohei Akimoto , Jun Sakuma , Kazuto Fukuchi

Transfer learning has emerged as a highly sought-after and actively pursued research area within the statistical community. The core concept of transfer learning involves leveraging insights and information from auxiliary datasets to…

Methodology · Statistics 2024-08-01 Pengfei Li , Tao Yu , Chixiang Chen , Jing Qin

The computer vision community is witnessing an unprecedented rate of new tasks being proposed and addressed, thanks to the deep convolutional networks' capability to find complex mappings from X to Y. The advent of each task often…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Junnan Li , Ziwei Xu , Yongkang Wong , Qi Zhao , Mohan Kankanhalli

Transfer learning is a vital technique that generalizes models trained for one setting or task to other settings or tasks. For example in speech recognition, an acoustic model trained for one language can be used to recognize speech in…

Computation and Language · Computer Science 2015-11-20 Dong Wang , Thomas Fang Zheng

Reusing pre-collected data from different domains is an appealing solution for decision-making tasks, especially when data in the target domain are limited. Existing cross-domain policy transfer methods mostly aim at learning domain…

Robotics · Computer Science 2026-03-10 Haoyi Niu , Qimao Chen , Tenglong Liu , Jianxiong Li , Guyue Zhou , Yi Zhang , Jianming Hu , Xianyuan Zhan

Transfer learning has become the de facto standard in computer vision and natural language processing, especially where labeled data is scarce. Accuracy can be significantly improved by using pre-trained models and subsequent fine-tuning.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 T. S. Jayram , Vincent Marois , Tomasz Kornuta , Vincent Albouy , Emre Sevgen , Ahmet S. Ozcan

The ability of a human being to extrapolate previously gained knowledge to other domains inspired a new family of methods in machine learning called transfer learning. Transfer learning is often based on the assumption that objects in both…

Machine Learning · Statistics 2016-10-21 Ievgen Redko , Younès Bennani

Transfer learning is a machine learning paradigm where knowledge from one problem is utilized to solve a new but related problem. While conceivable that knowledge from one task could be useful for solving a related task, if not executed…

Machine Learning · Computer Science 2021-10-01 Xuetong Wu , Jonathan H. Manton , Uwe Aickelin , Jingge Zhu

Domain adaptation aims to generalise a high-performance learner on target domain (non-labelled data) by leveraging the knowledge from source domain (rich labelled data) which comes from a different but related distribution. Assuming the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Jie Su

In recent years, new neural network architectures designed to operate on graph-structured data have pushed the state-of-the-art in the field. A large set of these architectures utilize a form of classical random walks to diffuse…

Quantum Physics · Physics 2018-06-18 Stefan Dernbach , Arman Mohseni-Kabir , Siddharth Pal , Don Towsley , Miles Gepner

The success of deep learning algorithms generally depends on large-scale data, while humans appear to have inherent ability of knowledge transfer, by recognizing and applying relevant knowledge from previous learning experiences when…

Machine Learning · Computer Science 2022-01-19 Junguang Jiang , Yang Shu , Jianmin Wang , Mingsheng Long

Transfer learning is an important approach for addressing the challenges posed by limited data availability in various applications. It accomplishes this by transferring knowledge from well-established source domains to a less familiar…

Machine Learning · Statistics 2025-03-03 Yeheng Ge , Xueyu Zhou , Jian Huang

Transfer learning research attempts to make model induction transferable across different domains. This method assumes that specific information regarding to which domain each instance belongs is known. This paper helps to extend the…

Machine Learning · Computer Science 2025-06-04 Xinshun Liu , He Xin , Mao Hui , Liu Jing , Lai Weizhong , Ye Qingwen

We investigate the application of deep learning to the retrieval of the internuclear distance in the two-dimensional H$_2^{+}$ molecule from the momentum distribution of photoelectrons produced by strong-field ionization. We study the…

Atomic Physics · Physics 2023-03-29 N. I. Shvetsov-Shilovski , M. Lein

Deep reinforcement learning (DRL) has been increasingly employed to handle the dynamic and complex resource management in network slicing. The deployment of DRL policies in real networks, however, is complicated by heterogeneous cell…

Networking and Internet Architecture · Computer Science 2023-06-26 Tianlun Hu , Qi Liao , Qiang Liu , Georg Carle

Universal Domain Adaptation (UNDA) aims to handle both domain-shift and category-shift between two datasets, where the main challenge is to transfer knowledge while rejecting unknown classes which are absent in the labeled source data but…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Kuniaki Saito , Kate Saenko

Message-passing architectures struggle to sufficiently model long-range dependencies in node and graph prediction tasks. We propose a novel approach exploiting hierarchical graph structures and adaptive random walks to address this…

Machine Learning · Computer Science 2025-09-03 Joël Mathys , Federico Errica

Recent work on deep learning for tabular data demonstrates the strong performance of deep tabular models, often bridging the gap between gradient boosted decision trees and neural networks. Accuracy aside, a major advantage of neural models…

Network-structured data becomes ubiquitous in daily life and is growing at a rapid pace. It presents great challenges to feature engineering due to the high non-linearity and sparsity of the data. The local and global structure of the…

Machine Learning · Computer Science 2025-01-31 Xin Sun , Zenghui Song , Yongbo Yu , Junyu Dong , Claudia Plant , Christian Boehm