English
Related papers

Related papers: Transfer Learning for Degree-Corrected Mixed Membe…

200 papers

Transfer learning has been widely studied and gained increasing popularity to improve the accuracy of machine learning models by transferring some knowledge acquired in different training. However, no prior work has pointed out that…

Cryptography and Security · Computer Science 2023-07-19 Seira Hidano , Takao Murakami , Yusuke Kawamoto

Negative transfer in training of acoustic models for automatic speech recognition has been reported in several contexts such as domain change or speaker characteristics. This paper proposes a novel technique to overcome negative transfer by…

Machine Learning · Computer Science 2015-09-18 Mortaza Doulaty , Oscar Saz , Thomas Hain

Transfer learning aims to improve inference in a target domain by leveraging information from related source domains, but its effectiveness critically depends on how cross-domain heterogeneity is modeled and controlled. When the conditional…

Statistics Theory · Mathematics 2026-02-23 Hanxiao Chen , Debarghya Mukherjee

Transfer learning involves taking information and insight from one problem domain and applying it to a new problem domain. Although widely used in practice, theory for transfer learning remains less well-developed. To address this, we prove…

Machine Learning · Statistics 2020-06-24 Jake Williams , Abel Tadesse , Tyler Sam , Huey Sun , George D. Montanez

Transfer learning from huge natural image datasets, fine-tuning of deep neural networks and the use of the corresponding pre-trained networks have become de facto the core of art analysis applications. Nevertheless, the effects of transfer…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Nicolas Gonthier , Yann Gousseau , Saïd Ladjal

Cross-domain recommendation (CDR) methods are proposed to tackle the sparsity problem in click through rate (CTR) estimation. Existing CDR methods directly transfer knowledge from the source domains to the target domain and ignore the…

Machine Learning · Computer Science 2024-11-15 Ke Xu , Ziliang Wang , Wei Zheng , Yuhao Ma , Chenglin Wang , Nengxue Jiang , Cai Cao

Knowledge distillation is a popular machine learning technique that aims to transfer knowledge from a large 'teacher' network to a smaller 'student' network and improve the student's performance by training it to emulate the teacher. In…

Machine Learning · Computer Science 2022-10-19 Sushil Thapa

We study transfer learning for estimation in latent variable network models. In our setting, the conditional edge probability matrices given the latent variables are represented by $P$ for the source and $Q$ for the target. We wish to…

Machine Learning · Computer Science 2024-06-07 Akhil Jalan , Arya Mazumdar , Soumendu Sundar Mukherjee , Purnamrita Sarkar

Transfer learning, which allows a source task to affect the inductive bias of the target task, is widely used in computer vision. The typical way of conducting transfer learning with deep neural networks is to fine-tune a model pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Yunhui Guo , Honghui Shi , Abhishek Kumar , Kristen Grauman , Tajana Rosing , Rogerio Feris

Recommender systems based on collaborative filtering play a vital role in many E-commerce applications as they guide the user in finding their items of interest based on the user's past transactions and feedback of other similar customers.…

Information Retrieval · Computer Science 2022-03-29 Sowmini Devi Veeramachaneni , Arun K Pujari , Vineet Padmanabhan , Vikas Kumar

Transfer learning is a powerful tool enabling model training with limited amounts of data. This technique is particularly useful in real-world problems where data availability is often a serious limitation. The simplest transfer learning…

Machine Learning · Computer Science 2023-03-03 Federica Gerace , Diego Doimo , Stefano Sarao Mannelli , Luca Saglietti , Alessandro Laio

Discrete diffusion models (DMs) have achieved strong performance in language and other discrete domains, offering a compelling alternative to autoregressive modeling. Yet this performance typically depends on large training datasets,…

Machine Learning · Computer Science 2026-04-16 Julian Kleutgens , Claudio Battiloro , Lingkai Kong , Benjamin Grewe , Francesca Dominici , Mauricio Tec

Due to their high degree of expressiveness, neural networks have recently been used as surrogate models for mapping inputs of an engineering system to outputs of interest. Once trained, neural networks are computationally inexpensive to…

Machine Learning · Statistics 2020-02-12 Subhayan De , Jolene Britton , Matthew Reynolds , Ryan Skinner , Kenneth Jansen , Alireza Doostan

Supervised transfer learning has received considerable attention due to its potential to boost the predictive power of machine learning in scenarios where data are scarce. Generally, a given set of source models and a dataset from a target…

Machine Learning · Statistics 2024-01-23 Shunya Minami , Kenji Fukumizu , Yoshihiro Hayashi , Ryo Yoshida

Transfer learning leverages pre-trained model features from a large dataset to save time and resources when training new models for various tasks, potentially enhancing performance. Due to the lack of large datasets in the medical imaging…

Image and Video Processing · Electrical Eng. & Systems 2023-11-10 Gabriel Efrain Humpire-Mamani , Colin Jacobs , Mathias Prokop , Bram van Ginneken , Nikolas Lessmann

Deep text matching approaches have been widely studied for many applications including question answering and information retrieval systems. To deal with a domain that has insufficient labeled data, these approaches can be used in a…

Information Retrieval · Computer Science 2019-01-01 Chen Qu , Feng Ji , Minghui Qiu , Liu Yang , Zhiyu Min , Haiqing Chen , Jun Huang , W. Bruce Croft

Transfer learning is a vital technique that generalizes models trained for one setting or task to other settings or tasks. For example in speech recognition, an acoustic model trained for one language can be used to recognize speech in…

Computation and Language · Computer Science 2015-11-20 Dong Wang , Thomas Fang Zheng

Domain adaptation aims at training a classifier in one dataset and applying it to a related but not identical dataset. One successfully used framework of domain adaptation is to learn a transformation to match both the distribution of the…

Computer Vision and Pattern Recognition · Computer Science 2015-03-03 Xu Zhang , Felix Xinnan Yu , Shih-Fu Chang , Shengjin Wang

We introduce techniques for rapidly transferring the information stored in one neural net into another neural net. The main purpose is to accelerate the training of a significantly larger neural net. During real-world workflows, one often…

Machine Learning · Computer Science 2016-04-26 Tianqi Chen , Ian Goodfellow , Jonathon Shlens

Transfer learning has emerged as a highly sought-after and actively pursued research area within the statistical community. The core concept of transfer learning involves leveraging insights and information from auxiliary datasets to…

Methodology · Statistics 2024-08-01 Pengfei Li , Tao Yu , Chixiang Chen , Jing Qin