English
Related papers

Related papers: Transfer Learning with Large-Scale Quantile Regres…

200 papers

Although transfer learning has been shown to be successful for tasks like object and speech recognition, its applicability to question answering (QA) has yet to be well-studied. In this paper, we conduct extensive experiments to investigate…

Computation and Language · Computer Science 2018-04-24 Yu-An Chung , Hung-Yi Lee , James Glass

In low-resource settings, model transfer can help to overcome a lack of labeled data for many tasks and domains. However, predicting useful transfer sources is a challenging problem, as even the most similar sources might lead to unexpected…

Computation and Language · Computer Science 2021-11-01 Lukas Lange , Jannik Strötgen , Heike Adel , Dietrich Klakow

Transfer learning is a valuable tool in deep learning as it allows propagating information from one "source dataset" to another "target dataset", especially in the case of a small number of training examples in the latter. Yet,…

Machine Learning · Computer Science 2023-06-13 Daniel Jakubovitz , David Uliel , Miguel Rodrigues , Raja Giryes

Data scarcity is a tremendous challenge in causal effect estimation. In this paper, we propose to exploit additional data sources to facilitate estimating causal effects in the target population. Specifically, we leverage additional source…

Machine Learning · Computer Science 2021-06-01 Thanh Vinh Vo , Pengfei Wei , Trong Nghia Hoang , Tze-Yun Leong

Transfer learning is a widely used method to build high performing computer vision models. In this paper, we study the efficacy of transfer learning by examining how the choice of data impacts performance. We find that more pre-training…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiquan Ngiam , Daiyi Peng , Vijay Vasudevan , Simon Kornblith , Quoc V. Le , Ruoming Pang

Quantile regression has been successfully used to study heterogeneous and heavy-tailed data. Varying-coefficient models are frequently used to capture changes in the effect of input variables on the response as a function of an index or…

Methodology · Statistics 2021-10-18 Ran Dai , Mladen Kolar

We consider Heterogeneous Transfer Learning (HTL) from a source to a new target domain for high-dimensional regression with differing feature sets. Most homogeneous TL methods assume that target and source domains share the same feature…

Machine Learning · Statistics 2025-12-02 Jae Ho Chang , Massimiliano Russo , Subhadeep Paul

High-dimensional data in modern applications, such as COVID-19 mortality, often span multiple domains. Leveraging auxiliary information from source domains to improve performance in a target domain motivates the use of transfer learning.…

Methodology · Statistics 2026-04-09 Haoming Shi , Yang Feng , Xiaoqian Liu

Transfer learning uses a data model, trained to make predictions or inferences on data from one population, to make reliable predictions or inferences on data from another population. Most existing transfer learning approaches are based on…

Methodology · Statistics 2022-12-01 Jimmy Hickey , Jonathan P. Williams , Emily C. Hector

This paper addresses challenges in robust transfer learning stemming from ambiguity in Bayes classifiers and weak transferable signals between the target and source distribution. We introduce a novel quantity called the ''ambiguity level''…

Machine Learning · Statistics 2025-05-06 Jianqing Fan , Cheng Gao , Jason M. Klusowski

We consider transferability estimation, the problem of estimating how well deep learning models transfer from a source to a target task. We focus on regression tasks, which received little previous attention, and propose two simple and…

Machine Learning · Computer Science 2023-12-05 Cuong N. Nguyen , Phong Tran , Lam Si Tung Ho , Vu Dinh , Anh T. Tran , Tal Hassner , Cuong V. Nguyen

Quantum Transfer Learning (QTL) recently gained popularity as a hybrid quantum-classical approach for image classification tasks by efficiently combining the feature extraction capabilities of large Convolutional Neural Networks with the…

Modern NLP applications have enjoyed a great boost utilizing neural networks models. Such deep neural models, however, are not applicable to most human languages due to the lack of annotated training data for various NLP tasks.…

Computation and Language · Computer Science 2019-06-06 Xilun Chen , Ahmed Hassan Awadallah , Hany Hassan , Wei Wang , Claire Cardie

Quantile regression is a powerful tool for inferring how covariates affect specific percentiles of the response distribution. Existing methods either estimate conditional quantiles separately for each quantile of interest or estimate the…

Methodology · Statistics 2024-11-19 Joseph Feldman , Daniel Kowal

Quantum machine learning (QML) has emerged as a promising area of research for enhancing the performance of classical machine learning systems by leveraging quantum computational principles. However, practical deployment of QML remains…

Quantum Physics · Physics 2025-10-21 Amena Khatun , Muhammad Usman

In dynamic decision-making scenarios across business and healthcare, leveraging sample trajectories from diverse populations can significantly enhance reinforcement learning (RL) performance for specific target populations, especially when…

Machine Learning · Statistics 2025-04-15 Jinhang Chai , Elynn Chen , Jianqing Fan

As transfer learning techniques are increasingly used to transfer knowledge from the source model to the target task, it becomes important to quantify which source models are suitable for a given target task without performing…

The shapes of functions provide highly interpretable summaries of their trajectories. This article develops a novel transfer learning methodology to tackle the challenge of data scarcity in functional linear models. The methodology…

Methodology · Statistics 2025-10-16 Shuhao Jiao , Ian W. Mckeague

Transfer learning research attempts to make model induction transferable across different domains. This method assumes that specific information regarding to which domain each instance belongs is known. This paper helps to extend the…

Machine Learning · Computer Science 2025-06-04 Xinshun Liu , He Xin , Mao Hui , Liu Jing , Lai Weizhong , Ye Qingwen

The application of transfer learning, leveraging knowledge from source domains to enhance model performance in a target domain, has significantly grown, supporting diverse real-world applications. Its success often relies on shared…

Machine Learning · Computer Science 2024-07-19 Runxue Bao , Yiming Sun , Yuhe Gao , Jindong Wang , Qiang Yang , Zhi-Hong Mao , Ye Ye