English
Related papers

Related papers: Adaptive transfer learning

200 papers

Randomized clinical trials are the gold standard for analyzing treatment effects, but high costs and ethical concerns can limit recruitment, potentially leading to invalid inferences. Incorporating external trial data with similar…

Methodology · Statistics 2024-09-09 Yujia Gu , Hanzhong Liu , Wei Ma

In this work, we address the question of the adaptability of artificial neural networks (NNs) used for impairments mitigation in optical transmission systems. We demonstrate that by using well-developed techniques based on the concept of…

Signal Processing · Electrical Eng. & Systems 2022-01-05 Pedro J. Freire , Daniel Abode , Jaroslaw E. Prilepsky , Nelson Costa , Bernhard Spinnler , Antonio Napoli , Sergei K. Turitsyn

Transfer learning assumes classifiers of similar tasks share certain parameter structures. Unfortunately, modern classifiers uses sophisticated feature representations with huge parameter spaces which lead to costly transfer. Under the…

Machine Learning · Statistics 2015-10-20 Song Liu , Kenji Fukumizu

We consider a transfer-learning problem by using the parameter transfer approach, where a suitable parameter of feature mapping is learned through one task and applied to another objective task. Then, we introduce the notion of the local…

Machine Learning · Statistics 2017-01-19 Wataru Kumagai

Many machine learning models appear to deploy effortlessly under distribution shift, and perform well on a target distribution that is considerably different from the training distribution. Yet, learning theory of distribution shift bounds…

Machine Learning · Computer Science 2024-05-30 Robi Bhattacharjee , Nick Rittler , Kamalika Chaudhuri

Transfer learning techniques aim to leverage information from multiple related datasets to enhance prediction quality against a target dataset. Such methods have been adopted in the context of high-dimensional sparse regression, and some…

Machine Learning · Statistics 2025-01-31 Koki Okajima , Tomoyuki Obuchi

Practitioners often use data from a randomized controlled trial to learn a treatment assignment policy that can be deployed on a target population. A recurring concern in doing so is that, even if the randomized trial was well-executed…

Econometrics · Economics 2023-04-25 Lihua Lei , Roshni Sahoo , Stefan Wager

We consider a semi-supervised classification problem with non-stationary label-shift in which we observe a labelled data set followed by a sequence of unlabelled covariate vectors in which the marginal probabilities of the class labels may…

Statistics Theory · Mathematics 2024-05-29 Henry W J Reeve

We propose an efficient transfer Bayesian optimization method, which finds the maximum of an expensive-to-evaluate black-box function by using data on related optimization tasks. Our method uses auxiliary information that represents the…

Machine Learning · Statistics 2019-09-18 Tomoharu Iwata , Takuma Otsuka

Bayesian optimisation is a sample efficient method for finding a global optimum of expensive black-box objective functions. Historic datasets from related problems can be exploited to help improve performance of Bayesian optimisation by…

Machine Learning · Computer Science 2026-01-23 Natasha Trinkle , Huong Ha , Jeffrey Chan

Meta-learning methods perform well on new within-distribution tasks but often fail when adapting to out-of-distribution target tasks, where transfer from source tasks can induce negative transfer. We propose a causally-aware Bayesian…

Machine Learning · Computer Science 2026-02-24 Lotta Mäkinen , Jorge Loría , Samuel Kaski

Transfer learning is a key component of modern machine learning, enhancing the performance of target tasks by leveraging diverse data sources. Simultaneously, overparameterized models such as the minimum-$\ell_2$-norm interpolator (MNI) in…

Machine Learning · Statistics 2026-01-19 Yeichan Kim , Ilmun Kim , Seyoung Park

Learning personalized decision policies that generalize to the target population is of great relevance. Since training data is often not representative of the target population, standard policy learning methods may yield policies that do…

Machine Learning · Statistics 2021-12-03 Tobias Hatt , Daniel Tschernutter , Stefan Feuerriegel

Hypothesis transfer learning (HTL) contrasts domain adaptation by allowing for a previous task leverage, named the source, into a new one, the target, without requiring access to the source data. Indeed, HTL relies only on a hypothesis…

Machine Learning · Statistics 2023-07-17 Anass Aghbalou , Guillaume Staerman

Transfer learning refers to the transfer of knowledge or information from a relevant source task to a target task. However, most existing works assume both tasks are sampled from a stationary task distribution, thereby leading to the…

Machine Learning · Computer Science 2022-07-06 Jun Wu , Jingrui He

Transfer Learning, a technique where a model/agent can use the knowledge/expertise that it gained from one task and exploit that to solve another closely-related task, is often used in tackling problems in deep learning. Through this…

Robotics · Computer Science 2026-05-19 Benedict Florance Arockiaraj , Richard Chang , Wesley Yee

Convergence properties of empirical risk minimizers can be conveniently expressed in terms of the associated population risk. To derive bounds for the performance of the estimator under covariate shift, however, pointwise convergence rates…

Statistics Theory · Mathematics 2024-01-01 Johannes Schmidt-Hieber , Petr Zamolodtchikov

Lack of sufficient labeled data often limits the applicability of advanced machine learning algorithms to real life problems. However efficient use of Transfer Learning (TL) has been shown to be very useful across domains. TL utilizes…

Computation and Language · Computer Science 2017-08-15 Sunil Kumar Sahu , Ashish Anand

Optimal transport is a powerful framework for the efficient allocation of resources between sources and targets. However, traditional models often struggle to scale effectively in the presence of large and heterogeneous populations. In this…

Artificial Intelligence · Computer Science 2024-11-13 Navpreet Kaur , Juntao Chen , Yingdong Lu

Meta-Learning is a subarea of Machine Learning that aims to take advantage of prior knowledge to learn faster and with fewer data [1]. There are different scenarios where meta-learning can be applied, and one of the most common is algorithm…

Machine Learning · Computer Science 2019-10-17 Gean Trindade Pereira , Moisés dos Santos , Edesio Alcobaça , Rafael Mantovani , André Carvalho