English
Related papers

Related papers: Transfer Learning with Large-Scale Quantile Regres…

200 papers

We study a fundamental transfer learning process from source to target linear regression tasks, including overparameterized settings where there are more learned parameters than data samples. The target task learning is addressed by using…

Machine Learning · Computer Science 2024-06-03 Yehuda Dar , Daniel LeJeune , Richard G. Baraniuk

While conditional diffusion models have achieved remarkable success in various applications, they require abundant data to train from scratch, which is often infeasible in practice. To address this issue, transfer learning has emerged as an…

Machine Learning · Computer Science 2025-10-28 Ziheng Cheng , Tianyu Xie , Shiyue Zhang , Cheng Zhang

Transfer learning aims to leverage models pre-trained on source data to efficiently adapt to target setting, where only limited data are available for model fine-tuning. Recent works empirically demonstrate that adversarial training in the…

Machine Learning · Computer Science 2021-06-21 Zhun Deng , Linjun Zhang , Kailas Vodrahalli , Kenji Kawaguchi , James Zou

Modern systems (e.g., deep neural networks, big data analytics, and compilers) are highly configurable, which means they expose different performance behavior under different configurations. The fundamental challenge is that one cannot…

Artificial Intelligence · Computer Science 2019-02-27 Mohammad Ali Javidian , Pooyan Jamshidi , Marco Valtorta

The objective of transfer learning is to enhance estimation and inference in a target data by leveraging knowledge gained from additional sources. Recent studies have explored transfer learning for independent observations in complex,…

Machine Learning · Statistics 2025-04-23 Mingliang Ma Abolfazl Safikhani

In a variety of business situations, the introduction or improvement of machine learning approaches is impaired as these cannot draw on existing analytical models. However, in many cases similar problems may have already been solved…

Machine Learning · Computer Science 2020-05-22 Robin Hirt , Niklas Kühl , Yusuf Peker , Gerhard Satzger

Quantile regression is a powerful tool for learning the relationship between a response variable and a multivariate predictor while exploring heterogeneous effects. In this paper, we consider statistical inference for quantile regression…

Statistics Theory · Mathematics 2021-05-19 Xuming He , Xiaoou Pan , Kean Ming Tan , Wen-Xin Zhou

Transfer learning has recently attracted significant research attention, as it simultaneously learns from different source domains, which have plenty of labeled data, and transfers the relevant knowledge to the target domain with limited…

Machine Learning · Statistics 2018-06-14 Alireza Karbalayghareh , Xiaoning Qian , Edward R. Dougherty

We propose a novel adaptive transfer learning framework, learning to transfer learn (L2TL), to improve performance on a target dataset by careful extraction of the related information from a source dataset. Our framework considers…

Machine Learning · Computer Science 2020-07-17 Linchao Zhu , Sercan O. Arik , Yi Yang , Tomas Pfister

In this paper we propose an improved method for transfer learning that takes into account the balance between target and source data. This method builds on the state-of-the-art Multisource Tradaboost, but weighs the importance of each…

Machine Learning · Computer Science 2019-03-28 João Antunes , Alexandre Bernardino , Asim Smailagic , Daniel Siewiorek

Using transfer learning to adapt a pre-trained "source model" to a downstream "target task" can dramatically increase performance with seemingly no downside. In this work, we demonstrate that there can exist a downside after all: bias…

Machine Learning · Computer Science 2022-07-07 Hadi Salman , Saachi Jain , Andrew Ilyas , Logan Engstrom , Eric Wong , Aleksander Madry

Transfer learning is a common practice that alleviates the need for extensive data to train neural networks. It is performed by pre-training a model using a source dataset and fine-tuning it for a target task. However, not every source…

Machine Learning · Computer Science 2024-10-01 Jiseok Lee , Brian Kenji Iwana

Multi-source transfer learning has been proven effective when within-target labeled data is scarce. Previous work focuses primarily on exploiting domain similarities and assumes that source domains are richly or at least comparably labeled.…

Machine Learning · Computer Science 2018-07-09 Zirui Wang , Jaime Carbonell

Methods of transfer learning try to combine knowledge from several related tasks (or domains) to improve performance on a test task. Inspired by causal methodology, we relax the usual covariate shift assumption and assume that it holds true…

Machine Learning · Statistics 2018-09-25 Mateo Rojas-Carulla , Bernhard Schölkopf , Richard Turner , Jonas Peters

We consider a serious, previously-unexplored challenge facing almost all approaches to scaling up entity resolution (ER) to multiple data sources: the prohibitive cost of labeling training data for supervised learning of similarity scores…

Databases · Computer Science 2012-08-10 Sahand Negahban , Benjamin I. P. Rubinstein , Jim Gemmell

Modern software systems are built to be used in dynamic environments using configuration capabilities to adapt to changes and external uncertainties. In a self-adaptation context, we are often interested in reasoning about the performance…

Software Engineering · Computer Science 2017-04-24 Pooyan Jamshidi , Miguel Velez , Christian Kästner , Norbert Siegmund , Prasad Kawthekar

Transfer learning is a burgeoning concept in statistical machine learning that seeks to improve inference and/or predictive accuracy on a domain of interest by leveraging data from related domains. While the term "transfer learning" has…

Machine Learning · Statistics 2023-12-22 Piotr M. Suder , Jason Xu , David B. Dunson

Transfer learning is a vital technique that generalizes models trained for one setting or task to other settings or tasks. For example in speech recognition, an acoustic model trained for one language can be used to recognize speech in…

Computation and Language · Computer Science 2015-11-20 Dong Wang , Thomas Fang Zheng

Transfer learning enhances prediction accuracy on a target distribution by leveraging data from a source distribution, demonstrating significant benefits in various applications. This paper introduces a novel dissimilarity measure that…

Machine Learning · Statistics 2024-12-12 Mitsuhiro Fujikawa , Yohei Akimoto , Jun Sakuma , Kazuto Fukuchi

Deep learning based question answering (QA) on English documents has achieved success because there is a large amount of English training examples. However, for most languages, training examples for high-quality QA models are not available.…

Computation and Language · Computer Science 2019-07-16 Chia-Hsuan Lee , Hung-Yi Lee