English
Related papers

Related papers: Proxy-informed Bayesian transfer learning with unk…

200 papers

Offline Reinforcement learning is commonly used for sequential decision-making in domains such as healthcare and education, where the rewards are known and the transition dynamics $T$ must be estimated on the basis of batch data. A key…

Machine Learning · Computer Science 2023-08-10 Leo Benac , Sonali Parbhoo , Finale Doshi-Velez

Methods of transfer learning try to combine knowledge from several related tasks (or domains) to improve performance on a test task. Inspired by causal methodology, we relax the usual covariate shift assumption and assume that it holds true…

Machine Learning · Statistics 2018-09-25 Mateo Rojas-Carulla , Bernhard Schölkopf , Richard Turner , Jonas Peters

When presented with a data stream of two statistically dependent variables, predicting the future of one of the variables (the target stream) can benefit from information about both its history and the history of the other variable (the…

Machine Learning · Computer Science 2023-03-10 Damjan Kalajdzievski , Ximeng Mao , Pascal Fortier-Poisson , Guillaume Lajoie , Blake Richards

Network interference occurs when treatments assigned to some units affect the outcomes of others. Traditional approaches often assume that the observed network correctly specifies the interference structure. However, in practice,…

Methodology · Statistics 2026-02-04 Bar Weinstein , Daniel Nevo

Transfer learning is a burgeoning concept in statistical machine learning that seeks to improve inference and/or predictive accuracy on a domain of interest by leveraging data from related domains. While the term "transfer learning" has…

Machine Learning · Statistics 2023-12-22 Piotr M. Suder , Jason Xu , David B. Dunson

In many business settings, task-specific labeled data are scarce or costly to obtain, limiting supervised learning on a target task. A classical response is transfer learning (TL). Many TL works study how to transfer information from…

Machine Learning · Statistics 2026-05-14 Hamza Cherkaoui , Hélène Halconruy , Yohan Petetin

Transfer learning where the behavior of extracting transferable knowledge from the source domain(s) and reusing this knowledge to target domain has become a research area of great interest in the field of artificial intelligence.…

Machine Learning · Computer Science 2021-09-29 Junyu Xuan , Jie Lu , Guangquan Zhang

Transfer learning has aroused great interest in the statistical community. In this article, we focus on knowledge transfer for unsupervised learning tasks in contrast to the supervised learning tasks in the literature. Given the…

Machine Learning · Statistics 2024-03-13 Zeyu Li , Kangxiang Qin , Yong He , Wang Zhou , Xinsheng Zhang

Prompt-based probing has been widely used in evaluating the abilities of pretrained language models (PLMs). Unfortunately, recent studies have discovered such an evaluation may be inaccurate, inconsistent and unreliable. Furthermore, the…

Computation and Language · Computer Science 2022-03-24 Boxi Cao , Hongyu Lin , Xianpei Han , Fangchao Liu , Le Sun

Transfer learning research attempts to make model induction transferable across different domains. This method assumes that specific information regarding to which domain each instance belongs is known. This paper helps to extend the…

Machine Learning · Computer Science 2025-06-04 Xinshun Liu , He Xin , Mao Hui , Liu Jing , Lai Weizhong , Ye Qingwen

Visual prompting, an efficient method for transfer learning, has shown its potential in vision tasks. However, previous works focus exclusively on VP from standard source models, it is still unknown how it performs under the scenario of a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Qi Li , Liangzhi Li , Zhouqiang Jiang , Bowen Wang

Transfer learning enhances model performance in a target population with limited samples by leveraging knowledge from related studies. While many works focus on improving predictive performance, challenges of statistical inference persist.…

Methodology · Statistics 2024-12-05 Daoyuan Lai , Oscar Hernan Madrid Padilla , Tian Gu

We present new results for nonparametric identification of causal effects using noisy proxies for unobserved confounders. Our approach builds on the results of \citet{Hu2008} who tackle the problem of general measurement error. We call this…

Econometrics · Economics 2023-05-05 Ben Deaner

Bayesian transfer learning (BTL) is defined in this paper as the task of conditioning a target probability distribution on a transferred source distribution. The target globally models the interaction between the source and target, and…

Machine Learning · Computer Science 2021-01-19 Milan Papež , Anthony Quinn

Prompt-based learning paradigm bridges the gap between pre-training and fine-tuning, and works effectively under the few-shot setting. However, we find that this learning paradigm inherits the vulnerability from the pre-training stage,…

Computation and Language · Computer Science 2022-04-12 Lei Xu , Yangyi Chen , Ganqu Cui , Hongcheng Gao , Zhiyuan Liu

Federated learning brings potential benefits of faster learning, better solutions, and a greater propensity to transfer when heterogeneous data from different parties increases diversity. However, because federated learning tasks tend to be…

Machine Learning · Computer Science 2021-01-18 Duc Thien Nguyen , Shiau Hoong Lim , Laura Wynter , Desmond Cai

Human learners have the natural ability to use knowledge gained in one setting for learning in a different but related setting. This ability to transfer knowledge from one task to another is essential for effective learning. In this paper,…

Statistics Theory · Mathematics 2019-06-10 T. Tony Cai , Hongji Wei

We establish concentration rates for estimation of treatment effects in experiments that incorporate prior sources of information -- such as past pilots, related studies, or expert assessments -- whose external validity is uncertain. Each…

Econometrics · Economics 2026-03-24 Frederico Finan , Demian Pouzo

Statistical prediction models are often trained on data from different probability distributions than their eventual use cases. One approach to proactively prepare for these shifts harnesses the intuition that causal mechanisms should…

Machine Learning · Computer Science 2023-08-02 Bijan Mazaheri , Atalanti Mastakouri , Dominik Janzing , Michaela Hardt

We propose a transfer learning method that utilizes data representations in a semiparametric regression model. Our aim is to perform statistical inference on the parameter of primary interest in the target model while accounting for…

Methodology · Statistics 2024-06-21 Baihua He , Huihang Liu , Xinyu Zhang , Jian Huang