English
Related papers

Related papers: TILT: Target-induced loss tilting under covariate …

200 papers

Covariate shift is a common transfer learning scenario where the marginal distributions of input variables vary between source and target data while the conditional distribution of the output variable remains consistent. The existing…

Statistics Theory · Mathematics 2024-01-23 Petr Zamolodtchikov , Hanyuan Hang

In many real-world applications, researchers aim to deploy models trained in a source domain to a target domain, where obtaining labeled data is often expensive, time-consuming, or even infeasible. While most existing literature assumes…

Methodology · Statistics 2025-08-26 Seong-ho Lee , Yanyuan Ma , Jiwei Zhao

While Supervised Fine-Tuning (SFT) and Rejection Sampling Fine-Tuning (RFT) are standard for LLM alignment, they either rely on costly expert data or discard valuable negative samples, leading to data inefficiency. To address this, we…

Machine Learning · Computer Science 2026-04-24 Zehua Liu , Shuqi Liu , Tao Zhong , Mingxuan Yuan

This paper studies nonparametric regression with repeated measurements when the response in the target domain is unobservable or costly to collect. We adopt a transfer learning framework that leverages a source domain with observable…

Methodology · Statistics 2026-05-26 Yingxuan Wang , Xiangyu Xing , Wangli Xu

Estimating the conditional average treatment effect (CATE) from observational data plays a crucial role in areas such as e-commerce, healthcare, and economics. Existing studies mainly rely on the strong ignorability assumption that there…

Machine Learning · Computer Science 2025-01-28 Chuan Zhou , Yaxuan Li , Chunyuan Zheng , Haiteng Zhang , Haoxuan Li , Mingming Gong

We propose a principled framework for unsupervised domain adaptation under covariate shift in kernel Generalized Linear Models (GLMs), encompassing kernelized linear, logistic, and Poisson regression with ridge regularization. Our goal is…

Machine Learning · Statistics 2026-03-24 Nathan Weill , Kaizheng Wang

Probabilistic classification of unassociated Fermi-LAT sources using machine learning methods has an implicit assumption that the distributions of associated and unassociated sources are the same as a function of source parameters, which is…

High Energy Astrophysical Phenomena · Physics 2024-01-04 Dmitry V. Malyshev

Unsupervised domain adaptation, which involves transferring knowledge from a label-rich source domain to an unlabeled target domain, can be used to substantially reduce annotation costs in the field of object detection. In this study, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Kazuma Fujii , Hiroshi Kera , Kazuhiko Kawamoto

A pervasive phenomenon in machine learning applications is distribution shift, where training and deployment conditions for a machine learning model differ. As distribution shift typically results in a degradation in performance, much…

Machine Learning · Statistics 2024-01-23 Philip Amortila , Tongyi Cao , Akshay Krishnamurthy

Unsupervised Domain Adaptation aims to learn a model on a source domain with labeled data in order to perform well on unlabeled data of a target domain. Current approaches focus on learning \textit{Domain Invariant Representations}. It…

Machine Learning · Computer Science 2019-07-30 Victor Bouvier , Philippe Very , Céline Hudelot , Clément Chastagnol

Continual Test-Time Adaptation (CTA) is a challenging task that aims to adapt a source pre-trained model to continually changing target domains. In the CTA setting, a model does not know when the target domain changes, thus facing a drastic…

Machine Learning · Computer Science 2024-03-05 Inseop Chung , Kyomin Hwang , Jayeon Yoo , Nojun Kwak

Transfer learning of prediction models has been extensively studied, while the corresponding policy learning approaches are rarely discussed. In this paper, we propose principled approaches for learning the optimal policy in the target…

Machine Learning · Computer Science 2025-05-20 Xueqing Liu , Qinwei Yang , Zhaoqing Tian , Ruocheng Guo , Peng Wu

Covariate adjustment is an approach to improve the precision of trial analyses by adjusting for baseline variables that are prognostic of the primary endpoint. Motivated by the SEARCH Universal HIV Test-and-Treat Trial (2013-2017), we tell…

Methodology · Statistics 2025-12-16 Laura B. Balzer , Mark J. van der Laan , Maya L. Petersen

In the absence of large labelled datasets, self-supervised learning techniques can boost performance by learning useful representations from unlabelled data, which is often more readily available. However, there is often a domain shift…

Machine Learning · Computer Science 2020-06-23 Linus Ericsson , Henry Gouk , Timothy M. Hospedales

The generalization error (risk) of a supervised statistical learning algorithm quantifies its prediction ability on previously unseen data. Inspired by exponential tilting, \citet{li2020tilted} proposed the {\it tilted empirical risk} (TER)…

Machine Learning · Statistics 2025-06-10 Gholamali Aminian , Amir R. Asadi , Tian Li , Ahmad Beirami , Gesine Reinert , Samuel N. Cohen

Dataset bias is a well-known problem in the field of computer vision. The presence of implicit bias in any image collection hinders a model trained and validated on a particular dataset to yield similar accuracies when tested on other…

Computer Vision and Pattern Recognition · Computer Science 2019-07-15 Kirthi Shankar Sivamani

Covariate shift relaxes the widely-employed independent and identically distributed (IID) assumption by allowing different training and testing input distributions. Unfortunately, common methods for addressing covariate shift by trying to…

Machine Learning · Computer Science 2018-01-02 Anqi Liu , Brian D. Ziebart

Domain adaptive object detection (DAOD) aims to adapt the detector from a labelled source domain to an unlabelled target domain. In recent years, DAOD has attracted massive attention since it can alleviate performance degradation due to the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Siqi Zhang , Lu Zhang , Zhiyong Liu , Hangtao Feng

We present a Transfer Causal Learning (TCL) framework when target and source domains share the same covariate/feature spaces, aiming to improve causal effect estimation accuracy in limited data. Limited data is very common in medical…

Machine Learning · Computer Science 2024-01-02 Song Wei , Hanyu Zhang , Ronald Moore , Rishikesan Kamaleswaran , Yao Xie

Unsupervised domain adaptation (UDA) aims to improve the classification performance on an unlabeled target domain by leveraging information from a fully labeled source domain. Recent approaches explore domain-invariant and…

Machine Learning · Computer Science 2021-03-26 Ni Xiao , Lei Zhang