English
Related papers

Related papers: Covariate-Elaborated Robust Partial Information Tr…

200 papers

Many causal estimands are only partially identifiable since they depend on the unobservable joint distribution between potential outcomes. Stratification on pretreatment covariates can yield sharper bounds; however, unless the covariates…

Econometrics · Economics 2024-11-19 Wenlong Ji , Lihua Lei , Asher Spector

In supervised learning, the estimation of prediction error on unlabeled test data is an important task. Existing methods are usually built on the assumption that the training and test data are sampled from the same distribution, which is…

Methodology · Statistics 2022-09-30 Hui Xu , Robert Tibshirani

Transfer learning has aroused great interest in the statistical community. In this article, we focus on knowledge transfer for unsupervised learning tasks in contrast to the supervised learning tasks in the literature. Given the…

Machine Learning · Statistics 2024-03-13 Zeyu Li , Kangxiang Qin , Yong He , Wang Zhou , Xinsheng Zhang

Transfer learning is a valuable tool in deep learning as it allows propagating information from one "source dataset" to another "target dataset", especially in the case of a small number of training examples in the latter. Yet,…

Machine Learning · Computer Science 2023-06-13 Daniel Jakubovitz , David Uliel , Miguel Rodrigues , Raja Giryes

We pursue transfer learning to improve classifier accuracy on a target task with few labeled examples available for training. Recent work suggests that using a source task to learn a prior distribution over neural net weights, not just an…

Machine Learning · Computer Science 2024-05-27 Ethan Harvey , Mikhail Petrov , Michael C. Hughes

Spiking neural networks (SNNs) are rich in spatio-temporal dynamics and are suitable for processing event-based neuromorphic data. However, event-based datasets are usually less annotated than static datasets. This small data scale makes…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Xiang He , Dongcheng Zhao , Yang Li , Guobin Shen , Qingqun Kong , Yi Zeng

Nonresponse weighting adjustment using propensity score is a popular method for handling unit nonresponse. However, including all available auxiliary variables into the propensity model can lead to inefficient and inconsistent estimation,…

Methodology · Statistics 2018-07-31 Hejian Sang , Gyuhyeong Goh , Jae Kwang Kim

We propose a simple, statistically principled, and theoretically justified method to improve supervised learning when the training set is not representative, a situation known as covariate shift. We build upon a well-established methodology…

Machine Learning · Statistics 2025-03-12 Maximilian Autenrieth , David A. van Dyk , Roberto Trotta , David C. Stenning

Varying domains and biased datasets can lead to differences between the training and the target distributions, known as covariate shift. Current approaches for alleviating this often rely on estimating the ratio of training and target…

Machine Learning · Statistics 2020-10-27 Bijan Mazaheri , Siddharth Jain , Jehoshua Bruck

When the data are stored in a distributed manner, direct application of traditional statistical inference procedures is often prohibitive due to communication cost and privacy concerns. This paper develops and investigates two…

Machine Learning · Statistics 2021-08-04 Jianqing Fan , Yongyi Guo , Kaizheng Wang

Modern neural networks have proven to be powerful function approximators, providing state-of-the-art performance in a multitude of applications. They however fall short in their ability to quantify confidence in their predictions - this is…

Machine Learning · Statistics 2020-06-29 Alex J. Chan , Ahmed M. Alaa , Zhaozhi Qian , Mihaela van der Schaar

Many existing transfer learning methods rely on leveraging information from source data that closely resembles the target data. However, this approach often overlooks valuable knowledge that may be present in different yet potentially…

Machine Learning · Computer Science 2023-09-14 Xin Xiong , Zijian Guo , Tianxi Cai

In this work, we propose a novel variational Bayesian adaptive learning approach for cross-domain knowledge transfer to address acoustic mismatches between training and testing conditions, such as recording devices and environmental noise.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-28 Hu Hu , Sabato Marco Siniscalchi , Chao-Han Huck Yang , Chin-Hui Lee

We propose a novel spike and slab prior specification with scaled beta prime marginals for the importance parameters of regression coefficients to allow for general effect selection within the class of structured additive distributional…

Methodology · Statistics 2020-06-30 Nadja Klein , Manuel Carlan , Thomas Kneib , Stefan Lang , Helga Wagner

Transfer learning involves adapting a pre-trained model to novel downstream tasks. However, we observe that current transfer learning methods often fail to focus on task-relevant features. In this work, we explore refocusing model attention…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Baifeng Shi , Siyu Gai , Trevor Darrell , Xin Wang

Real-world learning tasks often encounter uncertainty due to covariate shift and noisy or inconsistent labels. However, existing robust learning methods merge these effects into a single distributional uncertainty set. In this work, we…

Methodology · Statistics 2026-03-17 Varun Venkatesh , Eyke Hüllermeier , Bernd Bischl , Mina Rezaei

Performance estimation under covariate shift is a crucial component of safe AI model deployment, especially for sensitive use-cases. Recently, several solutions were proposed to tackle this problem, most leveraging model predictions or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Mélanie Roschewitz , Ben Glocker

Many problems in science and engineering require making predictions based on few observations. To build a robust predictive model, these sparse data may need to be augmented with simulated data, especially when the design space is…

Across a variety of scientific disciplines, sparse inverse covariance estimation is a popular tool for capturing the underlying dependency relationships in multivariate data. Unfortunately, most estimators are not scalable enough to handle…

Transfer learning has become an essential technique for utilizing information from source datasets to improve the performance of the target task. However, in the context of high-dimensional data, heterogeneity arises due to heteroscedastic…

Methodology · Statistics 2024-06-26 Xiaohui Yuan , Shujie Ren