English
Related papers

Related papers: Detecting Unobserved Confounders: A Kernelized Reg…

200 papers

Confounding matters in almost all observational studies that focus on causality. In order to eliminate bias caused by connfounders, oftentimes a substantial number of features need to be collected in the analysis. In this case, large p…

Statistics Theory · Mathematics 2019-12-30 Shinyuu Lee , Yuru Zhu

We investigate statistical properties for a broad class of modern kernel-based regression (KBR) methods. These kernel methods were developed during the last decade and are inspired by convex risk minimization in infinite-dimensional Hilbert…

Statistics Theory · Mathematics 2009-09-29 Andreas Christmann , Ingo Steinwart

Results in epidemiology and social science often require the removal of confounding effects from measurements of the pairwise correlation of variables in survey data. This is typically accomplished by some variant of linear regression…

Methodology · Statistics 2025-12-02 William H. Press

When observed decisions depend only on observed features, off-policy policy evaluation (OPE) methods for sequential decision making problems can estimate the performance of evaluation policies before deploying them. This assumption is…

Machine Learning · Statistics 2020-03-13 Hongseok Namkoong , Ramtin Keramati , Steve Yadlowsky , Emma Brunskill

We prove statistical rates of convergence for kernel-based least squares regression from i.i.d. data using a conjugate gradient algorithm, where regularization against overfitting is obtained by early stopping. This method is related to…

Statistics Theory · Mathematics 2016-07-11 Gilles Blanchard , Nicole Krämer

In most adaptive signal processing applications, system linearity is assumed and adaptive linear filters are thus used. The traditional class of supervised adaptive filters rely on error-correction learning for their adaptive capability.…

Machine Learning · Computer Science 2015-08-31 Songlin Zhao

We study policy evaluation of offline contextual bandits subject to unobserved confounders. Sensitivity analysis methods are commonly used to estimate the policy value under the worst-case confounding over a given uncertainty set. However,…

Machine Learning · Statistics 2023-09-25 Kei Ishikawa , Niao He

We propose a method for nonparametric density estimation that exhibits robustness to contamination of the training sample. This method achieves robustness by combining a traditional kernel density estimator (KDE) with ideas from classical…

Machine Learning · Statistics 2011-09-07 JooSeuk Kim , Clayton D. Scott

Unmeasured confounding bias threatens the validity of observational studies. While sensitivity analyses and study designs have been proposed to address this issue, they often overlook the growing availability of auxiliary data. Using…

Methodology · Statistics 2024-10-22 Jie Kate Hu , Dafne Zorzetto , Francesca Dominici

Proxy variables are commonly used in causal inference when unmeasured confounding exists. While most existing proximal methods assume a unidirectional causal relationship between two primary variables, many social and biological systems…

Methodology · Statistics 2025-07-21 Jiaqi Min , Xueyue Zhang , Shanshan Luo

Conditionally positive definite (CPD) kernels are defined with respect to a function class $\mathcal{F}$. It is well known that such a kernel $K$ is associated with its native space (defined analogously to an RKHS), which in turn gives rise…

Machine Learning · Computer Science 2026-05-26 Rustem Takhanov , Zhenisbek Assylbekov

Dyadic data is often encountered when quantities of interest are associated with the edges of a network. As such it plays an important role in statistics, econometrics and many other data science disciplines. We consider the problem of…

Statistics Theory · Mathematics 2023-10-17 Matias D. Cattaneo , Yingjie Feng , William G. Underwood

One of the major challenges in estimating conditional potential outcomes and conditional average treatment effects (CATE) is the presence of hidden confounders. Since testing for hidden confounders cannot be accomplished only with…

Machine Learning · Computer Science 2025-06-17 Ahmed Aloui , Juncheng Dong , Ali Hasan , Vahid Tarokh

This paper develops a robust and efficient method for policy learning from observational data in the presence of unobserved confounding, complementing existing instrumental variable (IV) based approaches. We employ the marginal sensitivity…

Econometrics · Economics 2025-07-29 Zequn Jin , Gaoqian Xu , Xi Zheng , Yahong Zhou

As language models become more general purpose, increased attention needs to be paid to detecting out-of-distribution (OOD) instances, i.e., those not belonging to any of the distributions seen during training. Existing methods for…

Machine Learning · Computer Science 2024-07-19 Aryan Gulati , Xingjian Dong , Carlos Hurtado , Sarath Shekkizhar , Swabha Swayamdipta , Antonio Ortega

Regression uses supervised machine learning to find a model that combines several independent variables to predict a dependent variable based on ground truth (labeled) data, i.e., tuples of independent and dependent variables (labels).…

Machine Learning · Computer Science 2021-10-29 Maria Ulan , Welf Löwe , Morgan Ericsson , Anna Wingkvist

Comparing conditional distributions is a fundamental challenge in statistics and machine learning, with applications across a wide range of domains. While proposed methods for measuring discrepancies using kernel embeddings of distributions…

Machine Learning · Statistics 2026-05-05 Peter Moskvichev , Siu Lun Chau , Dino Sejdinovic

Uncertainty quantification is essential for scientific analysis, as it allows for the evaluation and interpretation of variability and reliability in complex systems and datasets. In their original form, multivariate statistical regression…

The principal stratification has become a popular tool to address a broad class of causal inference questions, particularly in dealing with non-compliance and truncation-by-death problems. The causal effects within principal strata which…

Methodology · Statistics 2022-06-20 Shanshan Luo , Wei Li , Wang Miao , Yangbo He

Panel data are widely used in political science to draw causal inferences. However, these models often rely on the strong and untested assumption of sequential ignorability--that no unmeasured variables influence both the independent and…

Methodology · Statistics 2026-02-17 Bang Quan Zheng