English
Related papers

Related papers: Demystifying Spectral Feature Learning for Instrum…

200 papers

In settings where Machine Learning (ML) algorithms automate or inform consequential decisions about people, individual decision subjects are often incentivized to strategically modify their observable attributes to receive more favorable…

Machine Learning · Computer Science 2022-06-10 Keegan Harris , Daniel Ngo , Logan Stapleton , Hoda Heidari , Zhiwei Steven Wu

Instrumental variables (IVs) are widely used to estimate causal effects in the presence of unobserved confounding between exposure and outcome. An IV must affect the outcome exclusively through the exposure and be unconfounded with the…

Instrumental variable methods are widely used for inferring the causal effect in the presence of unmeasured confounders. Existing instrumental variable methods for nonlinear outcome models require stringent identifiability conditions. This…

Methodology · Statistics 2022-07-01 Sai Li , Zijian Guo

The instrumental variables (IV) method is a method for making causal inferences about the effect of a treatment based on an observational study in which there are unmeasured confounding variables. The method requires a valid IV, a variable…

Methodology · Statistics 2014-08-19 Dylan Small , Zhiqiang Tan , Scott Lorch , Alan Brookhart

Hidden Markov models have successfully been applied as models of discrete time series in many fields. Often, when applied in practice, the parameters of these models have to be estimated. The currently predominating identification methods,…

Machine Learning · Statistics 2015-07-24 Robert Mattila , Cristian R. Rojas , Bo Wahlberg

To estimate causal effects, analysts performing observational studies in health settings utilize several strategies to mitigate bias due to confounding by indication. There are two broad classes of approaches for these purposes: use of…

Methodology · Statistics 2023-05-01 Roy S. Zawadzki , Joshua D. Grill , Daniel L. Gillen

Traditional instrumental variable (IV) methods often struggle with weak or invalid instruments and rely heavily on external data. We introduce a Synthetic Instrumental Variable (SIV) approach that constructs valid instruments using only…

Methodology · Statistics 2025-12-22 Ratbek Dzhumashev , Ainura Tursunalieva

Unobserved confounding is a fundamental challenge for estimating causal effects. To address unobserved confounding, recent literature has turned to two different approaches -- proxy variables and the use of multiple treatments. The first…

Methodology · Statistics 2026-05-20 Aytijhya Saha , Stephen Bates , Devavrat Shah

It is well-known that, without restricting treatment effect heterogeneity, instrumental variable (IV) methods only identify "local" effects among compliers, i.e., those subjects who take treatment only when encouraged by the IV. Local…

Methodology · Statistics 2019-06-03 Edward H. Kennedy , Sivaraman Balakrishnan , Max G'Sell

Drawing causal inference with observational studies is the central pillar of many disciplines. One sufficient condition for identifying the causal effect is that the treatment-outcome relationship is unconfounded conditional on the observed…

Statistics Theory · Mathematics 2017-01-17 Peng Ding , Tyler VanderWeele , James Robins

We present Spectral Inference Networks, a framework for learning eigenfunctions of linear operators by stochastic optimization. Spectral Inference Networks generalize Slow Feature Analysis to generic symmetric operators, and are closely…

Machine Learning · Computer Science 2020-01-17 David Pfau , Stig Petersen , Ashish Agarwal , David G. T. Barrett , Kimberly L. Stachenfeld

We study the kernel instrumental variable (KIV) algorithm, a kernel-based two-stage least-squares method for nonparametric instrumental variable regression. We provide a convergence analysis covering both identified and non-identified…

Machine Learning · Statistics 2026-04-09 Dimitri Meunier , Zhu Li , Tim Christensen , Arthur Gretton

Estimating treatment effects from observational data is challenging due to two main reasons: (a) hidden confounding, and (b) covariate mismatch (control and treatment groups not having identical distributions). Long lines of works exist…

Machine Learning · Computer Science 2025-04-30 Praharsh Nanavati , Ranjitha Prasad , Karthikeyan Shanmugam

In some causal inference scenarios, the treatment variable is measured inaccurately, for instance in epidemiology or econometrics. Failure to correct for the effect of this measurement error can lead to biased causal effect estimates.…

Machine Learning · Computer Science 2024-09-13 Antti Pöllänen , Pekka Marttinen

In a nonparametric instrumental regression model, we strengthen the conventional moment independence assumption towards full statistical independence between instrument and error term. This allows us to prove identification results and…

Econometrics · Economics 2019-06-13 Isaac Loh

We propose an approach to estimate the effect of multiple simultaneous interventions in the presence of hidden confounders. To overcome the problem of hidden confounding, we consider the setting where we have access to not only the…

Methodology · Statistics 2020-06-17 Sorawit Saengkyongam , Ricardo Silva

In this paper, we apply the Feature Space Decomposition (FSD) method developed in [LS24, GLS25, LSSW26, ALSS26] to obtain, under fairly general conditions, matching upper and lower bounds for the population excess risk of spectral methods…

Statistics Theory · Mathematics 2026-05-18 Guillaume Lecué , Zhifan Li , Zong Shang

One of the most common mistakes made when performing data analysis is attributing causal meaning to regression coefficients. Formally, a causal effect can only be computed if it is identifiable from a combination of observational data and…

Artificial Intelligence · Computer Science 2019-10-31 Daniel Kumor , Bryant Chen , Elias Bareinboim

Studies investigating the causal effects of spatially varying exposures on outcomes often rely on observational and spatially indexed data. A prevalent challenge is unmeasured spatial confounding, where an unobserved spatially varying…

Methodology · Statistics 2025-11-19 Sophie M. Woodward , Mauricio Tec , Francesca Dominici

Instrumental variables (IVs) are crucial for addressing unobservable confounders, yet their stringent exogeneity assumptions pose significant challenges in networked data. Existing methods typically rely on modelling neighbour information…

Artificial Intelligence · Computer Science 2026-02-10 Zhirong Huang , Debo Cheng , Guixian Zhang , Yi Wang , Jiuyong Li , Shichao Zhang