English
Related papers

Related papers: Demystifying Spectral Feature Learning for Instrum…

200 papers

Instrumental variable (IV) regression relies on instruments to infer causal effects from observational data with unobserved confounding. We consider IV regression in time series models, such as vector auto-regressive (VAR) processes. Direct…

Methodology · Statistics 2024-07-23 Nikolaj Thams , Rikke Søndergaard , Sebastian Weichwald , Jonas Peters

Debiasing is a fundamental concept in high-dimensional statistics. While degrees-of-freedom adjustment is the state-of-the-art technique in high-dimensional linear regression, it is limited to i.i.d. samples and sub-Gaussian covariates.…

Statistics Theory · Mathematics 2026-01-01 Yufan Li , Pragya Sur

For multi-valued functions---such as when the conditional distribution on targets given the inputs is multi-modal---standard regression approaches are not always desirable because they provide the conditional mean. Modal regression…

Machine Learning · Statistics 2020-10-30 Yangchen Pan , Ehsan Imani , Martha White , Amir-massoud Farahmand

Estimating individual-level treatment effect from observational data is a fundamental problem in causal inference and has attracted increasing attention in the fields of education, healthcare, and public policy.In this work, we concentrate…

Machine Learning · Computer Science 2025-07-10 Hui Meng , Keping Yang , Xuyu Peng , Bo Zheng

Consider the problem of estimating the local average treatment effect with an instrument variable, where the instrument unconfoundedness holds after adjusting for a set of measured covariates. Several unknown functions of the covariates…

Methodology · Statistics 2020-09-22 Baoluo Sun , Zhiqiang Tan

As network data applications continue to expand, causal inference within networks has garnered increasing attention. However, hidden confounders complicate the estimation of causal effects. Most methods rely on the strong ignorability…

Machine Learning · Computer Science 2024-09-16 Xiaojing Du , Feiyu Yang , Wentao Gao , Xiongren Chen

Many problems in causal inference and economics can be formulated in the framework of conditional moment models, which characterize the target function through a collection of conditional moment restrictions. For nonparametric conditional…

Machine Learning · Statistics 2022-12-29 Ziyu Wang , Yucen Luo , Yueru Li , Jun Zhu , Bernhard Schölkopf

Exogenous heterogeneity, for example, in the form of instrumental variables can help us learn a system's underlying causal structure and predict the outcome of unseen intervention experiments. In this paper, we consider linear models in…

Methodology · Statistics 2024-10-21 Niklas Pfister , Jonas Peters

We discuss causal inference for observational studies with possibly invalid instrumental variables. We propose a novel methodology called two-stage curvature identification (TSCI) by exploring the nonlinear treatment model with machine…

Methodology · Statistics 2024-01-08 Zijian Guo , Mengchu Zheng , Peter Bühlmann

Doubly robust estimators of causal effects are a popular means of estimating causal effects. Such estimators combine an estimate of the conditional mean of the outcome given treatment and confounders (the so-called outcome regression) with…

Methodology · Statistics 2019-01-17 David Benkeser , Weixin Cai , Mark J van der Laan

Feature selection of high-dimensional labeled data with limited observations is critical for making powerful predictive modeling accessible, scalable, and interpretable for domain experts. Spectroscopy data, which records the interaction…

Machine Learning · Computer Science 2022-02-10 Frantishek Akulich , Hadis Anahideh , Manaf Sheyyab , Dhananjay Ambre

Instrumental variable (IV) methods are widely used to adjust for the bias in estimating treatment effects caused by unmeasured confounders in observational studies. In this manuscript, we provide empirical and theoretical evidence that the…

Methodology · Statistics 2015-03-04 Ashkan Ertefaie , Dylan Small , James H. Flory , Sean Hennessy

Hyperspectral imaging (HSI) unlocks the huge potential to a wide variety of applications relied on high-precision pathology image segmentation, such as computational pathology and precision medicine. Since hyperspectral pathology images…

Image and Video Processing · Electrical Eng. & Systems 2021-03-08 Boxiang Yun , Yan Wang , Jieneng Chen , Huiyu Wang , Wei Shen , Qingli Li

This paper concerns a spectral estimation problem in which we want to find a spectral density function that is consistent with estimated second-order statistics. It is an inverse problem admitting multiple solutions, and selection of a…

Optimization and Control · Mathematics 2019-08-08 Bin Zhu

Why depth yields a genuine computational advantage over shallow methods remains a central open question in learning theory. We study this question in a controlled high-dimensional Gaussian setting, focusing on compositional target…

Machine Learning · Statistics 2026-02-12 Hugo Tabanelli , Yatin Dandi , Luca Pesce , Florent Krzakala

A triangular structural panel data model with additive separable individual-specific effects is used to model the causal effect of a covariate on an outcome variable when there are unobservable confounders with some of them time-invariant.…

Econometrics · Economics 2026-03-18 Monika Avila-Marquez

The instrumental variable method consistently estimates the effect of a treatment when there is unmeasured confounding and a valid instrumental variable. A valid instrumental variable is a variable that is independent of unmeasured…

Methodology · Statistics 2016-02-03 Zijian Guo , Dylan Small

Instrumental variables (IVs) are widely used to study the causal effect of an exposure on an outcome in the presence of unmeasured confounding. IVs require an instrument, a variable that is (A1) associated with the exposure, (A2) has no…

Methodology · Statistics 2024-07-30 Hyunseung Kang , Zijian Guo , Zhonghua Liu , Dylan Small

Instrumental variable regression is a foundational tool for causal analysis across the social and biomedical sciences. Recent advances use kernel methods to estimate nonparametric causal relationships, with general data types, while…

Statistics Theory · Mathematics 2026-01-21 Marvin Lob , Rahul Singh , Suhas Vijaykumar

Latent variable models with hidden binary units appear in various applications. Learning such models, in particular in the presence of noise, is a challenging computational problem. In this paper we propose a novel spectral approach to this…

Machine Learning · Statistics 2018-02-28 Ariel Jaffe , Roi Weiss , Shai Carmi , Yuval Kluger , Boaz Nadler