English
Related papers

Related papers: IV-ICL: Bounding Causal Effects with Instrumental …

200 papers

We are in the middle of a remarkable rise in the use and capability of artificial intelligence. Much of this growth has been fueled by the success of deep learning architectures: models that map from observables to outputs via multiple…

Applications · Statistics 2017-01-02 Jason Hartford , Greg Lewis , Kevin Leyton-Brown , Matt Taddy

Instrumental variable methods are widely used for inferring the causal effect in the presence of unmeasured confounders. Existing instrumental variable methods for nonlinear outcome models require stringent identifiability conditions. This…

Methodology · Statistics 2022-07-01 Sai Li , Zijian Guo

Learning the causal structure behind data is invaluable for improving generalization and obtaining high-quality explanations. We propose a novel framework, Invariant Structure Learning (ISL), that is designed to improve causal structure…

Machine Learning · Computer Science 2022-06-15 Yunhao Ge , Sercan Ö. Arik , Jinsung Yoon , Ao Xu , Laurent Itti , Tomas Pfister

Instrumental-variable (IV) regression enables causal estimation under endogeneity, but modern IV problems often involve nonlinear structural effects and high-dimensional covariates. Existing nonlinear IV methods directly learn the causal…

Machine Learning · Statistics 2026-05-11 Guyue Luo , Qiao Liu

Causal representation learning (CRL) offers the promise of uncovering the underlying causal model by which observed data was generated, but the practical applicability of existing methods remains limited by the strong assumptions required…

Machine Learning · Computer Science 2026-01-30 Yuhang Liu , Zhen Zhang , Dong Gong , Erdun Gao , Biwei Huang , Mingming Gong , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

Estimating the conditional average treatment effect (CATE) from observational data is relevant for many applications such as personalized medicine. Here, we focus on the widespread setting where the observational data come from multiple…

Machine Learning · Computer Science 2024-06-05 Jonas Schweisthal , Dennis Frauen , Mihaela van der Schaar , Stefan Feuerriegel

In this paper, we conduct a comprehensive study of In-Context Learning (ICL) by addressing several open questions: (a) What type of ICL estimator is learned by large language models? (b) What is a proper performance metric for ICL and what…

Machine Learning · Statistics 2023-10-11 Yufeng Zhang , Fengzhuo Zhang , Zhuoran Yang , Zhaoran Wang

Causal inference is difficult in the presence of unobserved confounders. We introduce the instrumented common confounding (ICC) approach to (nonparametrically) identify causal effects with instruments, which are exogenous only conditional…

Econometrics · Economics 2022-09-20 Christian Tien

When applying multi-instance learning (MIL) to make predictions for bags of instances, the prediction accuracy of an instance often depends on not only the instance itself but also its context in the corresponding bag. From the viewpoint of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Tiancheng Lin , Hongteng Xu , Canqian Yang , Yi Xu

Instrumental variable methods are among the most commonly used causal inference approaches to deal with unmeasured confounders in observational studies. The presence of invalid instruments is the primary concern for practical applications,…

Methodology · Statistics 2023-04-18 Zijian Guo

We study the problem of estimating causal effects under hidden confounding in the following unpaired data setting: we observe some covariates $X$ and an outcome $Y$ under different experimental conditions (environments) but do not observe…

Machine Learning · Statistics 2026-01-22 Felix Schur , Niklas Pfister , Peng Ding , Sach Mukherjee , Jonas Peters

In offline reinforcement learning (RL) an optimal policy is learned solely from a priori collected observational data. However, in observational data, actions are often confounded by unobserved variables. Instrumental variables (IVs), in…

Machine Learning · Statistics 2024-10-16 Luofeng Liao , Zuyue Fu , Zhuoran Yang , Yixin Wang , Mladen Kolar , Zhaoran Wang

We study offline imitation learning (IL) when part of the decision-relevant state is observed only through noisy measurements and the distribution may change between training and deployment. Such settings induce spurious state-action…

Machine Learning · Computer Science 2026-02-02 Shi Bo , AmirEmad Ghassami

Instrumental variable (IV) methods are widely used to infer treatment effects in the presence of unmeasured confounding. In this paper, we study nonparametric inference with an IV under a separable binary treatment choice model, which…

Methodology · Statistics 2026-02-03 Chan Park , Eric Tchetgen Tchetgen

Exogenous heterogeneity, for example, in the form of instrumental variables can help us learn a system's underlying causal structure and predict the outcome of unseen intervention experiments. In this paper, we consider linear models in…

Methodology · Statistics 2024-10-21 Niklas Pfister , Jonas Peters

Bridging the gap between internal and external validity is crucial for heterogeneous treatment effect estimation. Randomised controlled trials (RCTs), favoured for their internal validity due to randomisation, often encounter challenges in…

In-context learning (ICL) allows Transformers to adapt to novel tasks without weight updates, yet the underlying algorithms remain poorly understood. We adopt a statistical decision-theoretic perspective by investigating simple binary…

Machine Learning · Computer Science 2026-03-13 Faris Chaudhry , Siddhant Gadkari

This paper studies the confounding effects from the unmeasured confounders and the imbalance of observed confounders in IV regression and aims at unbiased causal effect estimation. Recently, nonlinear IV estimators were proposed to allow…

Artificial Intelligence · Computer Science 2022-11-21 Anpeng Wu , Kun Kuang , Ruoxuan Xiong , Bo Li , Fei Wu

Instrumental variables (IV) estimation suffers selection bias when the analysis conditions on the treatment. Judea Pearl's early graphical definition of instrumental variables explicitly prohibited conditioning on the treatment.…

Econometrics · Economics 2020-05-20 Felix Elwert , Elan Segarra

Despite having achieved great success for sentiment analysis, existing neural models struggle with implicit sentiment analysis. This may be due to the fact that they may latch onto spurious correlations ("shortcuts", e.g., focusing only on…

Computation and Language · Computer Science 2022-08-22 Siyin Wang , Jie Zhou , Changzhi Sun , Junjie Ye , Tao Gui , Qi Zhang , Xuanjing Huang