English
Related papers

Related papers: IV-ICL: Bounding Causal Effects with Instrumental …

200 papers

Many policy evaluations using instrumental variable (IV) methods include individuals who interact with each other, potentially violating the standard IV assumptions. This paper defines and partially identifies direct and spillover effects…

Econometrics · Economics 2025-09-17 Didier Nibbering , Matthijs Oosterveen

Causal effect moderation investigates how the effect of interventions (or treatments) on outcome variables changes based on observed characteristics of individuals, known as potential effect moderators. With advances in data collection,…

Methodology · Statistics 2024-11-26 Soham Bakshi , Walter Dempsey , Snigdha Panigrahi

Instrumental variables allow for quantification of cause and effect relationships even in the absence of interventions. To achieve this, a number of causal assumptions must be met, the most important of which is the independence assumption,…

Machine Learning · Statistics 2021-11-05 Nikolai Miklin , Mariami Gachechiladze , George Moreno , Rafael Chaves

Instrument variable (IV) methods are widely used in empirical research to identify causal effects of a policy. In the local average treatment effect (LATE) framework, the IV estimand identifies the LATE under three main assumptions: random…

Econometrics · Economics 2025-03-21 Désiré Kédagni , Huan Wu , Yi Cui

Incremental Learning (IL) is useful when artificial systems need to deal with streams of data and do not have access to all data at all times. The most challenging setting requires a constant complexity of the deep model and an incremental…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

This paper provides a critical review of the Bayesian perspective of causal inference based on the potential outcomes framework. We review the causal estimands, identification assumptions, the general structure of Bayesian inference of…

Methodology · Statistics 2022-10-25 Fan Li , Peng Ding , Fabrizia Mealli

In-context learning (ICL) is an emerging capability of large autoregressive language models where a few input-label demonstrations are appended to the input to enhance the model's understanding of downstream NLP tasks, without directly…

Computation and Language · Computer Science 2023-10-31 Zhuocheng Gong , Jiahao Liu , Qifan Wang , Jingang Wang , Xunliang Cai , Dongyan Zhao , Rui Yan

A major challenge in instrumental variables (IV) analysis is to find instruments that are valid, or have no direct effect on the outcome and are ignorable. Typically one is unsure whether all of the putative IVs are in fact valid. We…

Statistics Theory · Mathematics 2017-08-10 Zijian Guo , Hyunseung Kang , T. Tony Cai , Dylan S. Small

Supervised causal learning has shown promise in causal discovery, yet it often struggles with generalization across diverse interventional settings, particularly when intervention targets are unknown. To address this, we propose TICL…

Machine Learning · Computer Science 2026-02-24 Wei Chen , Rui Ding , Bojun Huang , Yang Zhang , Qiang Fu , Yuxuan Liang , Han Shi , Dongmei Zhang

In-context learning (ICL), which promotes inference with several demonstrations, has become a widespread paradigm to stimulate LLM capabilities for downstream tasks. Due to context length constraints, it cannot be further improved in spite…

Computation and Language · Computer Science 2024-06-04 Jiahao Li , Quan Wang , Licheng Zhang , Guoqing Jin , Zhendong Mao

Large language models (LLMs) have initiated a paradigm shift in transfer learning. In contrast to the classic pretraining-then-finetuning procedure, in order to use LLMs for downstream prediction tasks, one only needs to provide a few…

Computation and Language · Computer Science 2025-09-16 Chi Han , Ziqi Wang , Han Zhao , Heng Ji

We address the problem of causal effect estimation where hidden confounders are present, with a focus on two settings: instrumental variable regression with additional observed confounders, and proxy causal learning. Our approach uses a…

Machine Learning · Computer Science 2025-03-12 Haotian Sun , Antoine Moulin , Tongzheng Ren , Arthur Gretton , Bo Dai

Causal sensitivity analysis aims to provide bounds for causal effect estimates in the presence of unobserved confounding. However, existing methods for causal sensitivity analysis are per-instance procedures, meaning that changes to the…

Machine Learning · Statistics 2026-05-12 Emil Javurek , Dennis Frauen , Marie Brockschmidt , Jonas Schweisthal , Stefan Feuerriegel

Large Language Models (LLMs) have showcased their In-Context Learning (ICL) capabilities, enabling few-shot learning without the need for gradient updates. Despite its advantages, the effectiveness of ICL heavily depends on the choice of…

Computation and Language · Computer Science 2024-06-19 Vinay M. S. , Minh-Hao Van , Xintao Wu

Instrumental variables have proven useful, in particular within the social sciences and economics, for making inference about the causal effect of a random variable, B, on another random variable, C, in the presence of unobserved…

Methodology · Statistics 2012-06-26 Roland R. Ramsahai

In-context learning (ICL) is one of the surprising and useful features of large language models and subject of intense research. Recently, stylized meta-learning-like ICL setups have been devised that train transformers on sequences of…

Machine Learning · Computer Science 2024-04-16 Madhur Panwar , Kabir Ahuja , Navin Goyal

Recent work analyzing in-context learning (ICL) has identified a broad set of strategies that describe model behavior in different experimental conditions. We aim to unify these findings by asking why a model learns these disparate…

Machine Learning · Computer Science 2025-06-27 Daniel Wurgaft , Ekdeep Singh Lubana , Core Francisco Park , Hidenori Tanaka , Gautam Reddy , Noah D. Goodman

Mediation analysis is a strategy for understanding the mechanisms by which treatments or interventions affect later outcomes. Mediation analysis is frequently applied in randomized trial settings, but typically assumes: a) that randomized…

Methodology · Statistics 2021-12-30 Kara E. Rudolph , Nicholas Williams , Ivan Diaz

Instrumental variable models allow us to identify a causal function between covariates $X$ and a response $Y$, even in the presence of unobserved confounding. Most of the existing estimators assume that the error term in the response $Y$…

Machine Learning · Statistics 2022-09-23 Sorawit Saengkyongam , Leonard Henckel , Niklas Pfister , Jonas Peters

One of the most fundamental problems in causal inference is the estimation of a causal effect when variables are confounded. This is difficult in an observational study, because one has no direct evidence that all confounders have been…

Machine Learning · Statistics 2014-11-03 Ricardo Silva , Robin Evans