English
Related papers

Related papers: Testing Causality for High Dimensional Data

200 papers

We study the problem of deriving policies, or rules, that when enacted on a complex system, cause a desired outcome. Absent the ability to perform controlled experiments, such rules have to be inferred from past observations of the system's…

Machine Learning · Computer Science 2020-09-09 Kailash Budhathoki , Mario Boley , Jilles Vreeken

A data science task can be deemed as making sense of the data or testing a hypothesis about it. The conclusions inferred from data can greatly guide us to make informative decisions. Big data has enabled us to carry out countless prediction…

Machine Learning · Computer Science 2022-01-12 Wenhao Zhang , Ramin Ramezani , Arash Naeim

Observational studies are a key resource for causal inference but are often affected by systematic biases. Prior work has focused mainly on detecting these biases, via sensitivity analyses and comparisons with randomized controlled trials,…

Methodology · Statistics 2025-06-03 Ilker Demirel , Zeshan Hussain , Piersilvio De Bartolomeis , David Sontag

Mendelian randomization (MR) is widely used to uncover causal relationships in the presence of unmeasured confounders. However, most existing MR methods presuppose linear causality, risking bias when the true relationships are nonlinear,…

Methodology · Statistics 2025-08-05 Xinpei Wang , Tao Huang , Jinzhu Jia

As the significance of understanding the cause-and-effect relationships among variables increases in the development of modern systems and algorithms, learning causality from observational data has become a preferred and efficient approach…

Machine Learning · Computer Science 2024-11-28 Xiaoxuan Li , Yao Liu , Ruoyu Wang , Lina Yao

Consider the case that one observes a single time-series, where at each time t one observes a data record O(t) involving treatment nodes A(t), possible covariates L(t) and an outcome node Y(t). The data record at time t carries information…

Statistics Theory · Mathematics 2021-02-04 Mark J. van der Laan , Ivana Malenica

A typical problem in causal modeling is the instability of model structure learning, i.e., small changes in finite data can result in completely different optimal models. The present work introduces a novel causal modeling algorithm for…

We develop new methods to integrate experimental and observational data in causal inference. While randomized controlled trials offer strong internal validity, they are often costly and therefore limited in sample size. Observational data,…

Econometrics · Economics 2025-11-04 Xuelin Yang , Licong Lin , Susan Athey , Michael I. Jordan , Guido W. Imbens

Thanks to technological advances leading to near-continuous time observations, emerging multivariate point process data offer new opportunities for causal discovery. However, a key obstacle in achieving this goal is that many relevant…

Machine Learning · Statistics 2021-12-15 Xu Wang , Ali Shojaie

We consider graphical models based on a recursive system of linear structural equations. This implies that there is an ordering, $\sigma$, of the variables such that each observed variable $Y_v$ is a linear function of a variable specific…

Methodology · Statistics 2019-06-28 Y. Samuel Wang , Mathias Drton

We address the problem of estimating causal effects from observational data in the presence of network confounding, a setting where both treatment assignment and observed outcomes of individuals may be influenced by their neighbors within a…

Machine Learning · Computer Science 2026-03-24 Abhishek Dalvi , Neil Ashtekar , Vasant Honavar

We propose a method to classify the causal relationship between two discrete variables given only the joint distribution of the variables, acknowledging that the method is subject to an inherent baseline error. We assume that the causal…

Machine Learning · Statistics 2016-11-07 Krzysztof Chalupka , Frederick Eberhardt , Pietro Perona

Entropic causal inference is a recent framework for learning the causal graph between two variables from observational data by finding the information-theoretically simplest structural explanation of the data, i.e., the model with smallest…

Machine Learning · Computer Science 2025-09-23 Spencer Compton , Kristjan Greenewald , Dmitriy Katz , Murat Kocaoglu

This study proposes a novel method for estimation and hypothesis testing in high-dimensional single-index models. We address a common scenario where the sample size and the dimension of regression coefficients are large and comparable.…

Statistics Theory · Mathematics 2024-04-30 Kazuma Sawaya , Yoshimasa Uematsu , Masaaki Imaizumi

The trace of a matrix function f(A), most notably of the matrix inverse, can be estimated stochastically using samples< x,f(A)x> if the components of the random vectors x obey an appropriate probability distribution. However such a…

Numerical Analysis · Mathematics 2021-08-26 Andreas Frommer , Mostafa Nasr Khalil , Gustavo Ramirez-Hidalgo

This paper serves as a literature review of methodology concerning the (modern) causal inference methods to address the causal estimand with observational/survey data that have been or will be used in social science research. Mainly, this…

Econometrics · Economics 2024-08-02 Guanghui Pan

Causal discovery for purely observational, categorical data is a long-standing challenging problem. Unlike continuous data, the vast majority of existing methods for categorical data focus on inferring the Markov equivalence class only,…

Methodology · Statistics 2022-12-20 Yang Ni , Bani Mallick

Methods of causal discovery aim to identify causal structures in a data driven way. Existing algorithms are known to be unstable and sensitive to statistical errors, and are therefore rarely used with biomedical or epidemiological data. We…

Methodology · Statistics 2024-07-01 Christine W Bang , Janine Witte , Ronja Foraita , Vanessa Didelez

The inaccessibility of controlled randomized trials due to inherent constraints in many fields of science has been a fundamental issue in causal inference. In this paper, we focus on distinguishing the cause from effect in the bivariate…

Machine Learning · Statistics 2021-02-23 Jean-Francois Ton , Dino Sejdinovic , Kenji Fukumizu

This article presents a randomized matrix-free method for approximating the trace of $f({\bf A})$, where ${\bf A}$ is a large symmetric matrix and $f$ is a function analytic in a closed interval containing the eigenvalues of ${\bf A}$. Our…

Numerical Analysis · Mathematics 2021-03-22 Eric Hallman , Devon Troester