English
Related papers

Related papers: Testing Causality for High Dimensional Data

200 papers

Linear causal models are important tools for modeling causal dependencies and yet in practice, only a subset of the variables can be observed. In this paper, we examine the parameter identifiability of these models by investigating whether…

Machine Learning · Computer Science 2025-02-11 Xinshuai Dong , Ignavier Ng , Biwei Huang , Yuewen Sun , Songyao Jin , Roberto Legaspi , Peter Spirtes , Kun Zhang

We are interested in learning causal relationships between pairs of random variables, purely from observational data. To effectively address this task, the state-of-the-art relies on strong assumptions regarding the mechanisms mapping…

Machine Learning · Statistics 2014-09-16 David Lopez-Paz , Krikamol Muandet , Benjamin Recht

We present a domain-general account of causation that applies to settings in which macro-level causal relations between two systems are of interest, but the relevant causal features are poorly understood and have to be aggregated from vast…

Machine Learning · Statistics 2015-12-29 Krzysztof Chalupka , Pietro Perona , Frederick Eberhardt

Graph or network representations are an important foundation for data mining and machine learning tasks in relational data. Many tools of network analysis, like centrality measures, information ranking, or cluster detection rest on the…

Social and Information Networks · Computer Science 2022-02-10 Luka V. Petrovic , Ingo Scholtes

We provide a unified analysis of the predictive risk of ridge regression and regularized discriminant analysis in a dense random effects model. We work in a high-dimensional asymptotic regime where $p, n \to \infty$ and $p/n \to \gamma \in…

Statistics Theory · Mathematics 2015-11-05 Edgar Dobriban , Stefan Wager

Linear discriminant analysis is a widely used method for classification. However, the high dimensionality of predictors combined with small sample sizes often results in large classification errors. To address this challenge, it is crucial…

Machine Learning · Statistics 2025-01-09 Hongzhe Zhang , Arnab Auddy , Hongzhe Lee

Causal discovery problems use a set of observations to deduce causality between variables in the real world, typically to answer questions about biological or physical systems. These observations are often recorded at regular time…

Signal Processing · Electrical Eng. & Systems 2026-02-24 Kurt Butler , Damian Machlanski , Panagiotis Dimitrakopoulos , Sotirios A. Tsaftaris

We address the problem of inferring the causal direction between two variables by comparing the least-squares errors of the predictions in both possible directions. Under the assumption of an independence between the function relating cause…

Artificial Intelligence · Computer Science 2019-01-25 Patrick Blöbaum , Dominik Janzing , Takashi Washio , Shohei Shimizu , Bernhard Schölkopf

We address the problem of inferring the causal direction between a continuous variable $X$ and a discrete variable $Y$ from observational data. For the model $X \to Y$, we adopt the threshold model used in prior work. For the model $Y \to…

Machine Learning · Computer Science 2026-02-27 Takashi Nicholas Maeda , Shohei Shimizu , Hidetoshi Matsui

Bipartite experiments arise in various fields, in which the treatments are randomized over one set of units, while the outcomes are measured over another separate set of units. However, existing methods often rely on strong model…

Methodology · Statistics 2025-04-16 Sizhu Lu , Lei Shi , Yue Fang , Wenxin Zhang , Peng Ding

We describe a method that infers whether statistical dependences between two observed variables X and Y are due to a "direct" causal link or only due to a connecting causal path that contains an unobserved variable of low complexity, e.g.,…

Machine Learning · Computer Science 2012-02-20 Dominik Janzing , Eleni Sgouritsa , Oliver Stegle , Jonas Peters , Bernhard Schoelkopf

A methodology for high dimensional causal inference in a time series context is introduced. It is assumed that there is a monotonic transformation of the data such that the dynamics of the transformed variables are described by a Gaussian…

Methodology · Statistics 2023-07-07 Francesco Cordoni , Alessio Sancetta

Methods to identify cause-effect relationships currently mostly assume the variables to be scalar random variables. However, in many fields the objects of interest are vectors or groups of scalar variables. We present a new constraint-based…

Methodology · Statistics 2022-12-02 Jonas Wahl , Urmi Ninad , Jakob Runge

A fundamental challenge of scientific research is inferring causal relations based on observed data. One commonly used approach involves utilizing structural causal models that postulate noisy functional relations among interacting…

Methodology · Statistics 2024-08-13 David Strieder , Mathias Drton

The research questions that motivate transportation safety studies are causal in nature. Safety researchers typically use observational data to answer such questions, but often without appropriate causal inference methodology. The field of…

Applications · Statistics 2011-07-26 Vishesh Karwa , Aleksandra B. Slavković , Eric T. Donnell

We introduce a rigorous mathematical framework for Granger causality in extremes, designed to identify causal links from extreme events in time series. Granger causality plays a pivotal role in uncovering directional relationships among…

Machine Learning · Statistics 2024-10-21 Juraj Bodik , Olivier C. Pasche

This paper proposes methods of estimation and uniform inference for a general class of causal functions, such as the conditional average treatment effects and the continuous treatment effects, under multiway clustering. The causal function…

Econometrics · Economics 2024-09-11 Nan Liu , Yanbo Liu , Yuya Sasaki

The problem of using observed correlations to infer causal relations is relevant to a wide variety of scientific disciplines. Yet given correlations between just two classical variables, it is impossible to determine whether they arose from…

Randomised controlled trials (RCTs) are the most effective approach to causal discovery, but in many circumstances it is impossible to conduct RCTs. Therefore observational studies based on passively observed data are widely accepted as an…

Artificial Intelligence · Computer Science 2016-11-11 Jiuyong Li , Thuc Duy Le , Lin Liu , Jixue Liu , Zhou Jin , Bingyu Sun , Saisai Ma

Causal discovery and causal effect estimation are two fundamental tasks in causal inference. While many methods have been developed for each task individually, statistical challenges arise when applying these methods jointly: estimating…

Methodology · Statistics 2024-08-21 Paula Gradu , Tijana Zrnic , Yixin Wang , Michael I. Jordan