English
Related papers

Related papers: Testing Causality for High Dimensional Data

200 papers

Causal and attribution studies are essential for earth scientific discoveries and critical for informing climate, ecology, and water policies. However, the current generation of methods needs to keep pace with the complexity of scientific…

Applications · Statistics 2022-09-27 Elizabeth Eldhose , Tejasvi Chauhan , Vikram Chandel , Subimal Ghosh , Auroop R. Ganguly

Determining the causes of extreme events is a fundamental question in many scientific fields. An important aspect when modelling multivariate extremes is the tail dependence. In application, the extreme dependence structure may…

Methodology · Statistics 2022-12-21 Juraj Bodik , Linda Mhalla , Valérie Chavez-Demoulin

Causal inference is a critical research topic across many domains, such as statistics, computer science, education, public policy and economics, for decades. Nowadays, estimating causal effect from observational data has become an appealing…

Methodology · Statistics 2020-02-10 Liuyi Yao , Zhixuan Chu , Sheng Li , Yaliang Li , Jing Gao , Aidong Zhang

This PhD thesis contains several contributions to the field of statistical causal modeling. Statistical causal models are statistical models embedded with causal assumptions that allow for the inference and reasoning about the behavior of…

Machine Learning · Statistics 2021-10-05 Martin Emil Jakobsen

We present a sample path dependent measure of causal influence between two time series. The proposed measure is a random variable whose expected sum is the directed information. A realization of the proposed measure may be used to identify…

Information Theory · Computer Science 2018-10-15 Gabriel Schamberg , Todd P. Coleman

Machine learning algorithms are designed to capture complex relationships between features. In this context, the high dimensionality of data often results in poor model performance, with the risk of overfitting. Feature selection, the…

Machine Learning · Computer Science 2023-10-18 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

New text as data techniques offer a great promise: the ability to inductively discover measures that are useful for testing social science theories of interest from large collections of text. We introduce a conceptual framework for making…

Machine Learning · Statistics 2018-02-08 Naoki Egami , Christian J. Fong , Justin Grimmer , Margaret E. Roberts , Brandon M. Stewart

Methods that infer causal dependence from observational data are central to many areas of science, including medicine, economics, and the social sciences. A variety of theoretical properties of these methods have been proven, but empirical…

Methodology · Statistics 2021-07-08 Amanda Gentzel , Purva Pruthi , David Jensen

We present a new method for causal discovery in linear structural equation models. We propose a simple ``trick'' based on statistical testing in linear models that can distinguish between ancestors and non-ancestors of any given variable.…

Methodology · Statistics 2023-03-15 Christoph Schultheiss , Peter Bühlmann

Like natural complex systems such as the Earth's climate or a living cell, semiconductor lithography systems are characterized by nonlinear dynamics across more than a dozen orders of magnitude in space and time. Thousands of sensors…

Information Theory · Computer Science 2021-04-07 Errol Zalmijn , Tom Heskes , Tom Claassen

In this work, we consider causal inference in various high-dimensional treatment settings, including for single multi-valued treatments and vector treatments with binary or continuous components, when the number of treatments can be…

Statistics Theory · Mathematics 2026-02-26 Patrick Kramer , Edward H. Kennedy , Isaac M. Opper

Causal inference is central to statistics and scientific discovery, enabling researchers to identify cause-and-effect relationships beyond associations. While traditionally studied within Euclidean spaces, contemporary applications…

Methodology · Statistics 2025-07-01 Satarupa Bhattacharjee , Bing Li , Xiao Wu , Lingzhou Xue

Survey scientists increasingly face the problem of high-dimensionality in their research as digitization makes it much easier to construct high-dimensional (or "big") data sets through tools such as online surveys and mobile applications.…

Methodology · Statistics 2021-02-19 Barbara Felderer , Jannis Kueck , Martin Spindler

Obtaining valid treatment effect inference remains a challenging problem when dealing with numerous instruments and non-sparse control variables. In this paper, we propose a novel ridge regularization-based instrumental variables method for…

Econometrics · Economics 2025-10-17 Xiduo Chen , Xingdong Feng , Antonio F. Galvao , Yeheng Ge

Poly-trees are singly connected causal networks in which variables may arise from multiple causes. This paper develops a method of recovering ply-trees from empirically measured probability distributions of pairs of variables. The method…

Artificial Intelligence · Computer Science 2013-04-11 George Rebane , Judea Pearl

Nonlinear causal discovery from observational data imposes strict identifiability assumptions on the formulation of structural equations utilized in the data generating process. The evaluation of structure learning methods under assumption…

Machine Learning · Statistics 2024-12-17 Georg Velev , Stefan Lessmann

Entropic causal inference is a framework for inferring the causal direction between two categorical variables from observational data. The central assumption is that the amount of unobserved randomness in the system is not too large. This…

Machine Learning · Statistics 2021-01-12 Spencer Compton , Murat Kocaoglu , Kristjan Greenewald , Dmitriy Katz

We introduce a framework for estimating causal effects of binary and continuous treatments in high dimensions. We show how posterior distributions of treatment and outcome models can be used together with doubly robust estimators. We…

Methodology · Statistics 2020-10-06 Joseph Antonelli , Georgia Papadogeorgou , Francesca Dominici

Many statistical applications require the quantification of joint dependence among more than two random vectors. In this work, we generalize the notion of distance covariance to quantify joint dependence among d >= 2 random vectors. We…

Methodology · Statistics 2018-06-18 Shubhadeep Chakraborty , Xianyang Zhang

Predicting the effect of interventions with many possible variations, e.g., therapeutic content that affects mental health outcomes or an earnings call transcript that drives movement in share price, is useful across several domains.…

Machine Learning · Computer Science 2026-05-27 Nikita Dhawan , Arnav Paruthi , Andrew Kim , Lovedeep Gondara , Jekaterina Novikova , Chris J. Maddison