English
Related papers

Related papers: Testing Conditional Independence on Discrete Data …

200 papers

Many questions in science center around the fundamental problem of understanding causal relationships. However, most constraint-based causal discovery algorithms, including the well-celebrated PC algorithm, often incur an exponential number…

Machine Learning · Computer Science 2024-06-05 Kirankumar Shiragur , Jiaqi Zhang , Caroline Uhler

Determining conditional independence (CI) relationships between random variables is a fundamental yet challenging task in machine learning and statistics, especially in high-dimensional settings. Existing generative model-based CI testing…

Machine Learning · Computer Science 2025-05-30 Yixin Ren , Chenghou Jin , Yewei Xia , Li Ke , Longtao Huang , Hui Xue , Hao Zhang , Jihong Guan , Shuigeng Zhou

We propose a method for inferring the conditional independence graph (CIG) of a high-dimensional Gaussian vector time series (discrete-time process) from a finite-length observation. By contrast to existing approaches, we do not rely on a…

Machine Learning · Statistics 2015-10-28 Alexander Jung

We consider the problem of learning the causal MAG of a system from observational data in the presence of latent variables and selection bias. Constraint-based methods are one of the main approaches for solving this problem, but the…

Machine Learning · Computer Science 2021-10-26 Sina Akbari , Ehsan Mokhtarian , AmirEmad Ghassami , Negar Kiyavash

Constraint-based causal discovery methods leverage conditional independence tests to infer causal relationships in a wide variety of applications. Just as the majority of machine learning methods, existing work focuses on studying…

Machine Learning · Statistics 2024-05-27 Siyuan Guo , Viktor Tóth , Bernhard Schölkopf , Ferenc Huszár

Causal effect identification considers whether an interventional probability distribution can be uniquely determined from a passively observed distribution in a given causal structure. If the generating system induces context-specific…

Artificial Intelligence · Computer Science 2024-07-03 Santtu Tikka , Antti Hyttinen , Juha Karvanen

Conditional randomization tests (CRTs) assess whether a variable $x$ is predictive of another variable $y$, having observed covariates $z$. CRTs require fitting a large number of predictive models, which is often computationally…

Methodology · Statistics 2023-04-12 Mukund Sudarshan , Aahlad Manas Puli , Wesley Tansey , Rajesh Ranganath

Conditional independence (CI) testing is a fundamental and challenging task in modern statistics and machine learning. Many modern methods for CI testing rely on powerful supervised learning methods to learn regression functions or Bayes…

Machine Learning · Statistics 2023-10-31 Felipe Maia Polo , Yuekai Sun , Moulinath Banerjee

Identifying relationships among stochastic processes is a core objective in many fields, such as economics. While the standard toolkit for multivariate time series analysis has many advantages, it can be difficult to capture nonlinear…

Methodology · Statistics 2026-05-06 Michael Wieck-Sosa , Michel F. C. Haddad , Aaditya Ramdas

Causal Structure Learning (CSL), also referred to as causal discovery, amounts to extracting causal relations among variables in data. CSL enables the estimation of causal effects from observational data alone, avoiding the need to perform…

Machine Learning · Computer Science 2025-02-12 Fabrizio Russo , Francesca Toni

Probabilistic independence is a useful concept for describing the result of random sampling---a basic operation in all probabilistic languages---and for reasoning about groups of random variables. Nevertheless, existing verification methods…

Programming Languages · Computer Science 2020-07-21 Gilles Barthe , Justin Hsu , Kevin Liao

This paper develops a model-free sequential test for conditional independence. The proposed test allows researchers to analyze an incoming i.i.d. data stream with any arbitrary dependency structure, and safely conclude whether a feature is…

Methodology · Statistics 2023-02-21 Shalev Shaer , Gal Maman , Yaniv Romano

It is well-known that the notion of (strong) conditional independence (CI) is too restrictive to capture independencies that only hold in certain contexts. This kind of contextual independency, called context-strong independence (CSI), can…

Artificial Intelligence · Computer Science 2013-01-30 Michael S. K. M. Wong , C. J. Butz

Independence testing plays a central role in statistical and causal inference from observational data. Standard independence tests assume that the data samples are independent and identically distributed (i.i.d.) but that assumption is…

Machine Learning · Statistics 2022-07-04 Ragib Ahsan , Zahra Fatemi , David Arbour , Elena Zheleva

One of the common obstacles for learning causal models from data is that high-order conditional independence (CI) relationships between random variables are difficult to estimate. Since CI tests with conditioning sets of low order can be…

Machine Learning · Computer Science 2020-10-07 Marcel Wienöbst , Maciej Liśkiewicz

This work addresses testing the independence of two continuous and finite-dimensional random variables from the design of a data-driven partition. The empirical log-likelihood statistic is adopted to approximate the sufficient statistics of…

Machine Learning · Statistics 2022-01-19 Mauricio E. Gonzalez , Jorge F. Silva , Miguel Videla , Marcos E. Orchard

Compositional data (i.e., data comprising random variables that sum up to a constant) arises in many applications including microbiome studies, chemical ecology, political science, and experimental designs. Yet when compositional data serve…

Methodology · Statistics 2025-01-03 Ritwik Bhaduri , Siyuan Ma , Lucas Janson

We consider the problem of conditional independence testing: given a response Y and covariates (X,Z), we test the null hypothesis that Y is independent of X given Z. The conditional randomization test (CRT) was recently proposed as a way to…

Methodology · Statistics 2021-06-07 Molei Liu , Eugene Katsevich , Lucas Janson , Aaditya Ramdas

We investigate the sample complexity of mutual information and conditional mutual information testing. For conditional mutual information testing, given access to independent samples of a triple of random variables $(A, B, C)$ with unknown…

Data Structures and Algorithms · Computer Science 2025-06-05 Jan Seyfried , Sayantan Sen , Marco Tomamichel

The paper introduces robust independence tests with non-asymptotically guaranteed significance levels for stochastic linear time-invariant systems, assuming that the observed outputs are synchronous, which means that the systems are driven…

Machine Learning · Statistics 2023-08-07 Ambrus Tamás , Dániel Ágoston Bálint , Balázs Csanád Csáji