English
Related papers

Related papers: Conditional independence ideals with hidden variab…

200 papers

Conditional Independence (CI) graphs are a type of probabilistic graphical models that are primarily used to gain insights about feature relationships. Each edge represents the partial correlation between the connected features which gives…

Machine Learning · Computer Science 2024-08-30 Harsh Shrivastava , Urszula Chajewska

We develope the framework of transitional conditional independence. For this we introduce transition probability spaces and transitional random variables. These constructions will generalize, strengthen and unify previous notions of…

Statistics Theory · Mathematics 2021-08-30 Patrick Forré

Conditional independence (CI) tests underlie many approaches to model testing and structure learning in causal inference. Most existing CI tests for categorical and ordinal data stratify the sample by the conditioning variables, perform…

Machine Learning · Statistics 2023-07-06 Ankur Ankan , Johannes Textor

Conditional independence (CI) testing is a fundamental and challenging task in modern statistics and machine learning. Many modern methods for CI testing rely on powerful supervised learning methods to learn regression functions or Bayes…

Machine Learning · Statistics 2023-10-31 Felipe Maia Polo , Yuekai Sun , Moulinath Banerjee

Testing conditional independence has many applications, such as in Bayesian network learning and causal discovery. Different test methods have been proposed. However, existing methods generally can not work when only discretized…

Machine Learning · Statistics 2025-03-19 Boyang Sun , Yu Yao , Guang-Yuan Hao , Yumou Qiu , Kun Zhang

Logical inference algorithms for conditional independence (CI) statements have important applications from testing consistency during knowledge elicitation to constraintbased structure learning of graphical models. We prove that the…

Artificial Intelligence · Computer Science 2012-05-14 Mathias Niepert

Notions of counterfactual invariance (CI) have proven essential for predictors that are fair, robust, and generalizable in the real world. We propose graphical criteria that yield a sufficient condition for a predictor to be…

Machine Learning · Computer Science 2024-08-12 Francesco Quinzan , Cecilia Casolo , Krikamol Muandet , Yucen Luo , Niki Kilbertus

Causal models with unobserved variables impose nontrivial constraints on the distributions over the observed variables. When a common cause of two variables is unobserved, it is impossible to uncover the causal relation between them without…

Statistics Theory · Mathematics 2021-12-14 Beata Zjawin , Elie Wolfe , Robert W. Spekkens

The paper concerns the probabilistic evaluation of plans in the presence of unmeasured variables, each plan consisting of several concurrent or sequential actions. We establish a graphical criterion for recognizing when the effects of a…

Artificial Intelligence · Computer Science 2013-02-21 Judea Pearl , James M. Robins

Causal phenomena associated with rare events occur across a wide range of engineering problems, such as risk-sensitive safety analysis, accident analysis and prevention, and extreme value theory. However, current methods for causal…

Machine Learning · Statistics 2023-07-19 Chih-Yuan Chiu , Kshitij Kulkarni , Shankar Sastry

We investigate prime avoidance for an arbitrary set of prime ideals in a commutative ring. Various necessary and/or sufficient conditions for prime avoidance are given, which yield natural classes of infinite sets of primes that satisfy…

Commutative Algebra · Mathematics 2017-10-17 Justin Chen

We give a finite-sample analysis of predictive inference procedures after model selection in regression with random design. The analysis is focused on a statistically challenging scenario where the number of potentially important…

Statistics Theory · Mathematics 2009-08-26 Hannes Leeb

We propose a general new method, the conditional permutation test, for testing the conditional independence of variables $X$ and $Y$ given a potentially high-dimensional random vector $Z$ that may contain confounding factors. The proposed…

Methodology · Statistics 2019-05-08 Thomas B. Berrett , Yi Wang , Rina Foygel Barber , Richard J. Samworth

The framework of Inferential Models (IMs) has recently been developed in search of what is referred to as the holy grail of statistical theory, that is, prior-free probabilistic inference. Its method of Conditional IMs (CIMs) is a critical…

Statistics Theory · Mathematics 2023-01-13 Rongrong Zhang , Michael Y. Zhu , Chuanhai Liu

Causal inference methods based on conditional independence construct Markov equivalent graphs, and cannot be applied to bivariate cases. The approaches based on independence of cause and mechanism state, on the contrary, that causal…

Machine Learning · Computer Science 2021-08-04 Nataliya Sokolovska , Pierre-Henri Wuillemin

We consider the problem of learning the causal MAG of a system from observational data in the presence of latent variables and selection bias. Constraint-based methods are one of the main approaches for solving this problem, but the…

Machine Learning · Computer Science 2021-10-26 Sina Akbari , Ehsan Mokhtarian , AmirEmad Ghassami , Negar Kiyavash

We propose a test of the conditional independence of random variables $X$ and~$Y$ given~$Z$ under the additional assumption that $X$ is stochastically nondecreasing in~$Z$. The well-documented hardness of testing conditional independence…

Methodology · Statistics 2026-04-24 Rohan Hore , Jake A. Soloff , Rina Foygel Barber , Richard J. Samworth

Consider a high-dimensional linear regression problem, where the number of covariates is larger than the number of observations and the interest is in estimating the conditional variance of the response variable given the covariates. A…

Statistics Theory · Mathematics 2019-03-29 David Azriel

Conditional probabilities are a core concept in machine learning. For example, optimal prediction of a label $Y$ given an input $X$ corresponds to maximizing the conditional probability of $Y$ given $X$. A common approach to inference tasks…

Machine Learning · Computer Science 2017-08-09 Yoav Wald , Amir Globerson

The asymptotic tail behaviour of sums of independent subexponential random variables is well understood, one of the main characteristics being the principle of the single big jump. We study the case of dependent subexponential random…

Probability · Mathematics 2017-11-29 Sergey Foss , Andrew Richards