English
Related papers

Related papers: Conditional independence test for categorical data…

200 papers

Test of independence is of fundamental importance in modern data analysis, with broad applications in variable selection, graphical models, and causal inference. When the data is high dimensional and the potential dependence signal is…

Methodology · Statistics 2023-06-13 Zhanrui Cai , Jing Lei , Kathryn Roeder

In this paper we explore the behaviour of dependent test statistics for testing of multiple hypothesis . To keep simplicity, we have considered a mixture normal model with equicorrelated correlation set up. With a simple linear…

Statistics Theory · Mathematics 2020-01-09 Rahul Roy , Subir Kumar Bhandari

We show how to estimate a model's test error from unlabeled data, on distributions very different from the training distribution, while assuming only that certain conditional independencies are preserved between train and test. We do not…

Machine Learning · Computer Science 2016-06-17 Jacob Steinhardt , Percy Liang

We show that the stochastic independence of real-valued random variables is equivalent to the conditional uncorrelation, where the conditioning takes place over the Cartesian products of intervals. Next, we express the mutual independence…

Statistics Theory · Mathematics 2025-11-04 Dawid Tarłowski

In categorical data analysis, several regression models have been proposed for hierarchically-structured response variables, e.g. the nested logit model. But they have been formally defined for only two or three levels in the hierarchy.…

Methodology · Statistics 2014-05-23 Jean Peyhardi , Catherine Trottier , Yann Guédon

Estimation of the conditional independence graph (CIG) of high-dimensional multivariate Gaussian time series from multi-attribute data is considered. Existing methods for graph estimation for such data are based on single-attribute models…

Machine Learning · Statistics 2025-12-09 Jitendra K. Tugnait

Constraint-based (CB) learning is a formalism for learning a causal network with a database D by performing a series of conditional-independence tests to infer structural information. This paper considers a new test of independence that…

Artificial Intelligence · Computer Science 2012-12-12 Denver Dash , Marek J. Druzdzel

We consider here together the inference questions and the change-point problem in Poisson autoregressions (see Tj{\o}stheim, 2012). The conditional mean (or intensity) of the process is involved as a non-linear function of it past values…

Statistics Theory · Mathematics 2013-05-09 Paul Doukhan , William Kengne

One of the common obstacles for learning causal models from data is that high-order conditional independence (CI) relationships between random variables are difficult to estimate. Since CI tests with conditioning sets of low order can be…

Machine Learning · Computer Science 2020-10-07 Marcel Wienöbst , Maciej Liśkiewicz

Estimating causal effects from observational data requires identifying valid adjustment sets. This task is especially challenging in realistic settings where latent confounding and feedback loops are present. Existing approaches typically…

Machine Learning · Computer Science 2026-05-08 Ana Leticia Garcez Vicente , Gijs van Seeventer , Saber Salehkaleybar

We propose a general new method, the conditional permutation test, for testing the conditional independence of variables $X$ and $Y$ given a potentially high-dimensional random vector $Z$ that may contain confounding factors. The proposed…

Methodology · Statistics 2019-05-08 Thomas B. Berrett , Yi Wang , Rina Foygel Barber , Richard J. Samworth

This paper presents and analyzes an approach to cluster-based inference for dependent data. The primary setting considered here is with spatially indexed data in which the dependence structure of observed random variables is characterized…

Statistics Theory · Mathematics 2022-11-16 Jianfei Cao , Christian Hansen , Damian Kozbur , Lucciano Villacorta

We show that the d -separation criterion constitutes a valid test for conditional independence relationships that are induced by feedback systems involving discrete variables.

Artificial Intelligence · Computer Science 2013-02-18 Judea Pearl , Rina Dechter

There has been much interest in the nonparametric testing of conditional independence in the econometric and statistical literature, but the simplest and potentially most useful method, based on the sample partial correlation, seems to have…

Statistics Theory · Mathematics 2020-05-27 Wicher Bergsma

A seminal result in the ICA literature states that for $AY = \varepsilon$, if the components of $\varepsilon$ are independent and at most one is Gaussian, then $A$ is identified up to sign and permutation of its rows (Comon, 1994). In this…

Statistics Theory · Mathematics 2024-03-21 Geert Mesters , Piotr Zwiernik

Several procedures have been recently proposed to test the simplifying assumption for conditional copulas. Instead of considering pointwise conditioning events, we study the constancy of the conditional dependence structure when some…

Methodology · Statistics 2020-08-24 Alexis Derumigny , Jean-David Fermanian , Aleksey Min

In this paper, we consider the problem of testing independence in high-dimensional settings with missing data. Building upon a recently proposed Kendall-based statistic, we introduce two new modifications specifically designed to…

Methodology · Statistics 2026-04-28 Marija Cuparić , Bojana Milošević , Jelena Radojević

Given well-shuffled data, can we determine whether the data items are statistically (in)dependent? Formally, we consider the problem of testing whether a set of exchangeable random variables are independent. We will show that this is…

Statistics Theory · Mathematics 2022-10-25 Marcus Hutter

Certain causal models involving unmeasured variables induce no independence constraints among the observed variables but imply, nevertheless, inequality contraints on the observed distribution. This paper derives a general formula for such…

Artificial Intelligence · Computer Science 2013-02-21 Judea Pearl

We consider sequential hypothesis testing based on observations which are received in groups of random size. The observations are assumed to be independent both within and between the groups. We assume that the group sizes are independent…

Methodology · Statistics 2021-10-11 Andrey Novikov , Xóchitl Itxel Popoca-Jiménez