English
Related papers

Related papers: Model-Powered Conditional Independence Test

200 papers

Deep learning methods have proved highly effective for classification and image recognition problems. In this paper, we ask whether this success can be transferred to hypothesis testing: if a neural network can distinguish, for example, an…

Machine Learning · Statistics 2026-04-30 Gery Geenens , Pierre Lafaye de Micheaux , Ivan Muyun Zou

Linear independence testing is a fundamental information-theoretic and statistical problem that can be posed as follows: given $n$ points $\{(X_i,Y_i)\}^n_{i=1}$ from a $p+q$ dimensional multivariate distribution where $X_i \in…

Machine Learning · Statistics 2016-01-26 Aaditya Ramdas , David Isenberg , Aarti Singh , Larry Wasserman

We study the problem of testing the null hypothesis that X and Y are conditionally independent given Z, where each of X, Y and Z may be functional random variables. This generalises testing the significance of X in a regression model of…

Statistics Theory · Mathematics 2023-09-27 Anton Rask Lundborg , Rajen D. Shah , Jonas Peters

Real-life statistical samples are often plagued by selection bias, which complicates drawing conclusions about the general population. When learning causal relationships between the variables is of interest, the sample may be assumed to be…

Statistics Theory · Mathematics 2018-11-15 Angelos P. Armen , Robin J. Evans

We propose a new algorithmic framework for sequential hypothesis testing with i.i.d. data, which includes A/B testing, nonparametric two-sample testing, and independence testing as special cases. It is novel in several ways: (a) it takes…

Machine Learning · Statistics 2016-03-03 Akshay Balsubramani , Aaditya Ramdas

We consider the problem of goodness-of-fit testing for a model that has at least one unknown parameter that cannot be eliminated by transformation. Examples of such problems can be as simple as testing whether a sample consists of…

Methodology · Statistics 2021-04-28 Sean van der Merwe

It is well-known that the notion of (strong) conditional independence (CI) is too restrictive to capture independencies that only hold in certain contexts. This kind of contextual independency, called context-strong independence (CSI), can…

Artificial Intelligence · Computer Science 2013-01-30 Michael S. K. M. Wong , C. J. Butz

This paper shows that the problem of testing hypotheses in moment condition models without any assumptions about identification may be considered as a problem of testing with an infinite-dimensional nuisance parameter. We introduce a…

Statistics Theory · Mathematics 2014-09-24 Isaiah Andrews , Anna Mikusheva

Inferring the causal structure underlying stochastic dynamical systems from observational data holds great promise in domains ranging from science and health to finance. Such processes can often be accurately modeled via stochastic…

Machine Learning · Computer Science 2025-03-04 Georg Manten , Cecilia Casolo , Emilio Ferrucci , Søren Wengel Mogensen , Cristopher Salvi , Niki Kilbertus

Simulation-based inference methods that feature correct conditional coverage of confidence sets based on observations that have been compressed to a scalar test statistic require accurate modeling of either the p-value function or the…

Machine Learning · Statistics 2025-08-18 Ali Al Kadhim , Harrison B. Prosper

Bayesian networks provide a language for qualitatively representing the conditional independence properties of a distribution. This allows a natural and compact representation of the distribution, eases knowledge acquisition, and supports…

Artificial Intelligence · Computer Science 2013-02-18 Craig Boutilier , Nir Friedman , Moises Goldszmidt , Daphne Koller

The classic integrated conditional moment test is a promising method for testing regression model misspecification. However, it severely suffers from the curse of dimensionality. To extend it to handle the testing problem for parametric…

Statistics Theory · Mathematics 2020-05-26 Falong Tan , Lixing Zhu

We study a class of determinantal ideals that are related to conditional independence (CI) statements with hidden variables. Such CI statements correspond to determinantal conditions on a matrix whose entries are probabilities of events…

Commutative Algebra · Mathematics 2023-01-02 Oliver Clarke , Fatemeh Mohammadi , Johannes Rauh

Experiments often yield non-identically distributed data for statistical analysis. Tests of hypothesis under such set-ups are generally performed using the likelihood ratio test, which is non-robust with respect to outliers and model…

Statistics Theory · Mathematics 2017-07-25 Abhik Ghosh , Ayanendranath Basu

The paper introduces robust independence tests with non-asymptotically guaranteed significance levels for stochastic linear time-invariant systems, assuming that the observed outputs are synchronous, which means that the systems are driven…

Machine Learning · Statistics 2023-08-07 Ambrus Tamás , Dániel Ágoston Bálint , Balázs Csanád Csáji

Variable selection can be performed by testing conditional independence (CI) between each predictor and the response, given the other predictors. A doubly robust and powerful option for these CI tests is the projected covariance measure…

Methodology · Statistics 2025-11-10 Abhinav Chakraborty , Jeffrey Zhang , Eugene Katsevich

Understanding the effect of a feature vector $x \in \mathbb{R}^d$ on the response value (label) $y \in \mathbb{R}$ is the cornerstone of many statistical learning problems. Ideally, it is desired to understand how a set of collected…

Machine Learning · Computer Science 2023-06-22 Mohammad Mehrabi , Ryan A. Rossi

Causal discovery is a powerful technique for identifying causal relationships among variables in data. It has been widely used in various applications in software engineering. Causal discovery extensively involves conditional independence…

Software Engineering · Computer Science 2023-09-12 Pingchuan Ma , Zhenlan Ji , Peisen Yao , Shuai Wang , Kui Ren

In this work we consider the task of relaxing the i.i.d assumption in pattern recognition (or classification), aiming to make existing learning algorithms applicable to a wider range of tasks. Pattern recognition is guessing a discrete…

Machine Learning · Computer Science 2012-02-28 Daniil Ryabko

We consider testing multivariate conditional independence between a response Y and a covariate vector X given additional variables Z. We introduce the Multivariate Sufficient Statistic Conditional Randomization Test (MS-CRT), which…

Methodology · Statistics 2025-04-10 Xiaotong Lin , Jie Xie , Fangqiao Tian , Dongming Huang