English
Related papers

Related papers: Conditional independence testing: a predictive per…

200 papers

We introduce an independence criterion based on entropy regularized optimal transport. Our criterion can be used to test for independence between two samples. We establish non-asymptotic bounds for our test statistic and study its…

Machine Learning · Statistics 2022-04-21 Lang Liu , Soumik Pal , Zaid Harchaoui

This paper studies the connection between probabilistic conditional independence in uncertain reasoning and data dependency in relational databases. As a demonstration of the usefulness of this preliminary investigation, an alternate proof…

Artificial Intelligence · Computer Science 2013-02-28 Michael S. K. M. Wong , Z. W. Wang

We propose consistent nonparametric tests of conditional independence for time series data. Our methods are motivated from the difference between joint conditional cumulative distribution function (CDF) and the product of conditional CDFs.…

Econometrics · Economics 2021-10-12 Xiaojun Song , Haoyu Wei

A fundamental task in AI is to assess (in)dependence between mixed-type variables (text, image, sound). We propose a Bayesian kernelised correlation test of (in)dependence using a Dirichlet process model. The new measure of (in)dependence…

Machine Learning · Statistics 2021-05-11 Alessio Benavoli , Cassio de Campos

Causal discovery is to learn cause-effect relationships among variables given observational data and is important for many applications. Existing causal discovery methods assume data sufficiency, which may not be the case in many real world…

Machine Learning · Computer Science 2022-06-20 Zijun Cui , Naiyu Yin , Yuru Wang , Qiang Ji

We study the problem of testing \emph{conditional independence} for discrete distributions. Specifically, given samples from a discrete random variable $(X, Y, Z)$ on domain $[\ell_1]\times[\ell_2] \times [n]$, we want to distinguish, with…

Data Structures and Algorithms · Computer Science 2018-07-03 Clément L. Canonne , Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

We propose a coefficient of conditional dependence between two random variables $Y$ and $Z$ given a set of other variables $X_1,\ldots,X_p$, based on an i.i.d. sample. The coefficient has a long list of desirable properties, the most…

Statistics Theory · Mathematics 2021-03-30 Mona Azadkia , Sourav Chatterjee

Local structure such as context-specific independence (CSI) has received much attention in the probabilistic graphical model (PGM) literature, as it facilitates the modeling of large complex systems, as well as for reasoning with them. In…

Artificial Intelligence · Computer Science 2020-06-15 Yujia Shen , Arthur Choi , Adnan Darwiche

In high dimensional analysis, effects of explanatory variables on responses sometimes rely on certain exposure variables, such as time or environmental factors. In this paper, to characterize the importance of each predictor, we utilize its…

Methodology · Statistics 2018-04-11 Yeqing Zhou , Jingyuan Liu , Zhihui Hao , Liping Zhu

It is well known that conditional independence can be used to factorize a joint probability into a multiplication of conditional probabilities. This paper proposes a constructive definition of inter-causal independence, which can be used to…

Artificial Intelligence · Computer Science 2013-02-28 Nevin Lianwen Zhang , David L Poole

In this paper we use e-values in the context of multiple hypothesis testing assuming that the base tests produce independent, or sequential, e-values. Our simulation and empirical studies and theoretical considerations suggest that, under…

Methodology · Statistics 2024-08-14 Vladimir Vovk , Ruodu Wang

A new test of independence between random elements is presented in this article. The test is based on a functional of the Cram\'{e}r-von Mises type, which is applied to a $U$-process that is defined from the recurrence rates. Theorems of…

Statistics Theory · Mathematics 2019-08-12 Juan Kalemkerian , Diego Fernández

We consider the problem of learning the causal MAG of a system from observational data in the presence of latent variables and selection bias. Constraint-based methods are one of the main approaches for solving this problem, but the…

Machine Learning · Computer Science 2021-10-26 Sina Akbari , Ehsan Mokhtarian , AmirEmad Ghassami , Negar Kiyavash

Prediction with the possibility of abstention (or selective prediction) is an important problem for error-critical machine learning applications. While well-studied in the classification setup, selective approaches to regression are much…

Machine Learning · Statistics 2023-09-29 Fedor Noskov , Alexander Fishkov , Maxim Panov

Intelligent test requires efficient and effective analysis of high-dimensional data in a large scale. Traditionally, the analysis is often conducted by human experts, but it is not scalable in the era of big data. To tackle this challenge,…

Machine Learning · Computer Science 2022-07-04 Yiwen Liao , Tianjie Ge , Raphaël Latty , Bin Yang

We study a class of determinantal ideals that are related to conditional independence (CI) statements with hidden variables. Such CI statements correspond to determinantal conditions on a matrix whose entries are probabilities of events…

Commutative Algebra · Mathematics 2023-01-02 Oliver Clarke , Fatemeh Mohammadi , Johannes Rauh

We consider the problem of conditional independence testing: given a response Y and covariates (X,Z), we test the null hypothesis that Y is independent of X given Z. The conditional randomization test (CRT) was recently proposed as a way to…

Methodology · Statistics 2021-06-07 Molei Liu , Eugene Katsevich , Lucas Janson , Aaditya Ramdas

Probabilistic independence can dramatically simplify the task of eliciting, representing, and computing with probabilities in large domains. A key technique in achieving these benefits is the idea of graphical modeling. We survey existing…

Artificial Intelligence · Computer Science 2013-02-21 Fahiem Bacchus , Adam J. Grove

Causal discovery from observational data is a fundamental task in artificial intelligence, with far-reaching implications for decision-making, predictions, and interventions. Despite significant advances, existing methods can be broadly…

Machine Learning · Computer Science 2026-02-06 Jincheng Zhou , Mengbo Wang , Anqi He , Yumeng Zhou , Hessam Olya , Murat Kocaoglu , Bruno Ribeiro

The inferential model (IM) framework provides valid prior-free probabilistic inference by focusing on predicting unobserved auxiliary variables. But, efficient IM-based inference can be challenging when the auxiliary variable is of higher…

Statistics Theory · Mathematics 2015-01-20 Ryan Martin , Chuanhai Liu