English
Related papers

Related papers: Conditional Independence Testing via Latent Repres…

200 papers

In this paper, we consider the problem of testing independence in high-dimensional settings with missing data. Building upon a recently proposed Kendall-based statistic, we introduce two new modifications specifically designed to…

Methodology · Statistics 2026-04-28 Marija Cuparić , Bojana Milošević , Jelena Radojević

This paper proposes some novel one-sided omnibus tests for independence between two multivariate stationary time series. These new tests apply the Hilbert-Schmidt independence criterion (HSIC) to test the independence between the…

Methodology · Statistics 2018-04-27 Guochang Wang , Wai Keung Li , Ke Zhu

We introduce a test for the conditional independence of random variables $X$ and $Y$ given a random variable $Z$, specifically by sampling from the joint distribution $(X,Y,Z)$, binning the support of the distribution of $Z$, and conducting…

Statistics Theory · Mathematics 2024-02-05 Andrew Warren

Causal discovery is to learn cause-effect relationships among variables given observational data and is important for many applications. Existing causal discovery methods assume data sufficiency, which may not be the case in many real world…

Machine Learning · Computer Science 2022-06-20 Zijun Cui , Naiyu Yin , Yuru Wang , Qiang Ji

Learning causal structure from observational data is especially challenging when latent variables or selection bias are present. The Fast Causal Inference (FCI) algorithm addresses this setting but performs exhaustive conditional…

Machine Learning · Computer Science 2025-11-06 Joseph Ramsey , Bryan Andrews , Peter Spirtes

Testing a hypothesized causal model against observational data is a key prerequisite for many causal inference tasks. A natural approach is to test whether the conditional independence relations (CIs) assumed in the model hold in the data.…

Machine Learning · Computer Science 2025-06-30 Hyunchai Jeong , Adiba Ejaz , Jin Tian , Elias Bareinboim

A key goal of unsupervised representation learning is "inverting" a data generating process to recover its latent properties. Existing work that provably achieves this goal relies on strong assumptions on relationships between the latent…

Machine Learning · Computer Science 2021-11-01 Kartik Ahuja , Jason Hartford , Yoshua Bengio

How reliable are single-response LLM-as-a-judge ratings without references, and can we obtain fine-grained, deterministic scores in this setting? We study the common practice of asking a judge model to assign Likert-scale scores to…

Computation and Language · Computer Science 2025-09-30 Leander Girrbach , Chi-Ping Su , Tankred Saanum , Richard Socher , Eric Schulz , Zeynep Akata

We study the problem of independence and conditional independence tests between categorical covariates and a continuous response variable, which has an immediate application in genetics. Instead of estimating the conditional distribution of…

Methodology · Statistics 2015-05-05 Bo Jiang , Chao Ye , Jun S. Liu

There has been much interest in the nonparametric testing of conditional independence in the econometric and statistical literature, but the simplest and potentially most useful method, based on the sample partial correlation, seems to have…

Statistics Theory · Mathematics 2020-05-27 Wicher Bergsma

Large language models (LLMs) increasingly serve as reasoners and automated evaluators, yet they remain susceptible to cognitive biases -- often altering their reasoning when faced with spurious prompt-level cues such as consensus claims or…

Computers and Society · Computer Science 2026-04-07 Qian Wang , Xuandong Zhao , Zirui Zhang , Zhanzhi Lou , Nuo Chen , Dawn Song , Bingsheng He

We study the problem of learning multivariate dependencies in nonparametric and high-dimensional settings. This includes but is not limited to graphical models. Our approach effectively combines several features that are missing from…

Statistics Theory · Mathematics 2026-03-31 Arash A. Amini , Bryon Aragam , Qing Zhou

So far, one-factor copulas induce conditional independence with respect to a latent factor. In this paper, we extend one-factor copulas to conditionally dependent models. This is achieved through new representations which allow to build new…

Methodology · Statistics 2016-12-12 Nathan Uyttendaele , Gildas Mazo

Current supervised learning can learn spurious correlation during the data-fitting process, imposing issues regarding interpretability, out-of-distribution (OOD) generalization, and robustness. To avoid spurious correlation, we propose a…

Machine Learning · Computer Science 2021-04-29 Xinwei Sun , Botong Wu , Xiangyu Zheng , Chang Liu , Wei Chen , Tao Qin , Tie-yan Liu

Test of independence is of fundamental importance in modern data analysis, with broad applications in variable selection, graphical models, and causal inference. When the data is high dimensional and the potential dependence signal is…

Methodology · Statistics 2023-06-13 Zhanrui Cai , Jing Lei , Kathryn Roeder

Our goal is to recover time-delayed latent causal variables and identify their relations from measured temporal data. Estimating causally-related latent variables from observations is particularly challenging as the latent variables are not…

Machine Learning · Statistics 2022-02-10 Weiran Yao , Yuewen Sun , Alex Ho , Changyin Sun , Kun Zhang

Inferring causal relationships from observed data is an important task, yet it becomes challenging when the data is subject to various external interferences. Most of these interferences are the additional effects of external factors on…

Machine Learning · Computer Science 2025-11-14 Ruichu Cai , Xiaokai Huang , Wei Chen , Zijian Li , Zhifeng Hao

Temporally causal representation learning aims to identify the latent causal process from time series observations, but most methods require the assumption that the latent causal processes do not have instantaneous relations. Although some…

Machine Learning · Computer Science 2026-01-21 Zijian Li , Yifan Shen , Kaitao Zheng , Ruichu Cai , Xiangchen Song , Mingming Gong , Guangyi Chen , Kun Zhang

We address the issue of the testability of instrumental variables derived from observational data. Most existing testable implications are centered on scenarios where the treatment is a discrete variable, e.g., instrumental inequality…

Methodology · Statistics 2026-03-13 Xichen Guo , Zheng Li , Biwei Huang , Yan Zeng , Zhi Geng , Feng Xie

In the context of an imperfect gold standard, latent class modelling can be used to estimate accuracy of multiple medical tests. However, the conditional independence (CI) assumption is rarely thought to be clinically valid. Two models…

Methodology · Statistics 2025-09-24 Enzo Cerullo , Sean Pinkney , Alex J. Sutton , Tim Lucas , Nicola J. Cooper , Hayley E. Jones