English
Related papers

Related papers: Efficient Ensemble Conditional Independence Test F…

200 papers

Abstruse learning algorithms and complex datasets increasingly characterize modern clinical decision support systems (CDSS). As a result, clinicians cannot easily or rapidly scrutinize the CDSS recommendation when facing a difficult…

Artificial Intelligence · Computer Science 2021-11-02 Bojian Hou , Hao Zhang , Gur Ladizhinsky , Gur Ladizhinsky , Stephen Yang , Volodymyr Kuleshov , Fei Wang , Qian Yang

Estimating causal interactions in complex dynamical systems is an important problem encountered in many fields of current science. While a theoretical solution for detecting the causal interactions has been previously formulated in the…

Data Analysis, Statistics and Probability · Physics 2020-01-20 Jakub Kořenek , Jaroslav Hlinka

Inferring causal relationships from dynamical systems is the central interest of many scientific inquiries. Conditional local independence, which describes whether the evolution of one process is influenced by another process given…

Methodology · Statistics 2025-10-09 Mingzhou Liu , Xinwei Sun , Yizhou Wang

A powerful technique for solving combinatorial optimization problems is to reduce the search space without compromising the solution quality by exploring intrinsic mathematical properties of the problems. For the maximum weight independent…

Optimization and Control · Mathematics 2023-01-16 Jianfeng Liu , Sihong Shao , Chaorui Zhang

Recently, the binary expansion testing framework was introduced to test the independence of two continuous random variables by utilizing symmetry statistics that are complete sufficient statistics for dependence. We develop a new test based…

Statistics Theory · Mathematics 2021-01-11 Duyeol Lee , Kai Zhang , Michael R. Kosorok

Incorporating causal knowledge and mechanisms is essential for refining causal models and improving downstream tasks such as designing new treatments. In this paper, we introduce a novel concept in causal discovery, termed interventional…

Machine Learning · Computer Science 2025-10-31 Zhigao Guo , Feng Dong

Learning causality from observational data has received increasing interest across various scientific fields. However, most existing methods assume the absence of latent confounders and restrict the underlying causal graph to be acyclic,…

Methodology · Statistics 2025-11-18 Wei Jin , Lang Lang , Amanda B. Spence , Leah H. Rubin , Yanxun Xu

Conditional independence reasoning has been shown to be helpful in the context of Bayesian nets to optimize probabilistic inference, and related techniques have been applied to speed up a number of logical reasoning tasks in boolean logic…

Logic in Computer Science · Computer Science 2016-10-14 Ron van der Meyden

Identifying the relevant variables for a classification model with correct confidence levels is a central but difficult task in high-dimension. Despite the core role of sparse logistic regression in statistics and machine learning, it still…

Machine Learning · Statistics 2022-05-31 Binh T. Nguyen , Bertrand Thirion , Sylvain Arlot

One of the most common mistakes made when performing data analysis is attributing causal meaning to regression coefficients. Formally, a causal effect can only be computed if it is identifiable from a combination of observational data and…

Artificial Intelligence · Computer Science 2019-10-31 Daniel Kumor , Bryant Chen , Elias Bareinboim

We target the problem of accuracy and robustness in causal inference from finite data sets. Some state-of-the-art algorithms produce clear output complete with solid theoretical guarantees but are susceptible to propagating erroneous…

Artificial Intelligence · Computer Science 2012-10-19 Tom Claassen , Tom Heskes

A new method is proposed for exploiting causal independencies in exact Bayesian network inference. A Bayesian network can be viewed as representing a factorization of a joint probability into the multiplication of a set of conditional…

Artificial Intelligence · Computer Science 2014-11-17 N. L. Zhang , D. Poole

Chain-of-Thought (CoT) prompting has improved LLM reasoning, but models often generate explanations that appear coherent while containing unfaithful intermediate steps. Existing self-evaluation approaches are prone to inherent biases: the…

Artificial Intelligence · Computer Science 2026-04-21 Yuxi Sun , Aoqi Zuo , Haotian Xie , Wei Gao , Mingming Gong , Jing Ma

Clustering and dependence are common in trials. For example, in some cluster randomized trials (CRTs), pre-existing clusters are enrolled, randomized, and serve as the basis of intervention delivery. Such CRTs are "fully clustered":…

We develop new methods to integrate experimental and observational data in causal inference. While randomized controlled trials offer strong internal validity, they are often costly and therefore limited in sample size. Observational data,…

Econometrics · Economics 2025-11-04 Xuelin Yang , Licong Lin , Susan Athey , Michael I. Jordan , Guido W. Imbens

COMPLEX-IT is a case-based, mixed-methods platform for social inquiry into complex data/systems, designed to increase non-expert access to the tools of computational social science (i.e., cluster analysis, artificial intelligence, data…

Mathematical Software · Computer Science 2021-01-22 Corey Schimpf , Brian Castellani

Conformal prediction provides distribution-free predictive intervals with finite-sample marginal coverage. However, achieving conditional validity and interval efficiency (in terms of short interval length) remains challenging, particularly…

Machine Learning · Statistics 2026-05-06 Ran Zou , Wanrong Zhu , Bin Nan

Bridging the gap between internal and external validity is crucial for heterogeneous treatment effect estimation. Randomised controlled trials (RCTs), favoured for their internal validity due to randomisation, often encounter challenges in…

Causal effect estimation (CEE) provides a crucial tool for predicting the unobserved counterfactual outcome for an entity. As CEE relaxes the requirement for ``perfect'' counterfactual samples (e.g., patients with identical attributes and…

Machine Learning · Computer Science 2024-11-19 Hechuan Wen , Tong Chen , Guanhua Ye , Li Kheng Chai , Shazia Sadiq , Hongzhi Yin

Complex high-dimensional co-occurrence data are increasingly popular from a complex system of interacting physical, biological and social processes in discretely indexed modifiable areal units or continuously indexed locations of a study…

Machine Learning · Statistics 2022-10-19 Jian-Yong Wang , Han Yu