English
Related papers

Related papers: A new correlation coefficient between categorical,…

200 papers

This study introduces a data-driven, machine learning-based method to detect suitable control variables and instruments for assessing the causal effect of a treatment on an outcome in observational data. Our approach tests the joint…

Econometrics · Economics 2026-05-20 Nicolas Apfel , Julia Hatamyar , Martin Huber , Jannis Kueck

We study the problem of causal effect identification from observational distribution given the causal graph and some context-specific independence (CSI) relations. It was recently shown that this problem is NP-hard, and while a sound…

Machine Learning · Computer Science 2022-02-18 Ehsan Mokhtarian , Fateme Jamshidi , Jalal Etesami , Negar Kiyavash

This paper proposes a flexible new framework for constructing Neyman-orthogonal scores in semiparametric models involving infinite-dimensional nuisance parameters. While locally estimation is vital for integrating machine learning into…

Methodology · Statistics 2026-04-30 Kun Ren , Wen Su , Li Liu , Ian W. McKeague , Xingqiu Zhao

Causal inference methods based on conditional independence construct Markov equivalent graphs, and cannot be applied to bivariate cases. The approaches based on independence of cause and mechanism state, on the contrary, that causal…

Machine Learning · Computer Science 2021-08-04 Nataliya Sokolovska , Pierre-Henri Wuillemin

While there is substantial need for dependence models in higher dimensions, most existing models quickly become rather restrictive and barely balance parsimony and flexibility. Hierarchical constructions may improve on that by grouping…

Methodology · Statistics 2013-10-11 Eike Christian Brechmann

Linear mixed-effects models are widely used in analyzing repeated measures data, including clustered and longitudinal data, where inferences of both fixed effects and variance components are of importance. Unlike the fixed effect inference…

Methodology · Statistics 2022-08-31 J. Zhang , W. Guo , J. S. Carpenter , Andrew Leroux , K. R. Merikangas , N. G. Martin , I. B. Hickie , H. Shou , H. Li

Selecting powerful predictors for an outcome is a cornerstone task for machine learning. However, some types of questions can only be answered by identifying the predictors that causally affect the outcome. A recent approach to this causal…

Machine Learning · Computer Science 2022-03-01 Guillaume Martinet , Alexander Strzalkowski , Barbara E. Engelhardt

Commonalities and differences in correlation analysis in terms of phase space, conditioning and uncorrelatedness are discussed. The Poisson process is not generally appropriate as reference distribution for normalisation and cumulants, so…

High Energy Physics - Experiment · Physics 2007-05-23 H. C. Eggers

Discovering causal relations is fundamental to reasoning and intelligence. In particular, observational causal discovery algorithms estimate the cause-effect relation between two random entities $X$ and $Y$, given $n$ samples from $P(X,Y)$.…

Machine Learning · Statistics 2017-02-24 Mateo Rojas-Carulla , Marco Baroni , David Lopez-Paz

Measuring the statistical dependence between observed signals is a primary tool for scientific discovery. However, biological systems often exhibit complex non-linear interactions that currently cannot be captured without a priori knowledge…

What is the difference of a prediction that is made with a causal model and a non-causal model? Suppose we intervene on the predictor variables or change the whole environment. The predictions from a causal model will in general work as…

Methodology · Statistics 2024-04-27 Jonas Peters , Peter Bühlmann , Nicolai Meinshausen

This work presents a new methodology to obtain probabilistic interval predictions of a dynamical system. The proposed strategy uses stored past system measurements to estimate the future evolution of the system. The method relies on the use…

Systems and Control · Electrical Eng. & Systems 2021-12-21 A. Daniel Carnerero , Daniel R. Ramirez , Teodoro Alamo

A useful property of independent samples is that their correlation remains the same after applying marginal transforms. This invariance property plays a fundamental role in statistical inference, but does not hold in general for dependent…

Statistics Theory · Mathematics 2024-08-16 Takaaki Koike , Liyuan Lin , Ruodu Wang

We extend conformal prediction methodology beyond the case of exchangeable data. In particular, we show that a weighted version of conformal prediction can be used to compute distribution-free prediction intervals for problems in which the…

Methodology · Statistics 2020-07-08 Ryan J. Tibshirani , Rina Foygel Barber , Emmanuel J. Candes , Aaditya Ramdas

In multivariate longitudinal studies, associations between outcomes often exhibit time-varying and individual level heterogeneity, motivating the modeling of correlations as an explicit function of time and covariates. However, most…

We explore fairness from a statistical perspective by selectively utilizing either conditional distance covariance or distance covariance statistics as measures to assess the independence between predictions and sensitive attributes. We…

Machine Learning · Computer Science 2025-12-22 Ruifan Huang , Haixia Liu

Testing two potentially multivariate variables for statistical dependence on the basis finite samples is a fundamental statistical challenge. Here we explore a family of tests that adapt to the complexity of the relationship between the…

Machine Learning · Statistics 2020-10-23 Baihan Lin , Nikolaus Kriegeskorte

Simple correlation coefficients between two variables have been generalized to measure association between two matrices in many ways. Coefficients such as the RV coefficient, the distance covariance (dCov) coefficient and kernel based…

Methodology · Statistics 2014-08-19 Julie Josse , Susan Holmes

This paper is concerned with test of the conditional independence. We first establish an equivalence between the conditional independence and the mutual independence. Based on the equivalence, we propose an index to measure the conditional…

Methodology · Statistics 2021-05-18 Zhanrui Cai , Runze Li , Yaowu Zhang

The inferential model (IM) framework provides valid prior-free probabilistic inference by focusing on predicting unobserved auxiliary variables. But, efficient IM-based inference can be challenging when the auxiliary variable is of higher…

Statistics Theory · Mathematics 2015-01-20 Ryan Martin , Chuanhai Liu