English
Related papers

Related papers: Distance Correlation: A New Tool for Detecting Ass…

200 papers

In distributed and federated learning, heterogeneity across data sources remains a major obstacle to effective model aggregation and convergence. We focus on feature heterogeneity and introduce energy distance as a sensitive measure for…

Machine Learning · Statistics 2025-01-28 Mengchen Fan , Baocheng Geng , Roman Shterenberg , Joseph A. Casey , Zhong Chen , Keren Li

In a regression setting we propose algorithms that reduce the dimensionality of the features while simultaneously maximizing a statistical measure of dependence known as distance correlation between the low-dimensional features and a…

Machine Learning · Computer Science 2017-02-20 Praneeth Vepakomma , Ahmed Elgammal

Pearson's correlation is among the mostly widely reported measures of association. The strength of the statistical evidence for linear association is determined by the p-value of a hypothesis test. If the true distribution of a dataset is…

Statistics Theory · Mathematics 2021-08-31 Marc Jaffrey , Michael Dushkoff

Causal understanding is important in many disciplines of science and engineering, where we seek to understand how different factors in the system causally affect an experiment or situation and pave a pathway towards creating effective or…

Robotics · Computer Science 2025-05-14 Miguel Arana-Catania , Weisi Guo

Techniques for detecting critical phenomena -- phase transitions where correlation length diverges and small perturbations have large effects -- have been developed across multiple fields over nine decades. We survey between six and twelve…

Physics and Society · Physics 2026-03-19 Bruce Stephenson , Robin Macomber

Defeasibility in causal reasoning implies that the causal relationship between cause and effect can be strengthened or weakened. Namely, the causal strength between cause and effect should increase or decrease with the incorporation of…

Computation and Language · Computer Science 2024-06-28 Shaobo Cui , Lazar Milikic , Yiyang Feng , Mete Ismayilzada , Debjit Paul , Antoine Bosselut , Boi Faltings

A method is discussed that allows combining sets of differential or inclusive measurements. It is assumed that at least one measurement was obtained with simultaneously fitting a set of nuisance parameters, representing sources of…

Data Analysis, Statistics and Probability · Physics 2018-01-09 Jan Kieseler

Canonical correlation analysis (CCA) is a classic statistical method for discovering latent co-variation that underpins two or more observed random vectors. Several extensions and variations of CCA have been proposed that have strengthened…

Machine Learning · Computer Science 2023-12-22 Paris A. Karakasis , Nicholas D. Sidiropoulos

Quantum correlation often refers to correlations exhibited by two or more local subsystems under a suitable measurement. These correlations are beyond the framework of classical statistics and the associated classical probability…

Quantum Physics · Physics 2022-11-09 Biveen Shajilal , Elanor Huntington , Ping Koy Lam , Syed Assad

This work considers the problem of estimating the distance between two covariance matrices directly from the data. Particularly, we are interested in the family of distances that can be expressed as sums of traces of functions that are…

Machine Learning · Computer Science 2024-09-19 Roberto Pereira , Xavier Mestre , Davig Gregoratti

The use of degree-degree correlations to model realistic networks which are characterized by their Pearson's coefficient, has become widespread. However the effect on how different correlation algorithms produce different results on…

Physics and Society · Physics 2011-12-30 L. D. Valdez , C. Buono , L. A. Braunstein , P. A. Macri

Inferring the coupling direction from measured time series of complex systems is challenging. We propose a new state space based causality measure obtained from cross-distance vectors for quantifying interaction strength. It is a model-free…

Data Analysis, Statistics and Probability · Physics 2023-05-04 Martin Brešar , Pavle Boškoski

The Pearson distance between a pair of random variables $X,Y$ with correlation $\rho_{xy}$, namely, 1-$\rho_{xy}$, has gained widespread use, particularly for clustering, in areas such as gene expression analysis, brain imaging and cyber…

Methodology · Statistics 2019-08-19 Victor Solo

Correlation coefficients play a pivotal role in quantifying linear relationships between random variables. Yet, their application to time series data is very challenging due to temporal dependencies. This paper introduces a novel approach…

Methodology · Statistics 2024-01-09 Johan Medrano , Abderrahmane Kheddar , Sofiane Ramdani

Distance plays a fundamental role in measuring similarity between objects. Various visualization techniques and learning tasks in statistics and machine learning such as shape matching, classification, dimension reduction and clustering…

Machine Learning · Statistics 2025-04-23 Dianbin Bao , Kisung You , Lizhen Lin

The anisotropic 2-point correlation function (2PCF) of galaxies measures pairwise clustering as a function of the pair separation's angle to the line of sight. The latter is often defined as either the angle bisector of the…

Cosmology and Nongalactic Astrophysics · Physics 2015-10-19 Zachary Slepian , Daniel J. Eisenstein

We live in a digital world that, in 2010, crossed the mark of one zettabyte data. This huge amount of data processed on computers extremely fast with optimized techniques allows one to find insights in new and emerging types of data and…

Physics Education · Physics 2014-05-27 Renato P. dos Santos

It is of critical importance to be aware of the historical discrimination embedded in the data and to consider a fairness measure to reduce bias throughout the predictive modeling pipeline. Given various notions of fairness defined in the…

Machine Learning · Computer Science 2023-01-02 Hadis Anahideh , Nazanin Nezami , Abolfazl Asudeh

Causal set theory is perhaps the most minimalistic approach to quantum gravity, in the sense that it makes next to zero assumptions about the structure of spacetime below the Planck scale. Yet even with this minimalism, the continuum limit…

General Relativity and Quantum Cosmology · Physics 2024-05-31 Marian Boguna , Dmitri Krioukov

Probabilistic cross-identification has been successfully applied to a number of problems in astronomy from matching simple point sources to associating stars with unknown proper motions and even radio observations with realistic morphology.…

Astrophysics of Galaxies · Physics 2017-06-30 Neil Mallinar , Tamas Budavari , Gerard Lemson