English
Related papers

Related papers: Notes on the interpretation of dependence measures

200 papers

Measuring dependence between two random variables is very important, and critical in many applied areas such as variable selection, brain network analysis. However, we do not know what kind of functional relationship is between two…

Machine Learning · Statistics 2018-07-12 Hangjin Jiang , Kan Liu , Yiming Ding

Partial orderings and measures of information for continuous univariate random variables with special roles of Gaussian and uniform distributions are discussed. The information measures and measures of non-Gaussianity including third and…

Statistics Theory · Mathematics 2020-06-22 Una Radojicic , Klaus Nordhausen , Hannu Oja

Increased availability of data and accessibility of computational tools in recent years have created unprecedented opportunities for scientific research driven by statistical analysis. Inherent limitations of statistics impose constrains on…

Genomics · Quantitative Biology 2016-09-13 Olga A. Vsevolozhskaya , Gabriel Ruiz , Dmitri V. Zaykin

The correlation between NLG automatic evaluation metrics and human evaluation is often regarded as a critical criterion for assessing the capability of an evaluation metric. However, different grouping methods and correlation coefficients…

Computation and Language · Computer Science 2025-01-28 Mingqi Gao , Xinyu Hu , Li Lin , Xiaojun Wan

An important aspect of multiple hypothesis testing is controlling the significance level, or the level of Type I error. When the test statistics are not independent it can be particularly challenging to deal with this problem, without…

Statistics Theory · Mathematics 2009-03-04 Sandy Clarke , Peter Hall

Two families of dependence measures between random variables are introduced. They are based on the R\'enyi divergence of order $\alpha$ and the relative $\alpha$-entropy, respectively, and both dependence measures reduce to Shannon's mutual…

Information Theory · Computer Science 2019-08-22 Amos Lapidoth , Christoph Pfister

Little attention has been given to the correlation coefficient when data come from discrete or continuous non-normal populations. In this article, we consider the efficiency of two correlation coefficients which are from the same family,…

Methodology · Statistics 2015-11-06 Michael Tsagris , Ioannis Elmatzoglou , Christos C. Frangos

Mutual information is fundamentally important for measuring statistical dependence between variables and for quantifying information transfer by signaling and communication mechanisms. It can, however, be challenging to evaluate for…

Information Theory · Computer Science 2014-07-29 Clive G. Bowsher , Margaritis Voliotis

Measuring conditional dependencies among the variables of a network is of great interest to many disciplines. This paper studies some shortcomings of the existing dependency measures in detecting direct causal influences or their lack of…

Machine Learning · Statistics 2017-06-05 Jalal Etesami , Kun Zhang , Negar Kiyavash

Properties of weighted averages are studied for the general case that the individual measurements are subject to hidden correlations and have asymmetric statistical as well as systematic errors. Explicit expressions are derived for an…

High Energy Physics - Experiment · Physics 2007-05-23 Michael Schmelling

Nonparametric and nonlinear measures of statistical dependence between pairs of random variables are important tools in modern data analysis. In particular the emergence of large data sets can now support the relaxation of linearity…

Methodology · Statistics 2016-05-13 Sarah Filippi , Chris Holmes

Measuring the dependence of data plays a central role in statistics and machine learning. In this work, we summarize and generalize the main idea of existing information-theoretic dependence measures into a higher-level perspective by the…

Machine Learning · Computer Science 2021-01-26 Shujian Yu , Francesco Alesiani , Xi Yu , Robert Jenssen , Jose C. Principe

We propose a family of association measures for two-way contingency tables whose latent distribution can be assumed to be bivariate normal. When this assumption holds, the power-divergence measuring departure from independence can be…

Methodology · Statistics 2026-04-16 Wataru Urasaki

In this paper, we analyze the relative errors that crop up in the various reliability measures due to the tacit assumption that the components are independently working associated with a $n$-component series system or a parallel system…

Statistics Theory · Mathematics 2025-03-28 Subarna Bhattacharjee , Aninda Kumar Nanda , Subhashree Patra

Testing cross-sectional independence in panel data models is of fundamental importance in econometric analysis with high-dimensional panels. Recently, econometricians began to turn their attention to the problem in the presence of serial…

Methodology · Statistics 2023-09-18 Hongfei Wang , Binghui Liu , Long Feng , Yanyuan Ma

Testing for association or dependence between pairs of random variables is a fundamental problem in statistics. In some applications, data are subject to selection bias that causes dependence between observations even when it is absent from…

Methodology · Statistics 2020-10-13 Yaniv Tenzer , Micha Mandel , Or Zuk

We develop a new statistical procedure to test whether the dependence structure is identical between two groups. Rather than relying on a single index such as Pearson's correlation coefficient or Kendall's Tau, we consider the entire…

Econometrics · Economics 2018-11-07 Juwon Seo

The empirical copula process plays a central role in the asymptotic analysis of many statistical procedures which are based on copulas or ranks. Among other applications, results regarding its weak convergence can be used to develop…

Statistics Theory · Mathematics 2014-11-24 Axel Bücher , Betina Berghaus , Stanislav Volgushev

We investigate the relative information content of six measures of dependence between two random variables $X$ and $Y$ for large or extreme events for several models of interest for financial time series. The six measures of dependence are…

Statistical Mechanics · Physics 2008-12-10 Y. Malevergne , D. Sornette

The most popular multiple testing procedures are stepwise procedures based on $P$-values for individual test statistics. Included among these are the false discovery rate (FDR) controlling procedures of Benjamini--Hochberg [J. Roy. Statist.…

Statistics Theory · Mathematics 2009-06-18 Arthur Cohen , Harold B. Sackrowitz , Minya Xu