English
Related papers

Related papers: The extension of Pearson correlation coefficient, …

200 papers

Testing independence among a number of (ultra) high-dimensional random samples is a fundamental and challenging problem. By arranging $n$ identically distributed $p$-dimensional random vectors into a $p \times n$ data matrix, we investigate…

Statistics Theory · Mathematics 2017-03-28 Xi Chen , Weidong Liu

This paper introduces the correlation-of-divergency coefficient, c-delta, a custom statistical measure designed to quantify the similarity of internal divergence patterns between two groups of values. Unlike conventional correlation…

Methodology · Statistics 2026-03-10 Johan F. Hoorn

A major challenge in sparsity pattern estimation is that small modes are difficult to detect in the presence of noise. This problem is alleviated if one can observe samples from multiple realizations of the nonzero values for the same…

Information Theory · Computer Science 2011-07-29 Galen Reeves , Michael Gastpar

In high-dimensions, many variable selection methods, such as the lasso, are often limited by excessive variability and rank deficiency of the sample covariance matrix. Covariance sparsity is a natural phenomenon in high-dimensional…

Methodology · Statistics 2010-06-08 X. Jessie Jeng And Z. John Daye

In Science, Reshef et al. (2011) proposed the concept of equitability for measures of dependence between two random variables. To this end, they proposed a novel measure, the maximal information coefficient (MIC). Recently a PNAS paper…

Methodology · Statistics 2023-04-17 A. Adam Ding , Yi Li

The problem of detecting changes in covariance for a single pair of features has been studied in some detail, but may be limited in importance or general applicability. In contrast, testing equality of covariance matrices of a {\it set} of…

Methodology · Statistics 2017-12-12 Yi-Hui Zhou

We derive a detector that optimizes the target detection performance of any single-input single-output noise radar satisfying the following properties: it transmits Gaussian noise, it retains an internal reference signal for matched…

Signal Processing · Electrical Eng. & Systems 2022-04-19 David Luong , Bhashyam Balaji , Sreeraman Rajan

Canonical correlation analysis is a family of multivariate statistical methods for the analysis of paired sets of variables. Since its proposition, canonical correlation analysis has for instance been extended to extract relations between…

Machine Learning · Computer Science 2017-11-08 Viivi Uurtio , João M. Monteiro , Jaz Kandola , John Shawe-Taylor , Delmiro Fernandez-Reyes , Juho Rousu

Regression learning is classic and fundamental for medical image analysis. It provides the continuous mapping for many critical applications, like the attribute estimation, object detection, segmentation and non-rigid registration. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Chaoyu Chen , Xin Yang , Ruobing Huang , Xindi Hu , Yankai Huang , Xiduo Lu , Xinrui Zhou , Mingyuan Luo , Yinyu Ye , Xue Shuang , Juzheng Miao , Yi Xiong , Dong Ni

Quantifying uncertainty in high-dimensional sparse linear regression is a fundamental task in statistics that arises in various applications. One of the most successful methods for quantifying uncertainty is the debiased LASSO, which has a…

Statistics Theory · Mathematics 2024-02-27 Pedro Abdalla , Gil Kur

An approach to inference for relative sparsity was developed in prior work, and an adaptive lasso asymptotic normality theorem was given there, but this theorem was not fully used when estimating the variance of the policy coefficients.…

Methodology · Statistics 2026-05-05 Samuel Julian Weisenthal

Neural networks encode information through their collective spiking activity in response to external stimuli. This population response is noisy and strongly correlated, with complex interplay between correlations induced by the stimulus,…

Neurons and Cognition · Quantitative Biology 2022-11-28 Gabriel Mahuas , Olivier Marre , Thierry Mora , Ulisse Ferrari

Covariance matrix estimation concerns the problem of estimating the covariance matrix from a collection of samples, which is of extreme importance in many applications. Classical results have shown that $O(n)$ samples are sufficient to…

Information Theory · Computer Science 2019-03-19 Wei Cui , Xu Zhang , Yulong Liu

The problem of testing changes in covariance has received increasing attention in recent years, especially in the context of high-dimensional testing. A number of approaches have been proposed, all limited to the two-sample problem and…

Methodology · Statistics 2016-09-06 Yi-Hui Zhou

We consider the problem of fitting a relationship (e.g. a potential scientific law) to data involving multiple variables. Ordinary (least squares) regression is not suitable for this because the estimated relationship will differ according…

Methodology · Statistics 2024-09-05 Chris Tofallis

Meta-regression is often used to form hypotheses about what is associated with heterogeneity in a meta-analysis and to estimate the extent to which effects can vary between cohorts and other distinguishing factors. However, study-level…

Methodology · Statistics 2021-11-19 Maxwell Cairns , Luke A. Prendergast

Repeated use of a data sample via adaptively chosen queries can rapidly lead to overfitting, wherein the empirical evaluation of queries on the sample significantly deviates from their mean with respect to the underlying data distribution.…

Machine Learning · Computer Science 2024-04-26 Moshe Shenfeld , Katrina Ligett

Compositional data (i.e., data comprising random variables that sum up to a constant) arises in many applications including microbiome studies, chemical ecology, political science, and experimental designs. Yet when compositional data serve…

Methodology · Statistics 2025-01-03 Ritwik Bhaduri , Siyuan Ma , Lucas Janson

Coherence is the most fundamental quantum feature in quantum mechanics. For a bipartite quantum state, if a measurement is performed on one party, the other party, based on the measurement outcomes, will collapse to a corresponding state…

Quantum Physics · Physics 2017-03-09 Jun Zhang , Si-ren Yang , Yang Zhang , Chang-shui Yu

We show that the `shot noise' bias in angular clustering power spectra observed from discrete samples of points is not noise, but rather a known additive contribution that naturally arises due to degenerate pairs of points. In particular,…

Cosmology and Nongalactic Astrophysics · Physics 2025-10-15 Nicolas Tessore , Alex Hall