English
Related papers

Related papers: A fast algorithm for computing distance correlatio…

200 papers

Consider a metric space $(P,dist)$ with $N$ points whose doubling dimension is a constant. We present a simple, randomized, and recursive algorithm that computes, in $O(N \log N)$ expected time, the closest-pair distance in $P$. To generate…

Computational Geometry · Computer Science 2021-02-03 Anil Maheshwari , Wolfgang Mulzer , Michiel Smid

Starting from a dataset with input/output time series generated by multiple deterministic linear dynamical systems, this paper tackles the problem of automatically clustering these time series. We propose an extension to the so-called…

Systems and Control · Computer Science 2018-03-09 Oliver Lauwers , Bart De Moor

Understanding and developing a correlation measure that can detect general dependencies is not only imperative to statistics and machine learning, but also crucial to general scientific discovery in the big data age. In this paper, we…

Machine Learning · Statistics 2024-06-27 Cencheng Shen , Carey E. Priebe , Joshua T. Vogelstein

This paper presents a new approach to statistical similarity assessment based on sequence alignment. The algorithm performs mutual matching of two random sequences by successively searching for common elements and by applying sequence…

Signal Processing · Electrical Eng. & Systems 2021-06-09 Jakub Nikonowicz , Łukasz Matuszewski , Paweł Kubczak

Algorithms with fast convergence, small number of data access, and low per-iteration complexity are particularly favorable in the big data era, due to the demand for obtaining \emph{highly accurate solutions} to problems with \emph{a large…

Machine Learning · Statistics 2016-11-16 Zebang Shen , Hui Qian , Chao Zhang , Tengfei Zhou

Identifying dependency in multivariate data is a common inference task that arises in numerous applications. However, existing nonparametric independence tests typically require computation that scales at least quadratically with the sample…

Methodology · Statistics 2021-07-08 Shai Gorsky , Li Ma

Many data sources can be interpreted as time-series, and a key problem is to identify which pairs out of a large collection of signals are highly correlated. We expect that there will be few, large, interesting correlations, while most…

Data Structures and Algorithms · Computer Science 2017-10-06 Graham Cormode , Jacques Dark

Distance covariance and distance correlation have long been regarded as natural measures of dependence between two random vectors, and have been used in a variety of situations for testing independence. Despite their popularity, the…

Methodology · Statistics 2025-03-31 Hallin Marc , Davide La Vecchia , Hang Liu , Xinyi Xu

Identifying how dependence relationships vary across different conditions plays a significant role in many scientific investigations. For example, it is important for the comparison of biological systems to see if relationships between…

Methodology · Statistics 2023-07-31 Hoseung Song , Michael C. Wu

A possible drawback of the ordinary correlation coefficient $\rho$ for two real random variables $X$ and $Y$ is that zero correlation does not imply independence. In this paper we introduce a new correlation coefficient $\rho^*$ which…

Statistics Theory · Mathematics 2007-06-13 Wicher P. Bergsma

This paper describes novel and fast, simple and robust algorithm with O(N) expected complexity which enables to decrease run-time needed to find an exact maximum distance of two points in E2. The proposed algorithm has been evaluated…

Computational Geometry · Computer Science 2022-08-23 Vaclav Skala

Little attention has been given to the correlation coefficient when data come from discrete or continuous non-normal populations. In this article, we consider the efficiency of two correlation coefficients which are from the same family,…

Methodology · Statistics 2015-11-06 Michael Tsagris , Ioannis Elmatzoglou , Christos C. Frangos

We introduce the coverage correlation coefficient, a novel nonparametric measure of statistical association designed to quantifies the extent to which two random variables have a joint distribution concentrated on a singular subset with…

Methodology · Statistics 2025-08-18 Xuzhi Yang , Mona Azadkia , Tengyao Wang

We propose a multilevel Monte-Carlo scheme, applicable to local actions, which is expected to reduce statistical errors on correlation functions. We give general arguments to show how the efficiency and parameters of the algorithm are…

High Energy Physics - Lattice · Physics 2010-02-03 Harvey B. Meyer

Measuring and testing dependence between complex objects is of great importance in modern statistics. Most existing work relied on the distance between random variables, which inevitably required the moment conditions to guarantee the…

Methodology · Statistics 2023-04-19 Yilin Zhang , Songshan Yang

Computing the similarity between two probability distributions is a recurring theme across control. We introduce a unified family of distances between the probability distributions of two random variables that is based on the discrepancy…

Systems and Control · Electrical Eng. & Systems 2025-10-03 Alexandros E. Tzikas , Arec Jamgochian , Nazim Kemal Ure , Mykel J. Kochenderfer , Stephen P. Boyd

We provide a static data structure for distance estimation which supports {\it adaptive} queries. Concretely, given a dataset $X = \{x_i\}_{i = 1}^n$ of $n$ points in $\mathbb{R}^d$ and $0 < p \leq 2$, we construct a randomized data…

Data Structures and Algorithms · Computer Science 2020-12-17 Yeshwanth Cherapanamjeri , Jelani Nelson

A disordered medium is often constructed by $N$ points independently and identically distributed in a $d$-dimensional hyperspace. Characteristics related to the statistics of this system is known as the random point problem. As $d \to…

Disordered Systems and Neural Networks · Physics 2007-05-23 Cesar Augusto Sangaletti Tercariol , Alexandre Souto Martinez

This paper contributes multivariate versions of seven commonly used elastic similarity and distance measures for time series data analytics. Elastic similarity and distance measures are a class of similarity measures that can compensate for…

Machine Learning · Computer Science 2023-01-18 Ahmed Shifaz , Charlotte Pelletier , Francois Petitjean , Geoffrey I. Webb

We propose new statistical tests, in high-dimensional settings, for testing the independence of two random vectors and their conditional independence given a third random vector. The key idea is simple, i.e., we first transform each…

Methodology · Statistics 2026-01-28 Jinyuan Chang , Yue Du , Jing He , Qiwei Yao