English
Related papers

Related papers: Fast Computing for Distance Covariance

200 papers

Given an iid sequence of pairs of stochastic processes on the unit interval we construct a measure of independence for the components of the pairs. We define distance covariance and distance correlation based on approximations of the…

Statistics Theory · Mathematics 2018-11-30 Herold Dehling , Muneya Matsui , Thomas Mikosch , Gennady Samorodnitsky , Laleh Tafakori

Properly estimating correlations between objects at different spatial scales necessitates $\mathcal{O}(n^2)$ distance calculations. For this reason, most widely adopted packages for estimating correlations use clustering algorithms to…

Pearson's Chi-squared test, though widely used for detecting association between categorical variables, exhibits low statistical power in large sparse contingency tables. To address this limitation, two novel permutation tests have been…

Methodology · Statistics 2024-03-27 Qingyang Zhang

Many statistical applications require the quantification of joint dependence among more than two random vectors. In this work, we generalize the notion of distance covariance to quantify joint dependence among d >= 2 random vectors. We…

Methodology · Statistics 2018-06-18 Shubhadeep Chakraborty , Xianyang Zhang

This work considers the problem of estimating the distance between two covariance matrices directly from the data. Particularly, we are interested in the family of distances that can be expressed as sums of traces of functions that are…

Machine Learning · Computer Science 2024-09-19 Roberto Pereira , Xavier Mestre , Davig Gregoratti

Covariance localization is a critical component of ensemble-based data assimilation (DA) and many current localization schemes simply dampen correlations as a function of distance. Increases in computational resources, broadening scope of…

Data Analysis, Statistics and Probability · Physics 2025-08-27 Shay Gilpin , Matthias Morzfeld , Kevin K. Lin

The minimum distance of a code is an important concept in information theory. Hence, computing the minimum distance of a code with a minimum computational cost is a crucial process to many problems in this area. In this paper, we present…

Information Theory · Computer Science 2024-05-01 Fernando Hernando , Francisco D. Igual , Gregorio Quintana-Ortí

We provide a static data structure for distance estimation which supports {\it adaptive} queries. Concretely, given a dataset $X = \{x_i\}_{i = 1}^n$ of $n$ points in $\mathbb{R}^d$ and $0 < p \leq 2$, we construct a randomized data…

Data Structures and Algorithms · Computer Science 2020-12-17 Yeshwanth Cherapanamjeri , Jelani Nelson

The free distance of a convolutional code is a reliable indicator of its performance. However its computation is not an easy task. In this paper, we present some algorithms to compute the free distance with good efficiency that work for…

Information Theory · Computer Science 2024-02-06 Zita Abreu , Joachim Rosenthal , Michael Schaller

We present here a new algorithm for the fast computation of N-point correlation functions in large astronomical data sets. The algorithm is based on kdtrees which are decorated with cached sufficient statistics thus allowing for orders of…

In quantum information, trace distance is a basic metric of distinguishability between quantum states. However, there is no known efficient approach to estimate the value of trace distance in general. In this paper, we propose efficient…

Quantum Physics · Physics 2024-03-25 Qisheng Wang , Zhicheng Zhang

Distance-based classification is among the most competitive classification methods for time series data. The most critical component of distance-based classification is the selected distance function. Past research has proposed various…

Machine Learning · Computer Science 2020-08-19 Maximilian Toller , Bernhard C. Geiger , Roman Kern

Analyzing high-dimensional data with manifold learning algorithms often requires searching for the nearest neighbors of all observations. This presents a computational bottleneck in statistical manifold learning when observations of…

Machine Learning · Computer Science 2022-03-11 Fan Cheng , Anastasios Panagiotelis , Rob J Hyndman

The visual cue of optical flow plays a major role in the navigation of flying insects, and is increasingly studied for use by small flying robots as well. A major problem is that successful optical flow control seems to require distance…

Robotics · Computer Science 2015-06-04 G. C. H. E. de Croon

Estimation of the mean and covariance parameters for functional data is a critical task, with local linear smoothing being a popular choice. In recent years, many scientific domains are producing multivariate functional data for which $p$,…

Statistics Theory · Mathematics 2024-09-24 Alexander Petersen

This paper revisits the ordered statistics decoding (OSD). It provides a comprehensive analysis of the OSD algorithm by characterizing the statistical properties, evolution and the distribution of the Hamming distance and weighted Hamming…

Information Theory · Computer Science 2021-05-10 Chentao Yue , Mahyar Shirvanimoghaddam , Branka Vucetic , Yonghui Li

Non-parametric two-sample tests based on energy distance or maximum mean discrepancy are widely used statistical tests for comparing multivariate data from two populations. While these tests enjoy desirable statistical properties, their…

Computation · Statistics 2024-06-11 Elias Chaibub Neto

Application of the minimum distance method to the linear regression model for estimating regression parameters is a difficult and time-consuming process due to the complexity of its distance function, and hence, it is computationally…

Computation · Statistics 2017-02-15 Jiwoong Kim

Algorithms with fast convergence, small number of data access, and low per-iteration complexity are particularly favorable in the big data era, due to the demand for obtaining \emph{highly accurate solutions} to problems with \emph{a large…

Machine Learning · Statistics 2016-11-16 Zebang Shen , Hui Qian , Chao Zhang , Tengfei Zhou

This paper describes novel and fast, simple and robust algorithm with O(N) expected complexity which enables to decrease run-time needed to find an exact maximum distance of two points in E2. The proposed algorithm has been evaluated…

Computational Geometry · Computer Science 2022-08-23 Vaclav Skala