English

Graph Database Solution for Higher Order Spatial Statistics in the Era of Big Data

Cosmology and Nongalactic Astrophysics 2019-06-19 v1 Instrumentation and Methods for Astrophysics

Abstract

We present an algorithm for the fast computation of the general NN-point spatial correlation functions of any discrete point set embedded within an Euclidean space of Rn\mathbb{R}^n. Utilizing the concepts of kd-trees and graph databases, we describe how to count all possible NN-tuples in binned configurations within a given length scale, e.g. all pairs of points or all triplets of points with side lengths <rmax<r_{max}. Through bench-marking we show the computational advantage of our new graph based algorithm over more traditional methods. We show that all 3-point configurations up to and beyond the Baryon Acoustic Oscillation scale (\sim200 Mpc in physical units) can be performed on current SDSS data in reasonable time. Finally we present the first measurements of the 4-point correlation function of \sim0.5 million SDSS galaxies over the redshift range 0.43<z<0.70.43<z<0.7.

Keywords

Cite

@article{arxiv.1901.00296,
  title  = {Graph Database Solution for Higher Order Spatial Statistics in the Era of Big Data},
  author = {Cristiano G. Sabiu and Ben Hoyle and Juhan Kim and Xiao-Dong Li},
  journal= {arXiv preprint arXiv:1901.00296},
  year   = {2019}
}

Comments

9 pages, 8 figures, submitted

R2 v1 2026-06-23T07:01:09.367Z