Related papers: Science-driven 3D data compression
We propose a strategy to compress and store large volumes of scientific data represented on unstructured grids. Approaches utilizing tensor decompositions for data compression have already been proposed. Here, data on a structured grid is…
The angular power spectrum is a natural tool to analyse the observed galaxy number count fluctuations. In a standard analysis, the angular galaxy distribution is sliced into concentric redshift bins and all correlations of its harmonic…
We extend the modal decomposition method, previously applied to compress the information in the real-space bispectrum, to the anisotropic redshift-space galaxy bispectrum. In the modal method approach, the bispectrum is expanded on a basis…
Combining redshift and galaxy shape information offers new exciting ways of exploiting the gravitational lensing effect for studying the large scales of the cosmos. One application is the three-dimensional reconstruction of the matter…
Future orbiting observatories will survey large areas of sky in order to constrain the physics of dark matter and dark energy using weak gravitational lensing and other methods. Lossy compression of the resultant data will improve the cost…
We demonstrate the effectiveness of a relatively straightforward analysis of the complex 3D Fourier transform of galaxy coordinates derived from redshift surveys. Numerical demonstrations of this approach are carried out on a volume-limited…
Lossy compression is widely used to reduce storage and I/O costs for large-scale particle datasets in scientific applications such as cosmology, molecular dynamics, and fluid dynamics, where clustering structures (e.g., single-linkage or…
Future large scale cosmological surveys will provide huge data sets whose analysis requires efficient data compression. Calculating accurate covariances is extremely challenging with increasing number of statistics used. Here we introduce a…
We study the estimators of various second-order weak lensing statistics such as the shear correlation functions xi_\pm and the aperture mass dispersion <M_ap^2> which can directly be constructed from weak lensing shear maps. We compare the…
We perform a tomographic structure growth and expansion rate analysis using the monopole, quadrupole and hexadecapole of the redshift-space galaxy power spectrum derived from the Sloan Digital Sky Survey (SDSS-III) Baryon Oscillation…
Handling big data has largely been a major bottleneck in traditional statistical models. Consequently, when accurate point prediction is the primary target, machine learning models are often preferred over their statistical counterparts for…
The cosmological information contained in anisotropic galaxy clustering measurements can often be compressed into a small number of parameters whose posterior distribution is well described by a Gaussian. We present a general methodology to…
We present a tomographic cosmological weak lensing analysis of the HST COSMOS Survey. Applying our lensing-optimized data reduction, principal component interpolation for the ACS PSF, and improved modelling of charge-transfer inefficiency,…
Compressed sensing (CS) theory assures us that we can accurately reconstruct magnetic resonance images using fewer k-space measurements than the Nyquist sampling rate requires. In traditional CS-MRI inversion methods, the fact that the…
Number counts of galaxy clusters across redshift are a powerful cosmological probe, if a precise and accurate reconstruction of the underlying mass distribution is performed -- a challenge called mass calibration. With the advent of wide…
We consider the case when a set of spatially distributed sensors make local observations which are noisy versions of a signal of interest. Each sensor transmits compressed information about its measurements to the fusion center which should…
Data analysis and interpretation often relies on an approximation of an empirical dataset by some analytic functions or models. Actual implementations usually rely on a non-linear multi-dimensional optimization algorithm, typically…
Determining the distribution of redshifts for galaxies in wide-field photometric surveys is essential for robust cosmological studies of weak gravitational lensing. We present the methodology, calibrated redshift distributions, and…
Weak gravitational lensing is the slight distortion of galaxy shapes caused primarily by the gravitational effects of dark matter in the universe. In our work, we seek to invert the weak lensing signal from 2D telescope images to…
We explore the utility of Karhunen Loeve (KL) analysis in solving practical problems in the analysis of gravitational shear surveys. Shear catalogs from large-field weak lensing surveys will be subject to many systematic limitations,…