English
Related papers

Related papers: Data Compression and Inference in Cosmology with S…

200 papers

In inference problems, we often have domain knowledge which allows us to define summary statistics that capture most of the information content in a dataset. In this paper, we present a hybrid approach, where such physics-based summaries…

Cosmology and Nongalactic Astrophysics · Physics 2025-04-24 T. Lucas Makinen , Alan Heavens , Natalia Porqueres , Tom Charnock , Axel Lapel , Benjamin D. Wandelt

Recent advances in signal processing have focused on the use of sparse representations in various applications. A new field of interest based on sparsity has recently emerged: compressed sensing. This theory is a new sampling framework that…

Astrophysics · Physics 2009-11-13 J. Bobin , J-L Starck , R. Ottensamer

Motivated by specific data and accuracy requirements for building numerical databases of turbulent flows, data compression using spatio-temporal sub-sampling and local re-simulation is proposed. Numerical re-simulation experiments for…

Fluid Dynamics · Physics 2020-07-01 Zhao Wu , Tamer A. Zaki , Charles Meneveau

Given the growth in the variety and precision of astronomical datasets of interest for cosmology, the best cosmological constraints are invariably obtained by combining data from different experiments. At the likelihood level, one…

Cosmology and Nongalactic Astrophysics · Physics 2024-09-04 Arrykrishna Mootoovaloo , Carlos García-García , David Alonso , Jaime Ruiz-Zapatero

Modern cosmological observations allow us to study in great detail the evolution and history of the large scale structure hierarchy. The fundamental problem of accurate constraints on the cosmological parameters, within a given cosmological…

Astrophysics · Physics 2009-11-13 K. Dolag , S. Borgani , S. Schindler , A. Diaferio , A. M. Bykov

Cosmological analyses are moving past the well understood 2-point statistics to extract more information from cosmological fields. A natural step in extending inference pipelines to other summary statistics is to include higher order…

Cosmology and Nongalactic Astrophysics · Physics 2026-02-20 Kai Lehman , Zhengyangguang Gong , David Gebauer , Stella Seitz , Jochen Weller

Cosmological parameter estimation is entering a new era. Large collaborations need to coordinate high-stakes analyses using multiple methods; furthermore such analyses have grown in complexity due to sophisticated models of cosmology and…

Cosmology and Nongalactic Astrophysics · Physics 2018-04-04 Joe Zuntz , Marc Paterno , Elise Jennings , Douglas Rudd , Alessandro Manzotti , Scott Dodelson , Sarah Bridle , Saba Sehrish , James Kowalkowski

Estimating the parameters of a model describing a set of observations using a neural network is in general solved in a supervised way. In cases when we do not have access to the model's true parameters this approach can not be applied.…

Astrophysics of Galaxies · Physics 2020-09-30 Miguel A. Aragon-Calvo

Compressed sensing is a signal processing technique that allows for the reconstruction of a signal from a small set of measurements. The key idea behind compressed sensing is that many real-world signals are inherently sparse, meaning that…

Machine Learning · Computer Science 2025-09-16 Shane Stevenson , Maryam Sabagh

We present a data-driven technique to analyze multifrequency images from upcoming cosmological surveys mapping large sky area. Using full information from the data at the two-point level, our method can simultaneously constrain the…

Cosmology and Nongalactic Astrophysics · Physics 2023-03-01 Yun-Ting Cheng , Benjamin D. Wandelt , Tzu-Ching Chang , Olivier Dore

We introduce a statistical physics inspired supervised machine learning algorithm for classification and regression problems. The method is based on the invariances or stability of predicted results when known data is represented as…

Machine Learning · Statistics 2018-11-19 Patrick Chao , Tahereh Mazaheri , Bo Sun , Nicholas B. Weingartner , Zohar Nussinov

We present a probabilistic approach to generate a small, query-able summary of a dataset for interactive data exploration. Departing from traditional summarization techniques, we use the Principle of Maximum Entropy to generate a…

Databases · Computer Science 2017-05-25 Laurel Orr , Magda Balazinska , Dan Suciu

Facing the advent of the next generation cosmological surveys we present a method to forecast knowledge gain on cosmological models. We propose this as a well defined and general tool to quantify the performance of different experiments in…

Cosmology and Nongalactic Astrophysics · Physics 2016-06-21 Marco Raveri , Matteo Martinelli , Gongbo Zhao , Yuting Wang

We have developed a method that maps large astronomical images onto a two-dimensional map and clusters them. A combination of various state-of-the-art machine learning (ML) algorithms is used to develop a fully unsupervised image quality…

Instrumentation and Methods for Astrophysics · Physics 2021-04-28 Hossen Teimoorinia , Sara Shishehchi , Ahnaf Tazwar , Ping Lin , Finn Archinuk , Stephen D. J. Gwyn , J. J. Kavelaars

The observable universe contains density perturbations on scales larger than any finite volume survey. Perturbations on scales larger than a survey can measure degrade its power to constrain cosmological parameters. The dependence of survey…

Cosmology and Nongalactic Astrophysics · Physics 2019-10-09 Matthew C. Digman , Joseph E. McEwen , Christopher M. Hirata

Cosmological emulators of observables such as the Cosmic Microwave Background (CMB) spectra and matter power spectra commonly use training data sampled from a Latin hypercube. This method often incurs high computational costs by covering…

Cosmology and Nongalactic Astrophysics · Physics 2024-05-03 Andreas Nygaard , Emil Brinch Holm , Steen Hannestad , Thomas Tram

Large cosmological datasets have been probing the properties of our universe and constraining the parameters of dark matter and dark energy with increasing precision. Deep learning techniques have shown potential to be smarter, and to…

Cosmology and Nongalactic Astrophysics · Physics 2018-10-30 Zoltán Haiman

Compressed sensing is a signal processing method that acquires data directly in a compressed form. This allows one to make less measurements than what was considered necessary to record a signal, enabling faster or more precise measurement…

Statistical Mechanics · Physics 2012-08-20 Florent Krzakala , Marc Mézard , François Sausset , Yifan Sun , Lenka Zdeborová

A model-independent or non-parametric approach for modeling a database has been widely used in cosmology. In these scenarios, the data has been used directly to reconstruct an underlying function. In this work, we introduce a novel…

Cosmology and Nongalactic Astrophysics · Physics 2023-01-19 Ahmad Mehrabi

In the era of burgeoning data generation, managing and storing large-scale time-varying datasets poses significant challenges. With the rise of supercomputing capabilities, the volume of data produced has soared, intensifying storage and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Humayra Tasnim , Soumya Dutta , Melanie Moses