English
Related papers

Related papers: Data Compression and Inference in Cosmology with S…

200 papers

Astrophysics and cosmology are rich with data. The advent of wide-area digital cameras on large aperture telescopes has led to ever more ambitious surveys of the sky. Data volumes of entire surveys a decade ago can now be acquired in a…

Instrumentation and Methods for Astrophysics · Physics 2017-04-18 Jan Kremer , Kristoffer Stensbo-Smidt , Fabian Gieseke , Kim Steenstrup Pedersen , Christian Igel

Large-sample data became prevalent as data acquisition became cheaper and easier. While a large sample size has theoretical advantages for many statistical methods, it presents computational challenges. Sketching, or compression, is a…

Machine Learning · Statistics 2020-05-11 Alexander F. Lapanowski , Irina Gaynanova

Weather and climate simulations produce petabytes of high-resolution data that are later analyzed by researchers in order to understand climate change or severe weather. We propose a new method of compressing this multidimensional weather…

Machine Learning · Computer Science 2023-04-17 Langwen Huang , Torsten Hoefler

There has been much interest in deploying deep learning algorithms on low-powered devices, including smartphones, drones, and medical sensors. However, full-scale deep neural networks are often too resource-intensive in terms of energy and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yoshitomo Matsubara , Ruihan Yang , Marco Levorato , Stephan Mandt

We discuss the problems of applying Maximum Likelihood methods to the CMB and how one can make it both efficient and optimal. The solution is a generalised eigenvalue problem that allows virtually no loss of information about the parameter…

Astrophysics · Physics 2007-05-23 Andy Taylor , Alan Heavens , Bill Ballinger , Max Tegmark

With the rapid advances of data acquisition techniques, spatio-temporal data are becoming increasingly abundant in a diverse array of disciplines. Here we develop spatio-temporal regression methodology for analyzing large amounts of…

Methodology · Statistics 2021-12-01 Ting Fung Ma , Fangfang Wang , Jun Zhu , Anthony R. Ives , Katarzyna E. Lewińska

Focusing on the well motivated aperture mass statistics $\Map$, we study the possibility of constraining cosmological parameters using future space based SNAP class weak lensing missions. Using completely analytical results we construct the…

Astrophysics · Physics 2007-05-23 Dipak Munshi , Patrick Valageas

The era of huge data necessitates highly efficient machine learning algorithms. Many common machine learning algorithms, however, rely on computationally intensive subroutines that are prohibitively expensive on large datasets. Oftentimes,…

Machine Learning · Computer Science 2023-09-26 Mo Tiwari

We address the problem of discretizing continuous cosmological signals such as a galaxy distribution for further processing with Fast Fourier techniques. Discretizing, in particular representing continuous signals by discrete sets of sample…

Instrumentation and Methods for Astrophysics · Physics 2009-01-21 J. Jasche , F. S. Kitaura , T. A. Ensslin

In recent years, deep learning models have been successfully employed for augmenting low-resolution cosmological simulations with small-scale information, a task known as "super-resolution". So far, these cosmological super-resolution…

Cosmology and Nongalactic Astrophysics · Physics 2024-11-14 Andreas Schanz , Florian List , Oliver Hahn

The rapid expansion in the size of new datasets has created a need for fast and efficient parameter-learning techniques. Compressive learning is a framework that enables efficient processing by using random, non-linear features to project…

Machine Learning · Computer Science 2025-08-18 Daniel Mas Montserrat , David Bonet , Maria Perera , Xavier Giró-i-Nieto , Alexander G. Ioannidis

We investigate the compression of quantum information with respect to a given set $\mathcal{M}$ of high-dimensional measurements. This leads to a notion of simulability, where we demand that the statistics obtained from $\mathcal{M}$ and an…

Learning meaningful representations is at the heart of many tasks in the field of modern machine learning. Recently, a lot of methods were introduced that allow learning of image representations without supervision. These representations…

How can we compress language models without sacrificing accuracy? The number of compression algorithms for language models is rapidly growing to benefit from remarkable advances of recent language models without side effects due to the…

Computation and Language · Computer Science 2024-01-30 Seungcheol Park , Jaehyeon Choi , Sojin Lee , U Kang

We develop a novel statistical strong lensing approach to probe the cosmological parameters by exploiting multiple redshift image systems behind galaxies or galaxy clusters. The method relies on free-form mass inversion of strong lenses and…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-17 M. Lubini , M. Sereno , J. Coles , Ph. Jetzer , P. Saha

The rapid growth of high-resolution scientific simulations and observation systems is generating massive spatiotemporal datasets, making efficient, error-bounded compression increasingly important. Meanwhile, decoder-only large language…

Machine Learning · Computer Science 2025-11-06 Guozhong Li , Muhannad Alhumaidi , Spiros Skiadopoulos , Panos Kalnis

A novel method of summation for power series is developed. The method is based on the self-similar approximation theory. The trick employed is in transforming, first, a series expansion into a product expansion and in applying the…

Statistical Mechanics · Physics 2009-11-10 V. I. Yukalov , S. Gluzman , D. Sornette

Automated analyses of the outcome of a simulation have been an important part of atomistic modeling since the early days, addressing the need of linking the behavior of individual atoms and the collective properties that are usually the…

Chemical Physics · Physics 2019-05-22 Michele Ceriotti

[Abridged] Galaxy clusters are the most massive gravitationally-bound systems in the universe and are widely considered to be an effective cosmological probe. We propose the first Machine Learning method using galaxy cluster properties to…

To analyze high-dimensional systems, many fields in science and engineering rely on high-level descriptions, sometimes called "macrostates," "coarse-grainings," or "effective theories". Examples of such descriptions include the…

Information Theory · Computer Science 2015-06-19 David H. Wolpert , Joshua A. Grochow , Eric Libby , Simon DeDeo