English
Related papers

Related papers: Data Compression for CMB Experiments

200 papers

People tend to store a lot of files inside theirs storage. When the storage nears it limit, they then try to reduce those files size to minimum by using data compression software. In this paper we propose a new algorithm for data…

Data Structures and Algorithms · Computer Science 2012-09-06 I. Made Agus Dwi Suarjaya

Deep neural networks have achieved strong performance in image classification tasks due to their ability to learn complex patterns from high-dimensional data. However, their large computational and memory requirements often limit deployment…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Sai Shi

We explore the fundamental limits to which reionization histories can be constrained using only large-scale cosmic microwave background (CMB) anisotropy measurements. The redshift distribution of the fractional ionization $x_e(z)$ affects…

Cosmology and Nongalactic Astrophysics · Physics 2020-01-31 D. J. Watts , G. E. Addison , C. L. Bennett , J. L. Weiland

This work describes Cosmic Microwave Background (CMB) data analysis algorithms and their implementations, developed to produce a pixelized map of the sky and a corresponding pixel-pixel noise correlation matrix from time ordered data for a…

We present efficient algorithms for CMB lensing simulation and power spectrum es- timation for flat-sky CMB polarization maps. We build a pure B-mode estimator to remedy E to B leakage due to partial sky coverage. We show that our…

Cosmology and Nongalactic Astrophysics · Physics 2013-11-14 Thibaut Louis , Sigurd Næss , Sudeep Das , Joanna Dunkley , Blake Sherwin

The new generation of CMB polarization experiments will reach limits of sensitivity never achieved before to detect the primordial B-mode signal. However, all these efforts will be futile if we lack a tight control of systematics. Here, we…

Cosmology and Nongalactic Astrophysics · Physics 2022-03-30 E. de la Hoz , P. Diego-Palazuelos , E. Martínez-González , P. Vielva , R. B. Barreiro , J. D. Bilbao-Ahedo

Linear models are used in online decision making, such as in machine learning, policy algorithms, and experimentation platforms. Many engineering systems that use linear models achieve computational efficiency through distributed systems…

Machine Learning · Computer Science 2021-03-04 Jeffrey Wong , Eskil Forsell , Randall Lewis , Tobias Mao , Matthew Wardrop

In the era of high precision CMB measurements, systematic effects are beginning to limit the ability to extract subtler cosmological information. The non-circularity of the experimental beam has become progressively important as CMB…

Astrophysics · Physics 2011-04-11 Tarun Souradeep , Sanjit Mitra , Anand Sengupta , Subharthi Ray , Rajib Saha

Large language models (LLMs) exhibit excellent performance in various tasks. However, the memory requirements of LLMs present a great challenge when deploying on memory-limited devices, even for quantized LLMs. This paper introduces a…

Computation and Language · Computer Science 2025-02-24 Weilan Wang , Yu Mao , Dongdong Tang , Hongchao Du , Nan Guan , Chun Jason Xue

Compressed sensing is a method that allows a significant reduction in the number of samples required for accurate measurements in many applications in experimental sciences and engineering. In this work, we show that compressed sensing can…

Chemical Physics · Physics 2015-06-05 X. Andrade , J. N. Sanders , A. Aspuru-Guzik

Gravitational lensing of the CMB is a valuable cosmological signal that correlates to tracers of large-scale structure and acts as a important source of confusion for primordial $B$-mode polarization. State-of-the-art lensing reconstruction…

Cosmology and Nongalactic Astrophysics · Physics 2019-02-05 Julien Carron , Antony Lewis

In order to handle large data sets omnipresent in modern science, efficient compression algorithms are necessary. Here, a Bayesian data compression (BDC) algorithm that adapts to the specific measurement situation is derived in the context…

Data Analysis, Statistics and Probability · Physics 2021-03-01 Johannes Harth-Kitzerow , Reimar Leike , Philipp Arras , Torsten A. Enßlin

Processing, storing and communicating information that originates as an analog signal involves conversion of this information to bits. This conversion can be described by the combined effect of sampling and quantization, as illustrated in…

Information Theory · Computer Science 2018-05-23 Alon Kipnis , Yonina C. Eldar , Andrea J. Goldsmith

A simple hard-thresholding operation is shown to be able to recover $L$ signals $\mathbf{x}_1,...,\mathbf{x}_L \in \mathbb{R}^n$ that share a common support of size $s$ from $m = \mathcal{O}(s)$ one-bit measurements per signal if $L \ge…

Information Theory · Computer Science 2018-09-18 Johannes Maly , Lars Palzer

We formulate the problem of performing optimal data compression under the constraints that compressed data can be used for accurate classification in machine learning. We show that this translates to a problem of minimizing the mutual…

Signal Processing · Electrical Eng. & Systems 2022-11-04 Jingchao Gao , Ao Tang , Weiyu Xu

This paper generalises the hybrid power spectrum estimator developed in Efstathiou (2004a) to the estimation of polarization power spectra of the cosmic microwave background radiation. The hybrid power spectrum estimator is unbiased and we…

Astrophysics · Physics 2009-11-11 G. Efstathiou

We present herein a scheme by which to accurately evaluate the error exponents of a lossy data compression problem, which characterize average probabilities over a code ensemble of compression failure and success above or below a critical…

Statistical Mechanics · Physics 2007-05-23 Tadaaki Hosaka , Yoshiyuki Kabashima

The development of deep learning algorithms has extensively empowered humanity's task automatization capacity. However, the huge improvement in the performance of these models is highly correlated with their increasing level of complexity,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Eduarda Caldeira , Pedro C. Neto , Marco Huber , Naser Damer , Ana F. Sequeira

One approach to reconciling local measurements of a high expansion rate with observations of acoustic oscillations in the CMB and galaxy clustering (the "Hubble tension") is to introduce additional contributions to the $\Lambda$CDM model…

Cosmology and Nongalactic Astrophysics · Physics 2026-01-09 Raphaël Kou , Antony Lewis

We investigate the compression of quantum information with respect to a given set $\mathcal{M}$ of high-dimensional measurements. This leads to a notion of simulability, where we demand that the statistics obtained from $\mathcal{M}$ and an…