Related papers: Data Streams from the Low Frequency Instrument On-…
The Planck Low Frequency Instrument will recover polarization by differencing the outputs from radiometers sensitive to orthogonal polarizations. We contrast the systematic errors that afflict such a system with those that affect…
We describe the processing of the 531 billion raw data samples from the High Frequency Instrument (hereafter HFI), which we performed to produce six temperature maps from the first 473 days of Planck-HFI survey data. These maps provide an…
The amount of data generated and gathered in scientific simulations and data collection applications is continuously growing, putting mounting pressure on storage and bandwidth concerns. A means of reducing such issues is data compression;…
The Planck High Frequency Instrument (HFI) is designed to measure the temperature and polarization anisotropies of the Cosmic Microwave Background and galactic foregrounds in six wide bands centered at 100, 143, 217, 353, 545 and 857 GHz at…
The implementation of modern monitoring systems for power quality disturbances have the potential to generate substantial amounts of data, reaching a point where transmission and storage of high-frequency measurements become impractical.…
The volume of radio-astronomical data is a considerable burden in the processing and storing of radio observations with high time and frequency resolutions and large bandwidths. Lossy compression of interferometric radio-astronomical data…
The Herschel Space Observatory of ESA was launched in May 2009 and is in operation since. From its distant orbit around L2 it needs to transmit a huge quantity of information through a very limited bandwidth. This is especially true for the…
In this paper we discuss the issue of loosing telemetry (TM) data due to different reasons (e.g. spacecraft-ground transmissions) while performing a full-sky survey with space-borne instrumentation. This is a particularly important issue…
This paper describes the identification, modelling, and removal of previously unexplained systematic effects in the polarization data of the Planck High Frequency Instrument (HFI) on large angular scales, including new mapmaking and…
Error-controlled lossy compression has been studied for years because of extremely large volumes of data being produced by today's scientific simulations. None of existing lossy compressors, however, allow users to fix the peak…
Time series data compression is emerging as an important problem with the growth in IoT devices and sensors. Due to the presence of noise in these datasets, lossy compression can often provide significant compression gains without impacting…
The High Frequency Instrument (HFI) of Planck is the most sensitive CMB experiment ever planned. Statistical fluctuations (photon noise) of the CMB itself will be the major limitation to the sensitivity of the CMB channels. Higher frequency…
We present the current accounting of systematic effect uncertainties for the Low Frequency Instrument (LFI) that are relevant to the 2015 release of the Planck cosmological results, showing the robustness and consistency of our data set,…
this paper is part of the Prelaunch status LFI papers published on JINST: http://www.iop.org/EJ/journal/-page=extra.proc5/jinst The Low Frequency Instrument is optically interfaced with the ESA Planck telescope through 11 corrugated feed…
We present Planck LFI frequency sky maps derived within the BeyondPlanck framework. This framework draws samples from a global posterior distribution that includes instrumental, astrophysical and cosmological parameters, and the main…
We study the impact of the 1/f noise on the PLANCK Low Frequency Instrument (LFI) osbervations (Mandolesi et al 1998) and describe a simple method for removing striping effects from the maps for a number of different scanning stategies. A…
With ever-increasing volumes of scientific floating-point data being produced by high-performance computing applications, significantly reducing scientific floating-point data size is critical, and error-controlled lossy compressors have…
Current radio interferometers output multi-petabyte-scale volumes of data per year making the storage, transfer, and processing of this data a sizeable challenge. This challenge is expected to grow with the next-generation telescopes such…
The conventional approach to pre-process data for compression is to apply transforms such as the Fourier, the Karhunen-Lo\`{e}ve, or wavelet transforms. One drawback from adopting such an approach is that it is independent of the use of the…
Current data compression methods, such as sparsification in Federated Averaging (FedAvg), effectively enhance the communication efficiency of Federated Learning (FL). However, these methods encounter challenges such as the straggler problem…