Related papers: A compression scheme for radio data in high perfor…
In the recent years, heterogeneous machine learning accelerators have become of significant interest in science, engineering and industry. The major processing speed bottlenecks in these platforms come from (a) an electronic data…
We describe the reduction of data taken with the PACS instrument on board the Herschel Space Observatory in the Science Demonstration Phase of the Herschel-ATLAS (H-ATLAS) survey, specifically data obtained for a 4x4-deg^2 region using…
Gravitational-wave astronomy seeks to extract information about astrophysical systems from the gravitational-wave signals they emit. For coalescing compact-binary sources this requires accurate model templates for the inspiral and,…
Data compression plays a key role in reducing storage and I/O costs. Traditional lossy methods primarily target data on rectilinear grids and cannot leverage the spatial coherence in unstructured mesh data, leading to suboptimal compression…
Since its original use on the Hubble Deep Field, "Drizzle" has become a de facto standard for the combination of images taken by the Hubble Space Tele- scope. However, the drizzle algorithm was developed with small, faint, partially…
In a typical MIMO radar scenario, transmit nodes transmit orthogonal waveforms, while each receive node performs matched filtering with the known set of transmit waveforms, and forwards the results to the fusion center. Based on the data it…
Extreme-scale cosmological simulations have been widely used by today's researchers and scientists on leadership supercomputers. A new generation of error-bounded lossy compressors has been used in workflows to reduce storage requirements…
Radio interferometers observe the Fourier space of the sky, at locations determined by the array geometry. Before a real space image is constructed by a Fourier transform, the data is weighted to improve the quality of reconstruction. Two…
We investigate the possibility of performing cosmological studies in the redshift range $2.5<z<5$ through suitable extensions of existing and upcoming radio-telescopes like CHIME, HIRAX and FAST. We use the Fisher matrix technique to…
Many information systems employ lossy compression as a crucial intermediate stage among other processing components. While the important distortion is defined by the system's input and output signals, the compression usually ignores the…
Modern astronomical data processing requires complex software pipelines to process ever growing datasets. For radio astronomy, these pipelines have become so large that they need to be distributed across a computational cluster. This makes…
The sheer volume of data anticipated to be captured by future radio telescopes, such as, The Square Kilometer Array (SKA) and its precursors present new data challenges, including the cost and technical feasibility of data transport and…
Precision measurements of the beam pattern response are needed to predict the response of a radio telescope. Mapping the beam of a low frequency radio array presents a unique challenge and science cases such as the observation of the 21\,cm…
Efficient lossless coding of medical volume data with temporal axis can be achieved by motion compensated wavelet lifting. As side benefit, a scalable bit stream is generated, which allows for displaying the data at different resolution…
The paper reviews progress in imaging in radio interferometry for the period 1993-1996. Unlike an optical telescope, the basic measurements of a radio interferometer (correlations between antennas) are indirectly related to a sky brightness…
This work proposes to reduce visibility data volume using a baseline-dependent lossy compression technique that preserves smearing at the edges of the field-of-view. We exploit the relation of the rank of a matrix and the fact that a…
Recent studies have shown that the efficiency of deep neural networks in mobile applications can be significantly improved by distributing the computational workload between the mobile device and the cloud. This paradigm, termed…
Memory and network bandwidth are decisive bottlenecks when handling high-resolution multidimensional data sets in visualization applications, and they increasingly demand suitable data compression strategies. We introduce a novel lossy…
The CHIME radio telescope operates in the frequency bandwidth of 400 to 800 MHz. The CHIME/FRB collaboration has a data pipeline that analyzes the data in real time, suppresses radio frequency interferences (RFI) and searches for FRBs.…
Here we present a general algorithm for processing microcalorimeter data with special applicability to data with high photon count rates. Conventional optimal filtering, which has become ubiquitous in microcalorimeter data processing,…