Related papers: Data Compression in the Petascale Astronomy Era: a…
Several cosmological measurements have attained significant levels of maturity and accuracy over the last decade. Continuing this trend, future observations promise measurements of the statistics of the cosmic mass distribution at an…
During the training of Large Language Models (LLMs), tensor data is periodically "checkpointed" to persistent storage to allow recovery of work done in the event of failure. The volume of data that must be copied during each checkpoint,…
In the era of mega-constellations, the need for accurate and publicly available information has become fundamental for satellite operators to guarantee the safety of spacecrafts and the Low Earth Orbit (LEO) space environment. This study…
Data compression plays a key role in reducing storage and I/O costs. Traditional lossy methods primarily target data on rectilinear grids and cannot leverage the spatial coherence in unstructured mesh data, leading to suboptimal compression…
The identification of strong gravitational lenses in large surveys has historically been a rather time consuming exercise. Early data from the Herschel Astrophysical Terahertz Large Area Survey (Herschel-ATLAS) demonstrate that lenses can…
Since the first detection of gravitational waves in 2015, gravitational-wave astronomy has emerged as a rapidly advancing field that holds great potential for studying the cosmos, from probing the properties of black holes to testing the…
The standardisation of gamma-ray astronomical data emerged in recent years as a necessity for the future generation of gamma-ray observatories. Nevertheless, adopting a common format for gamma-ray instruments can already benefit the current…
Compressive sensing promises to enable bandwidth-efficient on-board compression of astronomical data by lifting the encoding complexity from the source to the receiver. The signal is recovered off-line, exploiting GPUs parallel computation…
Weak gravitational lensing is one of the most promising cosmological probes of the late universe. Several large ongoing (DES, KiDS, HSC) and planned (LSST, EUCLID, WFIRST) astronomical surveys attempt to collect even deeper and larger scale…
Gaussian processes provide a method for extracting cosmological information from observations without assuming a cosmological model. We carry out cosmography -- mapping the time evolution of the cosmic expansion -- in a model-independent…
As high-performance computing architectures evolve, more scientific computing workflows are being deployed on advanced computing platforms such as GPUs. These workflows can produce raw data at extremely high throughputs, requiring urgent…
Modern radio telescopes generate large amounts of data, with the next generation Very Large Array (ngVLA) and the Square Kilometre Array (SKA) expected to feed up to 292 GB of visibilities per second to the science data processor (SDP).…
Lossless image compression is an essential research field in image compression. Recently, learning-based image compression methods achieved impressive performance compared with traditional lossless methods, such as WebP, JPEG2000, and FLIF.…
Cosmological gravitational microlensing is a useful technique for understanding the structure of the inner parts of a quasar, especially the accretion disk and the central supermassive black hole. So far, most of the cosmological…
The next generation of radio astronomy telescopes are challenging existing data analysis paradigms, as they have an order of magnitude more antennas and larger bandwidth. Foremost amongst these are deep spectral line surveys, because these…
Where appropriate repositories are not available to support all relevant astronomical data products, data can fall into darkness: unseen and unavailable for future reference and re-use. Some data in this category are legacy or old data, but…
We analyse the issues involved in the management and mining of astrophysical data. The traditional approach to data management in the astrophysical field is not able to keep up with the increasing size of the data gathered by modern…
Strong lensing gravitational time delays are a powerful and cost effective probe of dark energy. Recent studies have shown that a single lens can provide a distance measurement with 6-7 % accuracy (including random and systematic…
Context. Explaining the accelerated expansion of the Universe is one of the fundamental challenges in physics today. Cosmography provides information about the evolution of the universe derived from measured distances, assuming only that…
In recent years, gravitational lensing has been used as a means to detect substructure in galaxy-sized halos, via anomalous flux ratios in quadruply-imaged lenses. In addition to causing anomalous flux ratios, substructure may also perturb…