English
Related papers

Related papers: Data Compression in the Petascale Astronomy Era: a…

200 papers

Astroinformatics is a new impact area in the world of astronomy, occasionally called the final frontier, where several astrophysicists, statisticians and computer scientists work together to tackle various data intensive astronomical…

Computational Engineering, Finance, and Science · Computer Science 2015-04-30 Snehanshu Saha , Surbhi Agrawal , Manikandan. R , Kakoli Bora , Swati Routh , Anand Narasimhamurthy

With the fast development of modern microscopes and bioimaging techniques, an unprecedentedly large amount of imaging data are being generated, stored, analyzed, and even shared through networks. The size of the data poses great challenges…

Image and Video Processing · Electrical Eng. & Systems 2024-01-17 Yu Zhou , Jan Sollmann , Jianxu Chen

Galaxy-galaxy strong lensing provides a powerful probe of galaxy formation, evolution, and the properties of dark matter and dark energy. However, conventional lens-modeling approaches are computationally expensive and require fine-tuning…

Instrumentation and Methods for Astrophysics · Physics 2025-08-07 Xiaoyue Cao , Ran Li , Nan Li , Yun Chen , Rui Li , Huanyuan Shan , Tian Li

We review the current state of data mining and machine learning in astronomy. 'Data Mining' can have a somewhat mixed connotation from the point of view of a researcher in this field. If used correctly, it can be a powerful approach,…

Instrumentation and Methods for Astrophysics · Physics 2010-08-11 Nicholas M. Ball , Robert J. Brunner

The light we observe from distant astrophysical objects including supernovae and quasars allows us to determine large distances in terms of a cosmological model. Despite the success of the standard cosmological model in fitting the data,…

Cosmology and Nongalactic Astrophysics · Physics 2024-05-07 Angela L. H. Ng

Empirically-determined scaling laws have been broadly successful in predicting the evolution of large machine learning models with training data and number of parameters. As a consequence, they have been useful for optimizing the allocation…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Katherine L. Mentzer , Andrea Montanari

The latest generation of radio astronomy interferometers will conduct all sky surveys with data products consisting of petabytes of spectral line data. Traditional approaches to identifying and parameterising the astrophysical sources…

Instrumentation and Methods for Astrophysics · Physics 2014-07-21 Stefan Westerlund , Christopher Harris

The changing heavens have played a central role in the scientific effort of astronomers for centuries. Galileo's synoptic observations of the moons of Jupiter and the phases of Venus starting in 1610, provided strong refutation of Ptolemaic…

Instrumentation and Methods for Astrophysics · Physics 2015-03-19 Joshua S. Bloom , Joseph W. Richards

Weak gravitational lensing has become a common tool to constrain the cosmological model. The majority of the methods to derive constraints on cosmological parameters use second-order statistics of the cosmic shear. Despite their success,…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-04 Sandrine Pires , Adrienne Leonard , Jean-Luc Starck

Fundamental changes are taking place in the way we do astronomy. In twenty years time, it is likely that most astronomers will never go near a cutting-edge telescope, which will be much more efficiently operated in service mode. They will…

Instrumentation and Methods for Astrophysics · Physics 2010-10-01 Ray P. Norris

Today's large-scale scientific applications running on high-performance computing (HPC) systems generate vast data volumes. Thus, data compression is becoming a critical technique to mitigate the storage burden and data-movement cost.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-04 Boyuan Zhang , Jiannan Tian , Sheng Di , Xiaodong Yu , Yunhe Feng , Xin Liang , Dingwen Tao , Franck Cappello

We describe a compression method for floating-point astronomical images that gives compression ratios of 6 -- 10 while still preserving the scientifically important information in the image. The pixel values are first preprocessed by…

Instrumentation and Methods for Astrophysics · Physics 2010-09-10 W. D. Pence , R. L. White , R. Seaman

Error-controlled lossy compressors have been widely used in scientific applications to reduce the unprecedented size of scientific data while keeping data distortion within a user-specified threshold. While they significantly mitigate the…

Databases · Computer Science 2026-03-27 Xuan Wu , Sheng Di , Tripti Agarwal , Kai Zhao , Xin Liang , Franck Cappello

Current cosmological observations allow for deviations from the standard growth of large-scale structures in the universe. These deviations could indicate modifications to General Relativity on cosmological scales or suggest the dynamical…

Cosmology and Nongalactic Astrophysics · Physics 2024-11-12 Yo Toda , Adrià Gómez-Valent , Kazuya Koyama

Early works on medical image compression date to the 1980's with the impetus on deployment of teleradiology systems for high-resolution digital X-ray detectors. Commercially deployed systems during the period could compress 4,096 x 4,096…

Computer Vision and Pattern Recognition · Computer Science 2018-05-21 Aupendu Kar , Sri Phani Krishna Karri , Nirmalya Ghosh , Ramanathan Sethuraman , Debdoot Sheet

An array of large observational programs using ground-based and space-borne telescopes is planned in the next decade. The forthcoming wide-field sky surveys are expected to deliver a sheer volume of data exceeding an exabyte. Processing the…

Instrumentation and Methods for Astrophysics · Physics 2023-05-26 Kana Moriwaki , Takahiro Nishimichi , Naoki Yoshida

Strong Lensing is a powerful probe of the matter distribution in galaxies and clusters and a relevant tool for cosmography. Analyses of strong gravitational lenses with Deep Learning have become a popular approach due to these astronomical…

The cosmic curvature density parameter has been constrained in the present work independent of any background cosmological model. The reconstruction is performed adopting the non-parametric Gaussian Processes (GP). The constraints on…

Cosmology and Nongalactic Astrophysics · Physics 2022-03-18 Purba Mukherjee , Narayan Banerjee

Data analysis and interpretation often relies on an approximation of an empirical dataset by some analytic functions or models. Actual implementations usually rely on a non-linear multi-dimensional optimization algorithm, typically…

Instrumentation and Methods for Astrophysics · Physics 2025-01-29 Igor Chilingarian , Kirill Grishin

Traditional analysis techniques may not be sufficient for astronomers to make the best use of the data sets that current and future instruments, such as the Square Kilometre Array and its Pathfinders, will produce. By utilizing the…

Instrumentation and Methods for Astrophysics · Physics 2010-01-14 Amr H. Hassan , Christopher J. Fluke , David G. Barnes