English
Related papers

Related papers: Data Compression in the Petascale Astronomy Era: a…

200 papers

Photometric redshift surveys map the distribution of matter in the Universe through the positions and shapes of galaxies with poorly resolved measurements of their radial coordinates. While a tomographic analysis can be used to recover some…

Cosmology and Nongalactic Astrophysics · Physics 2017-12-06 David Alonso

The increasing volume and velocity of science data necessitate the frequent movement of enormous data volumes as part of routine research activities. As a result, limited wide-area bandwidth often leads to bottlenecks in research progress.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-12 Yuanjian Liu , Sheng Di , Kyle Chard , Ian Foster , Franck Cappello

We present a data-driven technique to analyze multifrequency images from upcoming cosmological surveys mapping large sky area. Using full information from the data at the two-point level, our method can simultaneously constrain the…

Cosmology and Nongalactic Astrophysics · Physics 2023-03-01 Yun-Ting Cheng , Benjamin D. Wandelt , Tzu-Ching Chang , Olivier Dore

Lossy compression has become an important technique to reduce data size in many domains. This type of compression is especially valuable for large-scale scientific data, whose size ranges up to several petabytes. Although Autoencoder-based…

Machine Learning · Computer Science 2024-07-03 Hieu Le , Jian Tao

We describe the application of data mining algorithms to research problems in astronomy. We posit that data mining has always been fundamental to astronomical research, since data mining is the basis of evidence-based discovery, including…

Instrumentation and Methods for Astrophysics · Physics 2009-11-04 Kirk Borne

Revealing hidden patterns in astronomical data is often the path to fundamental scientific breakthroughs; meanwhile the complexity of scientific inquiry increases as more subtle relationships are sought. Contemporary data analysis problems…

Instrumentation and Methods for Astrophysics · Physics 2015-05-26 R. S. de Souza , E. Cameron , M. Killedar , J. Hilbe , R. Vilalta , U. Maio , V. Biffi , B. Ciardi , J. D. Riggs

In the last decade a new generation of telescopes and sensors has allowed the production of a very large amount of data and astronomy has become a data-rich science. New automatic methods largely based on machine learning are needed to cope…

Instrumentation and Methods for Astrophysics · Physics 2014-06-13 Stefano Cavuoti , Massimo Brescia , Giuseppe Longo

The volume of radio-astronomical data is a considerable burden in the processing and storing of radio observations with high time and frequency resolutions and large bandwidths. Lossy compression of interferometric radio-astronomical data…

Instrumentation and Methods for Astrophysics · Physics 2016-11-09 A. R. Offringa

Strongly gravitational lensing systems (SGL) encodes cosmology information in source/lens distance ratios $\mathcal{D}_{\rm obs}=\mathcal{D}_{\rm ls}/\mathcal{D}_{\rm s}$, which can be used to precisely constrain cosmological parameters. In…

Cosmology and Nongalactic Astrophysics · Physics 2019-12-05 Tonghua Liu , Shuo Cao , Jia Zhang , Shuaibo Geng , Yuting Liu , Xuan Ji , Zong-Hong Zhu

Policy Brief on "Global Data in Astronomy: Challenges and Opportunities", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July…

Instrumentation and Methods for Astrophysics · Physics 2024-02-21 Renee Hložek , Chenzhou Cui , Mark Allen , Patricia Whitelock , Jess McIver , Giuseppe Longo , Christopher Fluke , Ajit Kembhavi , Pranav Sharma , Ashish Mahabal

We present a systematic evaluation of JPEG2000 (ISO/IEC 15444) as a transport data format to enable rapid remote searches for fast transient events as part of the Deeper Wider Faster program (DWF). DWF uses ~20 telescopes from radio to…

Instrumentation and Methods for Astrophysics · Physics 2017-09-13 Dany Vohl , Tyler Pritchard , Igor Andreoni , Jeffrey Cooke , Bernard Meade

Many scientific applications opt for particles instead of meshes as their basic primitives to model complex systems composed of billions of discrete entities. Such applications span a diverse array of scientific domains, including molecular…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-04 Longtao Zhang , Ruoyu Li , Congrong Ren , Sheng Di , Jinyang Liu , Jiajun Huang , Robert Underwood , Pascal Grosset , Dingwen Tao , Xin Liang , Hanqi Guo , Franck Capello , Kai Zhao

A key processing step in ground-based astronomy involves combining multiple noisy and blurry exposures to produce an image of the night sky with an improved signal-to-noise ratio. Typically, this is achieved via image coaddition, and can be…

Instrumentation and Methods for Astrophysics · Physics 2025-09-15 Yashil Sukurdeep , Tamás Budavári , Andrew J. Connolly , Fausto Navarro

Strong lensing has developed into an important astrophysical tool for probing both cosmology and galaxies (their structure, formation, and evolution). Using the gravitational lensing theory and cluster mass distribution model, we try to…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-28 Shuo Cao , Yu Pan , Marek Biesiada , Wlodzimierz Godlowski , Zong-Hong Zhu

The last two decades have seen a major expansion in the availability, size, and precision of time-domain datasets in astronomy. Owing to their unique combination of flexibility, mathematical simplicity and comparative robustness, Gaussian…

Instrumentation and Methods for Astrophysics · Physics 2022-11-11 Suzanne Aigrain , Daniel Foreman-Mackey

The gravitational fields of astrophysical bodies bend the light around them, creating multiple paths along which light from a distant source can arrive at Earth. Measuring the difference in photon arrival time along these different paths…

In this study, we introduce a novel analytical Gaussian Process (GP) cosmography methodology, leveraging the differentiable properties of GPs to derive key cosmological quantities analytically. Our approach combines cosmic chronometer (CC)…

Cosmology and Nongalactic Astrophysics · Physics 2024-04-19 Bikash R. Dinda

From the moment astronomical observations are made the resulting data products begin to grow stale. Even if perfect binary copies are preserved through repeated timely migration to more robust storage media, data standards evolve and new…

Instrumentation and Methods for Astrophysics · Physics 2014-10-15 Rob Seaman

Lossless image compression is an important task in the field of multimedia communication. Traditional image codecs typically support lossless mode, such as WebP, JPEG2000, FLIF. Recently, deep learning based approaches have started to show…

Image and Video Processing · Electrical Eng. & Systems 2020-02-06 Zhengxue Cheng , Heming Sun , Masaru Takeuchi , Jiro Katto

Surveys with submillimetre telescopes are revealing large numbers of gravitationally lensed high-redshift sources. I describe how, in practice, these lensed systems could be simultaneously used to estimate the values of cosmological…

Cosmology and Nongalactic Astrophysics · Physics 2017-03-08 Stephen Eales