English
Related papers

Related papers: AstroCompress: A benchmark dataset for multi-purpo…

200 papers

An array of large observational programs using ground-based and space-borne telescopes is planned in the next decade. The forthcoming wide-field sky surveys are expected to deliver a sheer volume of data exceeding an exabyte. Processing the…

Instrumentation and Methods for Astrophysics · Physics 2023-05-26 Kana Moriwaki , Takahiro Nishimichi , Naoki Yoshida

Astronomical observations already produce vast amounts of data through a new generation of telescopes that cannot be analyzed manually. Next-generation telescopes such as the Large Synoptic Survey Telescope and the Square Kilometer Array…

Instrumentation and Methods for Astrophysics · Physics 2019-10-09 Giuseppe Longo , Erzsébet Merényi , Peter Tino

Scientific datasets present unique challenges for machine learning-driven compression methods, including more stringent requirements on accuracy and mitigation of potential invalidating artifacts. Drawing on results from compressed sensing…

Machine Learning · Computer Science 2024-05-24 Matthias Chung , Rick Archibald , Paul Atzberger , Jack Michael Solomon

Error-controlled lossy compressors have been widely used in scientific applications to reduce the unprecedented size of scientific data while keeping data distortion within a user-specified threshold. While they significantly mitigate the…

Databases · Computer Science 2026-03-27 Xuan Wu , Sheng Di , Tripti Agarwal , Kai Zhao , Xin Liang , Franck Cappello

Astronomy is increasingly encountering two fundamental truths: (1) The field is faced with the task of extracting useful information from extremely large, complex, and high dimensional datasets; (2) The techniques of astroinformatics and…

Instrumentation and Methods for Astrophysics · Physics 2011-10-28 Nicholas M. Ball

This paper addresses about various image compression techniques. On the basis of analyzing the various image compression techniques this paper presents a survey of existing research papers. In this paper we analyze different types of…

Information Theory · Computer Science 2013-11-28 Gaurav Vijayvargiya , Sanjay Silakari , Rajeev Pandey

Data volumes from multiple sky surveys have grown from gigabytes into terabytes during the past decade, and will grow from terabytes into tens (or hundreds) of petabytes in the next decade. This exponential growth of new data both enables…

Instrumentation and Methods for Astrophysics · Physics 2009-11-04 Kirk D. Borne

The advent of large data-set in cosmology has meant that in the past 10 or 20 years our knowledge and understanding of the Universe has changed not only quantitatively but also, and most importantly, qualitatively. Cosmologists rely on data…

Cosmology and Nongalactic Astrophysics · Physics 2014-11-20 Licia Verde

This paper presents a systematic literature review focusing on the application of machine learning techniques for deriving observational constraints in cosmology. The goal is to evaluate and synthesize existing research to identify…

Cosmology and Nongalactic Astrophysics · Physics 2025-10-14 Luis Rojas , Sebastián Espinoza , Esteban González , Carlos Maldonado , Fei Luo

Radio astronomical observations have very poor signal to noise ratios, unlike in other disciplines. On the other hand, it is possible to observe the object of interest for long time intervals as well as using a wider bandwidth.…

Astrophysics · Physics 2008-09-02 Sarod Yatawatta

We analyse the issues involved in the management and mining of astrophysical data. The traditional approach to data management in the astrophysical field is not able to keep up with the increasing size of the data gathered by modern…

Databases · Computer Science 2007-05-23 M. Frailis , A. De Angelis , V. Roberto

Combining different observational probes, such as galaxy clustering and weak lensing, is a promising technique for unveiling the physics of the Universe with upcoming dark energy experiments. The galaxy redshift sample from the Dark Energy…

The New Vacuum Solar Telescope (NVST) is a 1-m solar telescope that aims to observe the fine structures in both the photosphere and the chromosphere of the Sun. The observational data acquired simultaneously from one channel for the…

Instrumentation and Methods for Astrophysics · Physics 2016-12-23 Ying-bo Liu , Feng Wang , Hui Deng , Kai-fan Ji , Wei Dai , Shou-lin Wei , Bo Liang , Xiao-li Zhang

The large amount of cosmological data already available (and in the near future) makes necessary the development of efficient numerical codes. Many software products have been implemented to perform cosmological analyses considering one or…

Cosmology and Nongalactic Astrophysics · Physics 2022-03-16 Sandro Dias Pinto Vitenti , Mariana Penna-Lima

Change detection from satellite images typically incurs a delay ranging from several hours up to days because of latency in downlinking the acquired images and generating orthorectified image products at the ground stations; this may…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Gabriele Inzerillo , Diego Valsesia , Aniello Fiengo , Enrico Magli

This paper presents error-bounded lossy compression tailored for particle datasets from diverse scientific applications in cosmology, fluid dynamics, and fusion energy sciences. As today's high-performance computing capabilities advance,…

Information Theory · Computer Science 2024-04-05 Congrong Ren , Sheng Di , Longtao Zhang , Kai Zhao , Hanqi Guo

Over the past decade, astronomers have been using an increasingly larger number of web-based applications and archives to conduct their research. However, despite the early success in creating links across projects and data centers, the…

Instrumentation and Methods for Astrophysics · Physics 2015-03-17 Alberto Accomazzi , Michael J. Kurtz , Stephen S. Murray

Photometric redshift surveys map the distribution of matter in the Universe through the positions and shapes of galaxies with poorly resolved measurements of their radial coordinates. While a tomographic analysis can be used to recover some…

Cosmology and Nongalactic Astrophysics · Physics 2017-12-06 David Alonso

There is a proliferation in the number of satellites launched each year, resulting in downlinking of terabytes of data each day. The data received by ground stations is often unprocessed, making this an expensive process considering the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Martina Lofqvist , José Cano

All sciences, including astronomy, are now entering the era of information abundance. The exponentially increasing volume and complexity of modern data sets promises to transform the scientific practice, but also poses a number of common…

Astrophysics · Physics 2016-11-17 S. G. Djorgovski