English
Related papers

Related papers: AstroCompress: A benchmark dataset for multi-purpo…

200 papers

Astronomy is one of the most data-intensive of the sciences. Data technology is accelerating the quality and effectiveness of its research, and the rate of astronomical discovery is higher than ever. As a result, many view astronomy as…

Astrophysics · Physics 2007-05-23 Ray P Norris

Error-controlled lossy compression has been studied for years because of extremely large volumes of data being produced by today's scientific simulations. None of existing lossy compressors, however, allow users to fix the peak…

Information Theory · Computer Science 2018-07-17 Dingwen Tao , Sheng Di , Xin Liang , Zizhong Chen , Franck Cappello

Data compression algorithms typically rely on identifying repeated sequences of symbols from the original data to provide a compact representation of the same information, while maintaining the ability to recover the original data from the…

Databases · Computer Science 2023-08-08 Francesco Taurone , Daniel E. Lucani , Marcell Fehér , Qi Zhang

Over the past century, major advances in astronomy and astrophysics have been largely driven by improvements in instrumentation and data collection. With the amassing of high quality data from new telescopes, and especially with the advent…

Upcoming and future astronomy research facilities will systematically generate terabyte-sized data sets moving astronomy into the Petascale data era. While such facilities will provide astronomers with unprecedented levels of accuracy and…

Instrumentation and Methods for Astrophysics · Physics 2011-11-30 A. H. Hassan , C. J. Fluke , D. G. Barnes

In cosmology, the analysis of observational evidence is very important to test theoretical models of the Universe. Artificial neural networks are powerful and versatile computational tools for data modelling and are recently being…

Cosmology and Nongalactic Astrophysics · Physics 2022-02-15 Juan de Dios Rojas Olvera , Isidro Gómez-Vargas , J. Alberto Vázquez

Lossy Image compression is necessary for efficient storage and transfer of data. Typically the trade-off between bit-rate and quality determines the optimal compression level. This makes the image quality metric an integral part of any…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Juan Carlos Mier , Eddie Huang , Hossein Talebi , Feng Yang , Peyman Milanfar

Our increasingly digital and connected world has led to the generation of unprecedented amounts of data. This data must be efficiently managed, transmitted, and stored to preserve resources and allow scalability. Data compression has…

Information Theory · Computer Science 2025-10-09 Jonas G. Matt , Pengcheng Huang , Balz Maag

Advanced instruments in a variety of scientific domains are collecting massive amounts of data that must be post-processed and organized to support scientific research activities. Astronomers have been pioneers in the use of databases to…

Astrophysics · Physics 2007-05-23 Y. Dora Cai , Ruth Aydt , Robert J. Brunner

Today's astronomical projects need computational systems capable to store and analyze large amounts of scientific data, to effectively share data with other research Institutes and to easily implement information services to present data…

Astrophysics · Physics 2007-05-23 G. Calderone , L. Nicastro

Context: With the advancement of solar physics research, next-generation solar space missions and ground-based telescopes face significant challenges in efficiently transmitting and/or storing large-scale observational data. Aims: We…

Instrumentation and Methods for Astrophysics · Physics 2025-10-27 Zedong Liu , Song Tan , Alexander Warmuth , Frédéric Schuller , Yun Hong , Wenjing Huang , Yida Gu , Bojing Zhu , Guangming Tan , Dingwen Tao

Today's scientific simulations, for example in the high-performance exascale sector, produce huge amounts of data. Due to limited I/O bandwidth and available storage space, there is the necessity to reduce scientific data of high…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-25 N. Böing , J. Holke , C. Hergl , L. Spataro , G. Gassner , A. Basermann

The data volumes stored in telescope archives is constantly increasing due to the development and improvements in the instrumentation. Often the archives need to be stored over a distributed storage architecture, provided by independent…

Instrumentation and Methods for Astrophysics · Physics 2022-02-07 Y. G. Grange , V. N. Pandey , X. Espinal , R. Di Maria , A. P. Millar

Using optical hardware for neuromorphic computing has become more and more popular recently due to its efficient high-speed data processing capabilities and low power consumption. However, there are still some remaining obstacles to…

Emerging Technologies · Computer Science 2019-08-08 Chonghuai Ma , Floris Laporte , Joni Dambre , Peter Bienstman

Complexity science offers a wide range of measures for quantifying unpredictability, structure, and information. Yet, a systematic conceptual organization of these measures is still missing. We present a unified framework that locates…

Machine Learning · Computer Science 2025-05-13 Nima Dehghani

Lossy compression is one of the most effective methods for reducing the size of scientific data containing multiple data fields. It reduces information density through prediction or transformation techniques to compress the data. Previous…

Machine Learning · Computer Science 2024-09-30 Youyuan Liu , Wenqi Jia , Taolue Yang , Miao Yin , Sian Jin

Nowadays there is no field research which is not flooded with data. Among the sciences, Astrophysics has always been driven by the analysis of massive amounts of data. The development of new and more sophisticated observation facilities,…

Instrumentation and Methods for Astrophysics · Physics 2017-06-14 Mauro Garofalo , Alessio Botta , Giorgio Ventre

Policy Brief on "Global Data in Astronomy: Challenges and Opportunities", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July…

Instrumentation and Methods for Astrophysics · Physics 2024-02-21 Renee Hložek , Chenzhou Cui , Mark Allen , Patricia Whitelock , Jess McIver , Giuseppe Longo , Christopher Fluke , Ajit Kembhavi , Pranav Sharma , Ashish Mahabal

Inspired by the human brain's structure and function, neuromorphic computing has emerged as a promising approach for developing energy-efficient and powerful computing systems. Neuromorphic computing offers significant processing speed and…

Emerging Technologies · Computer Science 2023-11-28 Jonathan Naoukin , Murat Isik , Karn Tiwari

Data management is becoming increasingly important in dealing with the large amounts of data produced by large-scale scientific simulations and instruments. Existing multilevel compression algorithms offer a promising way to manage…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-12 Xin Liang , Ben Whitney , Jieyang Chen , Lipeng Wan , Qing Liu , Dingwen Tao , James Kress , Dave Pugmire , Matthew Wolf , Norbert Podhorszki , Scott Klasky
‹ Prev 1 3 4 5 6 7 10 Next ›