English
Related papers

Related papers: The Brazilian Science Data Center (BSDC)

200 papers

We are in the era of the Big Data. In Astronomy and Astrophysics, the massive amounts of data generated are, as of today, in the Peta-scale if not already in the Exa-scale. In the near future, we will see the data collected size and…

Instrumentation and Methods for Astrophysics · Physics 2023-02-23 S. Bertocco

We present CosmoHub (https://cosmohub.pic.es), a web application based on Hadoop to perform interactive exploration and distribution of massive cosmological datasets. Recent Cosmology seeks to unveil the nature of both dark matter and dark…

An array of large observational programs using ground-based and space-borne telescopes is planned in the next decade. The forthcoming wide-field sky surveys are expected to deliver a sheer volume of data exceeding an exabyte. Processing the…

Instrumentation and Methods for Astrophysics · Physics 2023-05-26 Kana Moriwaki , Takahiro Nishimichi , Naoki Yoshida

With SKA precursor and pathfinder operations in full swing, radio and (sub-)mm astronomy is entering the era of super big data. The big questions is how to make (sub-)mm and radio data available to the astronomical community, preferably…

Instrumentation and Methods for Astrophysics · Physics 2020-12-23 K. A. Lutz , J. Dempsey , Y. G. Grange , M. Kettenis , M. Lacy , C. Schollar

The amount of data in the world is expanding rapidly. Every day, huge amounts of data are created by scientific experiments, companies, and end users' activities. These large data sets have been labeled as "Big Data", and their storage,…

Databases · Computer Science 2020-04-29 Mahdi Bohlouli , Frank Schulz , Lefteris Angelis , David Pahor , Ivona Brandic , David Atlan , Rosemary Tate

Energy systems generate vast amounts of data in extremely short time intervals, creating challenges for efficient data management. Traditional data management methods often struggle with scalability and accessibility, limiting their…

Databases · Computer Science 2025-07-28 Lunodzo J. Mwinuka , Massimo Cafaro , Lucas Pereira , Hugo Morais

Scientists in all domains face a data avalanche - both from better instruments and from improved simulations. We believe that computer science tools and computer scientists are in a position to help all the sciences by building tools and…

Databases · Computer Science 2007-05-23 Jim Gray , Alexander S. Szalay

Sharing scientific data, with the objective of making it fully discoverable, accessible, assessable, intelligible, usable, and interoperable, requires work at the disciplinary level to define in particular how the data should be formatted…

Instrumentation and Methods for Astrophysics · Physics 2017-10-19 Françoise Genova , Christophe Arviset , Bridget M. Almas , Laura Bartolo , Daan Broeder , Emily Law , Brian McMahon

Nowadays astroparticle physics faces a rapid data volume increase. Meanwhile, there are still challenges of testing the theoretical models for clarifying the origin of cosmic rays by applying a multi-messenger approach, machine learning and…

Instrumentation and Methods for Astrophysics · Physics 2019-07-05 V. Tokareva , A. Haungs , D. Kang , D. Kostunin , F. Polgart , D. Wochele , J. Wochele

In most High Performance Computing (HPC) projects nowadays, there is a lot of data obtained from different sources, depending on the project's objectives. Some of that data is very huge in terms of size, so copying such data sometimes is an…

Cryptography and Security · Computer Science 2026-01-21 Gian Sebastian Mier Bello , Alexander Martinez Mendez , Carlos J. Barrios H. , Robinson Rivas , Luis A. Núñez

Astronomy looks after its data better than most disciplines, and it is no coincidence that the consensus standard for the archival preservation of all types of digital assets -- the OAIS Reference Model -- emerged originally from the space…

Instrumentation and Methods for Astrophysics · Physics 2011-06-21 Norman Gray , Graham Woan

Standardizing and incentivizing the use of digital object identifiers (DOIs) to aggregate and identify both data analyzed and data generated by a research project will advance the field of astronomy to match best practices in other research…

Digital Libraries · Computer Science 2018-05-23 Jenny Novacescu , Joshua E. G. Peek , Sarah Weissman , Scott W. Fleming , Karen Levay , Elizabeth Fraser

Since its inception in 1993, the ADS Abstract Service has become an indispensable research tool for astronomers and astrophysicists worldwide. In those seven years, much effort has been directed toward improving both the quantity and the…

Astrophysics · Physics 2009-10-31 C. Grant , A. Accomazzi , G. Eichhorn , M. J. Kurtz , S. S. Murray

Data collected by large-scale instruments, observatories, and sensor networks are key enablers of scientific discoveries in many disciplines. However, ensuring that these data can be accessed, integrated, and analyzed in a democratized and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-14 Yubo Qin , Ivan Rodero , Manish Parashar

Observatories are complex scientific and technical institutions serving diverse users and purposes. Their telescopes, instruments, software, and human resources engage in interwoven workflows over a broad range of timescales. These…

Instrumentation and Methods for Astrophysics · Physics 2014-07-30 Robert L. Seaman , W. Thomas Vestrand , Frederic V. Hessman

There is an opportunity to advance both solar system and extrasolar planetary studies that does not require the construction of new telescopes or new missions but better use and access to inter-disciplinary data sets. This approach…

Instrumentation and Methods for Astrophysics · Physics 2019-03-19 Daniel J. Crichton , J. Steve Hughes , Gael Roudier , Robert A. West , Jeffrey Jewell , Geoffrey Bryden , Mark Swain , T. Joseph W. Lazio

Data access -- or the availability of new and archival data for use by the larger community -- is key for scientific advancement. How data is presented, searched, and formatted determines accessibility and it can be difficult to find a…

Instrumentation and Methods for Astrophysics · Physics 2024-11-21 Caleb Wheeler , Natalie R. Hinkel , Andrea Banzatti

Spatial data science has emerged in recent years as an interdisciplinary field. This position paper discusses the importance of building and sharing high-quality datasets for spatial data science.

Computers and Society · Computer Science 2020-07-17 Yingjie Hu

Astronomy datasets can be challenging to use for high school astronomy classes. Data science education pedagogy can be leveraged to create astronomy activities in which students interrogate data, create visuals, and use statistical thinking…

Physics Education · Physics 2025-01-10 James Newland