English
Related papers

Related papers: Reimplementing the Hierarchical Data System using …

200 papers

The Vera C. Rubin Observatory will generate an unprecedented volume of data, including approximately 60 petabytes of raw data and around 30 trillion observed sources, posing a significant challenge for large-scale and end-user scientific…

We present status and results of AstroGrid-D, a joint effort of astrophysicists and computer scientists to employ grid technology for scientific applications. AstroGrid-D provides access to a network of distributed machines with a set of…

ADASS used to hold a regular FITS BoF (Birds of a Feather meeting). As other data formats started to be used along with FITS, this became a Data Formats BoF, and there was some element of competition between formats, together with an…

Instrumentation and Methods for Astrophysics · Physics 2026-05-21 Keith Shortridge

In this paper we describe our efforts to bring scientific data into the digital library. This has required extension of the standard WWW, and also the extension of metadata standards far beyond the Dublin Core. Our system demonstrates this…

Digital Libraries · Computer Science 2007-05-23 Robert E. McGrath , Joe Futrelle , Ray Plante , Damien Guillaume

Astronomy, as a field, has long encouraged the development of free, open digital infrastructure (e.g., National Research Council 2010, 2011). Examples range from simple scripts that enable individual scientific research, through software…

Instrumentation and Methods for Astrophysics · Physics 2021-08-18 Frank Timmes , Rich Townsend , Lars Bildsten

With many large science equipment constructing and putting into use, astronomy has stepped into the big data era. The new method and infrastructure of big data processing has become a new requirement of many astronomers. Cloud computing,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-24 Changhua Li , Chenzhou Cui , Boliang He , Dongwei Fan , Linying Mi , Shanshan Li , Sisi Yang , Yunfei Xu , Jun Han , Junyi Chen , Hailong Zhang , Ce Yu , Jian Xiao , Chuanjun Wang , Zihuang Cao , Yufeng Fan , Liang Liu , Xiao Chen , Wenming Song , Kangyu Du

Through the 1990s, HPC centers at national laboratories, universities, and other large sites designed distributed system architectures and software stacks that enabled extreme-scale computing. By the 2010s, these centers were eclipsed by…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-28 Benjamin S. Allen , Matthew A. Ezell , Paul Peltz , Doug Jacobsen , Eric Roman , Cory Lueninghoener , J. Lowell Wofford

We develop a technique for blind signal identification of the Starlink downlink signal in the 10.7 to 12.7 GHz band and present a detailed picture of the signal's structure. Importantly, the signal characterization offered herein includes…

Signal Processing · Electrical Eng. & Systems 2026-02-06 Todd E. Humphreys , Peter A. Iannucci , Zacharias Komodromos , Andrew M. Graff

Non-terrestrial networks (NTNs) are emerging as a core component of future 6G communication systems, providing global connectivity and supporting data-intensive applications. In this paper, we propose a distributed hierarchical federated…

Machine Learning · Computer Science 2025-03-11 Amin Farajzadeh , Animesh Yadav , Halim Yanikomeroglu

The NASA Astrophysics Data System Abstract Service has become a key component of astronomical research. It provides bibliographic information daily, or near daily, to a majority of astronomical researchers worldwide. We describe the history…

Astrophysics · Physics 2009-10-31 M. J. Kurtz , G. Eichhorn , A. Accomazzi , C. Grant , S. S. Murray , J. M. Watson

Relational databases (DBs) are ideal tools to manage bulky and structured data archives. In particular for Astronomy they can be used to fulfill all the requirements of a complex project, i.e. the management of: documents, software (s/w)…

Astrophysics · Physics 2007-05-23 L. Nicastro , G. Calderone

Hyperledger Fabric (HLF) is a modular and extensible permissioned blockchain platform released to open-source and hosted by the Linux Foundation. The platform's design exhibits principles required by enterprise grade business applications…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-08 Yacov Manevich , Artem Barger , Yoav Tock

FITS (Flexible Image Transport System) is a common format for astronomical data storage. It was first standardised in the early 1980s. Even though astronomical data is now processed mostly using software, visual data inspection by a human…

Instrumentation and Methods for Astrophysics · Physics 2019-02-19 Matwey Kornilov , Konstantin Malanchev

Data archiving is one of the most critical issues for modern astronomical observations. With the development of a new generation of radio telescopes, the transfer and archiving of massive remote data have become urgent problems to be…

Instrumentation and Methods for Astrophysics · Physics 2021-12-08 Cong-Ming Shi , Hui Deng , Feng Wang , Ying Mei , Shao-Guang Guo , Chen Yang , Chen Wu , Shou-Lin Wei , Andreas Wicenec

We introduce AXS (Astronomy eXtensions for Spark), a scalable open-source astronomical data analysis framework built on Apache Spark, a widely used industry-standard engine for big data processing. Building on capabilities present in Spark,…

Instrumentation and Methods for Astrophysics · Physics 2019-07-10 Petar Zečević , Colin T. Slater , Mario Jurić , Andrew J. Connolly , Sven Lončarić , Eric C. Bellm , V. Zach Golkhou , Krzysztof Suberlak

The rapid growth of blockchain systems leads to increasing interest in understanding and comparing blockchain performance at scale. In this paper, we focus on analyzing the performance of Hyperledger Fabric v1.1 - one of the most popular…

Databases · Computer Science 2021-07-22 Minh Quang Nguyen , Dumitrel Loghin , Tien Tuan Anh Dinh

The Interplanetary Filesystem (IPFS) is a distributed data storage service frequently used by blockchain applications and for sharing content in a censorship-resistant manner. Data is distributed within an open set of peers using a…

Networking and Internet Architecture · Computer Science 2021-02-23 Sebastian Henningsen , Martin Florian , Sebastian Rust , Björn Scheuermann

Low-orbit mega-constellation network, which utilize thousands of satellites to provide a variety of network services and collect a wide range of space information, is a rapidly growing field. Each satellite collects TB-level data daily,…

Networking and Internet Architecture · Computer Science 2024-06-06 Handong Luo , Wenhao Liu , Qi Zhang , Ziheng Yang , Quanwei Lin , Wenjun Zhu , Kun Qiu , Zhe Chen , Yue Gao

Recommendation system or also known as a recommender system is a tool to help the user in providing a suggestion of a specific dilemma. Thus, recently, the interest in developing a recommendation system in many fields has increased. Fuzzy…

The ADS Abstract and Article Services provide access to the astronomical literature through the World Wide Web (WWW). The forms based user interface provides access to sophisticated searching capabilities that allow our users to find…

Astrophysics · Physics 2009-10-31 G. Eichhorn , M. J. Kurtz , A. Accomazzi , C. S. Grant , S. S. Murray