English
Related papers

Related papers: The DAME/VO-Neural Infrastructure: an Integrated D…

200 papers

The U.S. Virtual Astronomical Observatory (VAO; http://www.us-vao.org/) has been in operation since May 2010. Its goal is to enable new science through efficient integration of distributed multi-wavelength data. This paper describes the…

Instrumentation and Methods for Astrophysics · Physics 2015-06-05 G. Bruce Berriman , Robert J. Hanisch , T. Joseph W. Lazio , Alexander Szalay , Giussepina Fabbiano

Dynamo is a full-stack software solution for scientific data management. Dynamo's architecture is modular, extensible, and customizable, making the software suitable for managing data in a wide range of installation scales, from a few…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-18 Yutaro Iiyama , Benedikt Maier , Daniel Abercrombie , Maxim Goncharov , Christoph Paus

AstroCloud is a cyber-Infrastructure for Astronomy Research initiated by Chinese Virtual Observatory (China-VO) under funding support from NDRC (National Development and Reform commission) and CAS (Chinese Academy of Sciences). The ultimate…

Instrumentation and Methods for Astrophysics · Physics 2014-11-20 Jian Xiao , Ce Yu , Chenzhou Cui , Boliang He , Changhua Li , Dongwei Fan , Zhi Hong , Shucheng Yin , Chuanjun Wang , Zihuang Cao , Yufeng Fan , Shanshan Li , Linying Mi , Wanghui Wan , Jianguo Wang , Hailong Zhang

We show that distributed Infrastructure-as-a-Service (IaaS) compute clouds can be effectively used for the analysis of high energy physics data. We have designed a distributed cloud system that works with any application using large input…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-01-04 R. J. Sobie , A. Agarwal , M. Anderson , P. Armstrong , K. Fransham , I. Gable , D. Harris , C. Leavett-Brown , M. Paterson , D. Penfold-Brown , M. Vliet , A. Charbonneau , R. Impey , W. Podaima

Petabyte-scale data volumes are generated by observations and simulations in modern astronomy and astrophysics. Storage, access, and data analysis are significantly hampered by such data volumes and are leading to the development of a new…

Instrumentation and Methods for Astrophysics · Physics 2025-08-29 Eva Sciacca , Nicola Tuccari , Fabio Vitello , Valentina Cesare

At the Canadian Astronomy Data Centre, we have combined our cloud computing system, CANFAR, with the world's most advanced machine learning software, Skytree, to create the world's first cloud computing system for data mining in astronomy.…

Instrumentation and Methods for Astrophysics · Physics 2013-12-17 Nicholas M. Ball

Over the past decade, astronomers have been using an increasingly larger number of web-based applications and archives to conduct their research. However, despite the early success in creating links across projects and data centers, the…

Instrumentation and Methods for Astrophysics · Physics 2015-03-17 Alberto Accomazzi , Michael J. Kurtz , Stephen S. Murray

Environmental science is often fragmented: data is collected using mismatched formats and conventions, and models are misaligned and run in isolation. Cloud computing offers a lot of potential in the way of resolving such issues by…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-08-08 Yehia Elkhatib , Gordon S. Blair , Bholanathsingh Surajbali

As the amount of scientific data continues to grow at ever faster rates, the research community is increasingly in need of flexible computational infrastructure that can support the entirety of the data science lifecycle, including…

Computers and Society · Computer Science 2016-04-12 Robert L. Grossman , Allison Heath , Mark Murphy , Maria Patterson , Walt Wells

Astronomy has a long history of acquiring, systematizing, and interpreting large quantities of data. Starting from the earliest sky atlases through the first major photographic sky surveys of the 20th century, this tradition is continuing…

Astrophysics · Physics 2007-05-23 Robert J. Brunner , S. George Djorgovski , Thomas A. Prince , Alex S. Szalay

Distributed computing platforms provide a robust mechanism to perform large-scale computations by splitting the task and data among multiple locations, possibly located thousands of miles apart geographically. Although such distribution of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-24 Alok Singh , Eric Stephan , Malachi Schram , Ilkay Altintas

Earth Observation (EO) mining aims at supporting efficient access and exploration of petabyte-scale space- and airborne remote sensing archives that are currently expanding at rates of terabytes per day. A significant challenge is…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-01-22 Luigi Mascolo , Marco Quartulli , Pietro Guccione , Giovanni Nico , Igor G. Olaizola

Scientific computing can in some sense be distilled to the execution of an application - or rather sets of applications which are combined into complex workflows. Due to the complexity and number both of scientific packages as well as…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-01 Bruce Becker , Sean Murray

We review some of the scientific opportunities and technical challenges posed by the exploration of the large digital sky surveys, in the context of a Virtual Observatory (VO). The VO paradigm will profoundly change the way observational…

The Target infrastructure has been specially built as a storage and compute infrastructure for the information systems derived from Astro-WISE. This infrastructure will be used by several applications that collaborate in the area of…

Instrumentation and Methods for Astrophysics · Physics 2011-10-06 A. N. Belikov , F. Dijkstra , J. A. Gankema , J. B. A. N. van Hoof , R. Koopman

We present the alpha release of the VOGCLUSTERS web application, specialized for data and text mining on globular clusters. It is one of the web2.0 technology based services of Data Mining & Exploration (DAME) Program, devoted to mine and…

Instrumentation and Methods for Astrophysics · Physics 2011-09-23 Marco Castellani , Massimo Brescia , Ettore Mancini , Luca Pellecchia , Giuseppe Longo

Infrastructures are not inherently durable or fragile, yet all are fragile over the long term. Durability requires care and maintenance of individual components and the links between them. Astronomy is an ideal domain in which to study…

Digital Libraries · Computer Science 2016-11-02 Christine L. Borgman , Peter T. Darch , Ashley E. Sands , Milena S. Golshan

Access to molecular and atomic data is critical for many forms of remote sensing analysis across different fields. Many atomic and molecular databases are however highly specialized for their intended application, complicating querying and…

Instrumentation and Methods for Astrophysics · Physics 2018-03-28 Samuel Regandell , Thomas Marquart , Nikolai Piskunov

The Astrophysical Virtual Observatory (AVO) initiative, jointly funded by the European Commission and six European organisations, had the task of creating the foundations of a regional scale infrastructure by conducting a research and…

Astrophysics · Physics 2007-05-23 P. Padovani

The Virtual Observatory (VO) is becoming the de-facto standard for astronomical data publication. However, the number of radio astronomical archives is still low in general, and even lower is the number of radio astronomical data available…

Instrumentation and Methods for Astrophysics · Physics 2012-05-14 J. D. Santander-Vela , E. García , S. Leon , V. Espigares , J. E. Ruiz , L. Verdes-Montenegro , E. Solano