Related papers: The DASCH Data Processing Pipeline and Multiple Ex…
Modern astronomical data processing requires complex software pipelines to process ever growing datasets. For radio astronomy, these pipelines have become so large that they need to be distributed across a computational cluster. This makes…
The Kepler Mission Science Operations Center (SOC) performs several critical functions including managing the ~156,000 target stars, associated target tables, science data compression tables and parameters, as well as processing the raw…
The ANTARES neutrino telescope is being constructed in the Mediterranean Sea. It consists of a large three-dimensional array of photo-multiplier tubes. The data acquisition system of the detector takes care of the digitisation of the…
We have designed and implemented a novel way to process wide-field astronomical data within a distributed environment of hardware resources and humanpower. The system is characterized by integration of archiving, calibration, and…
Sky coverage is one of the most important pieces of information about astronomical observations. We discuss possible representations, and present algorithms to create and manipulate shapes consisting of generalized spherical polygons with…
We present an optical to near-infrared selected astronomical catalogue covering 1270 deg.$^2$. This is the first attempt to systematically combine data from 23 of the premier extragalactic survey fields - the product of a vast investment of…
Performing data-intensive analytics is an essential part of modern Earth science. As such, research in atmospheric physics and meteorology frequently requires the processing of very large observational and/or modeled datasets. Typically,…
The ACS Survey of Globular Clusters has used HST's Wide-Field Channel to obtain uniform imaging of 65 of the nearest globular clusters to provide an extensive homogeneous dataset for a broad range of scientific investigations. The survey…
Biologists study Diatoms, a fundamental algae, to assess the health of aquatic systems. Diatom specimens have traditionally been preserved on analog slides, where a single slide can contain thousands of these microscopic organisms.…
It is currently feasible to start a continuous digital record of the entire sky sensitive to any visual magnitude brighter than 15 each night. Such a record could be created with a modest array of small telescopes, which collectively…
Photometry of galaxies has typically focused on small, faint systems due to their interest for cosmological studies. Large angular size galaxies, on the other hand, offer a more detailed view into the properties of galaxies, but bring a…
Advancements in optical metrology has enabled documentation of dense 3D point clouds of cultural heritage sites. For large scale and continuous digital documentation, processing of dense 3D point clouds becomes computationally cumbersome,…
SOFIA presents a number of interesting challenges for the development of a data reduction environment which, at its initial phase, will have to incorporate pipelines from seven different instruments. Therefore, the SOFIA data reduction…
This paper describes the Third Data Release of the Sloan Digital Sky Survey (SDSS). This release, containing data taken up through June 2003, includes imaging data in five bands over 5282 deg^2, photometric and astrometric catalogs of the…
We summarise the properties of the Sloan Digital Sky Survey (SDSS) project, discuss our software infrastructure, and outline the architecture of the SDSS image processing pipelines. We then discuss two of the algorithms used in the SDSS…
In order to place constraints on cosmology through optical surveys of galaxy clusters, one must first understand the properties of those clusters. To this end, we introduce the Mass Analysis Tool for Chandra (MATCha), a pipeline which uses…
The success of modern machine learning hinges on access to high-quality training data. In many real-world scenarios, such as acquiring data from public repositories or sharing across institutions, data is naturally organized into discrete…
Large digital sky surveys, over a broad range of wavelengths, both from the ground and from space observatories, are becoming a major source of astronomical data. Some examples include the Sloan Digital Sky Survey (SDSS) and the Digital…
German-Russian Astroparticle Data Life Cycle Initiative is an international project whose aim is to develop a distributed data storage system that aggregates data from the storage systems of different astroparticle experiments. The…
Clustering is an effective tool for astronomical spectral analysis, to mine clustering patterns among data. With the implementation of large sky surveys, many clustering methods have been applied to tackle spectroscopic and photometric data…