Related papers: The Pan-STARRS Data Processing System
Modern cosmological surveys such as the Hyper Suprime-Cam (HSC) survey produce a huge volume of low-resolution images of both distant galaxies and dim stars in our own galaxy. Being able to automatically classify these images is a…
Scientific endeavors such as large astronomical surveys generate databases on the terabyte scale. These, usually multidimensional databases must be visualized and mined in order to find interesting objects or to extract meaningful and…
A program that we call the QUEST Data Processing Software Pipeline has been written to process the large volumes of data produced by the QUEST camera on the Samuel Oschin Schmidt Telescope at the Palomar Observatory. The program carries out…
We summarize some of the compelling new scientific opportunities for understanding stars and stellar systems that can be enabled by sub-milliarcsec (sub-mas) angular resolution, UV-Optical spectral imaging observations, which can reveal the…
The Wide Field Survey Telescope (WFST) is a dedicated photometric surveying facility built jointly by the University of Science and Technology of China (USTC) and the Purple Mountain Observatory (PMO). Since many of its scientific…
SDAMS is the ensemble of database + software packages aimed to the archiving, quick-look analysis, off-line analysis, network accessibility and plotting of the SPOrt produced data. Many of the aspects related to data archiving, analysis and…
In recent years, there has been a proliferation of wide-field sky surveys to search for a variety of transient objects. Using relatively short focal lengths, the optics of these systems produce undersampled stellar images often marred by a…
Microlensing events can be used to directly measure the masses of single field stars to a precision of $\sim$1-10\%. The majority of direct mass measurements for stellar and sub-stellar objects typically only come from observations of…
New approaches for data provenance and data management (DPDM) are required for mega science projects like the Square Kilometer Array, characterized by extremely large data volume and intense data rates, therefore demanding innovative and…
Transient radio sources, such as fast radio bursts, intermittent pulsars, and rotating radio transients, can offer a wealth of information regarding extreme emission physics as well as the intervening interstellar and/or intergalactic…
Astronomy has a long history of acquiring, systematizing, and interpreting large quantities of data. Starting from the earliest sky atlases through the first major photographic sky surveys of the 20th century, this tradition is continuing…
We have created a new image analysis pipeline to reprocess images taken by the Near Earth Asteroid Tracking survey and have applied it to ten nights of observations. This work is the first large-scale reprocessing of images from an asteroid…
With the exponential growth in data volume, especially in recent decades, the demand for data processing has surged across all scientific fields. Within astronomical datasets, the combination of solar space missions and ground-based…
A fast-turnaround pipeline for realtime data reduction plays an essential role in discovering and permitting follow-up observations to young supernovae and fast-evolving transients in modern time-domain surveys. In this paper, we present…
A scientific instrument comprised of a global network of millions of independent, connected, remote devices presents unique data acquisition challenges. We describe the software design of a mobile application which collects data from…
Exploration of the time-domain radio sky has huge potential for advancing our knowledge of the dynamic universe. Past surveys have discovered large numbers of pulsars, rotating radio transients and other transient radio phenomena; however,…
Multi-messenger astronomy is becoming the key to understanding the Universe from a comprehensive perspective. In most cases, the data and the technology are already in place, therefore it is important to provide an easily-accessible package…
DRAGONS (Data Reduction for Astronomy from Gemini Observatory North and South) is a platform for the reduction and processing of astronomical data. The Python-based, open-source package includes infrastructure for automation and algorithms…
Coming high-cadence wide-field optical telescopes will image hundreds of thousands of sources per minute. Besides inspecting the near real-time data streams for transient and variability events, the accumulated data archive is a wealthy…
The Large sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST) medium-resolution spectral survey of Galactic Nebulae (MRS-N) has conducted for three years since Sep. 2018 and observed more than 190 thousands nebular spectra and 20…