Related papers: The DASCH Data Processing Pipeline and Multiple Ex…

In this decade astronomy is undergoing a paradigm shift to handle data from next generation observatories such as the Square Kilometre Array (SKA) or the Vera C. Rubin Observatory (LSST). Producing real time data streams of up to 10 TB/s…

The analysis and an efficient scientific exploration of the Digital Palomar Observatory Sky Survey (DPOSS) represents a major technical challenge. The input data set consists of 3 Terabytes of pixel information, and contains a few billion…

The article provides a brief description of the software package DECH for processing and analysis of astronomical spectra. DECH supports all stages of processing and analysis of spectral data, including image preprocessing, spectra…

The Zwicky Transient Facility is a new robotic-observing program, in which a newly engineered 600-MP digital camera with a pioneeringly large field of view, 47~square degrees, will be installed into the 48-inch Samuel Oschin Telescope at…

DAPHNE is a new open-source software infrastructure designed to address the increasing demands of integrated data analysis (IDA) pipelines, comprising data management (DM), high performance computing (HPC), and machine learning (ML)…

The next-generation astronomy digital archives will cover most of the universe at fine resolution in many wave-lengths, from X-rays to ultraviolet, optical, and infrared. The archives will be stored at diverse geographical locations. One of…

The Stratospheric Observatory for Infrared Astronomy (SOFIA) is an airborne astronomical observatory comprised of a 2.5-meter telescope mounted in the aft section of a Boeing 747SP aircraft. During routine operations, several instruments…

We present the first major data release of the largest single key-project in area carried out in open time with the Herschel Space Observatory. The Herschel Astrophysical Terahertz Large Area Survey (H-ATLAS) is a survey of 600 deg^2 in…

The Herschel-ATLAS is a survey of 550 square degrees with the Herschel Space Observatory in five far--infrared and submillimetre bands. The first data for the survey, observations of a field 4x4 sq. degrees in size, were taken during the…

Astrophysics lies at the crossroads of big datasets (such as the Large Synoptic Survey Telescope and Gaia), open source software to visualize and interpret high dimensional datasets (such as Glue, WorldWide Telescope, and OpenSpace), and…

During the 20th Century, aerial surveys captured hundreds of millions of high-resolution photographs of the earth's surface. These images, the precursors to modern satellite imagery, represent an extraordinary visual record of the…

A data life cycle (DLC) is a high-level data processing pipeline that involves data acquisition, event reconstruction, data analysis, publication, archiving, and sharing. For astroparticle physics a DLC is particularly important due to the…

We review some aspects of the current state of data-intensive astronomy, its methods, and some outstanding data analysis challenges. Astronomy is at the forefront of "big data" science, with exponentially growing data volumes and data…

Photographic plate archives contain a wealth of information about positions and brightness celestial objects had decades ago. Plate digitization is necessary to make this information accessible, but extracting it is a technical challenge.…

This work describes the rescue and enhancement of several thousand spectrophotometric plates from the La Plata Observatory. These plates and their attached handwritten documents, date from the beginning of the 20th century and contain…

The US National Park Service (NPS) assesses the night sky quality over parks by capturing a series of overlapping images to obtain a mosaic view of the entire night sky. The NPS Night Skies Program has integrated a sequence of scripts and…

Open Universe for blazars is a set of high-transparency data products for blazar science, and the tools designed to generate them. Blazar astrophysics is becoming increasingly data driven, depending on the integration and combined analysis…

The next-generation astronomy archives will cover most of the universe at fine resolution in many wavelengths. One of the first of these projects, the Sloan Digital Sky Survey (SDSS) will create a 5-wavelength catalog over 10,000 square…

Modern radio telescopes generate large amounts of data, with the next generation Very Large Array (ngVLA) and the Square Kilometre Array (SKA) expected to feed up to 292 GB of visibilities per second to the science data processor (SDP).…

We present the pipeline for the cosmic shear analysis of the Dark Energy Camera All Data Everywhere (DECADE) weak lensing dataset: a catalog consisting of 107 million galaxies observed by the Dark Energy Camera (DECam) in the northern…