Related papers: Building a scalable global data processing pipelin…

The Sunrise Chromospheric Infrared spectroPolarimeter (SCIP) has been developed for the third flight of the SUNRISE balloon-borne stratospheric solar observatory. The aim of SCIP is to reveal the evolution of three-dimensional magnetic…

Understanding the structure of the matter distribution in the Universe due to the action of the gravitational instability -- the cosmic web -- is complicated by lack of direct analytic access to the nonlinear domain of structure formation.…

Commercial cloud platforms are a powerful technology for astronomical research. Despite the benefits of cloud computing -- such as on-demand scalability and reduction of systems management overhead -- confusion over how to manage costs…

With the rapid adoption of machine learning techniques for large-scale applications in science and engineering comes the convergence of two grand challenges in visualization. First, the utilization of black box models (e.g., deep neural…

Modern Astrophysics is based on multi-wavelength data organized into large and heterogeneous catalogues. Hence, the need for efficient, reliable and scalable catalogue cross-matching methods plays a crucial role in the era of the petabyte…

Currently, the processing of scientific data in astroparticle physics is based on various distributed technologies, the most common of which are Grid and cloud computing. The most frequently discussed approaches are focused on large and…

Advancements in optical metrology has enabled documentation of dense 3D point clouds of cultural heritage sites. For large scale and continuous digital documentation, processing of dense 3D point clouds becomes computationally cumbersome,…

The Large Synoptic Survey Telescope (LSST) is an ambitious astronomical survey with a similarly ambitious Data Management component. Data Management for LSST includes processing on both nightly and yearly cadences to generate transient…

In the era of precision cosmology, the ability to generate accurate and large-scale galaxy catalogs is crucial for advancing our understanding of the universe. With the flood of cosmological data from current and upcoming missions,…

This paper discusses the requirements for and performance metrics of the the Grid Computing system used to implement the Locus Algorithm to identify optimum pointings for differential photometry of 61,662,376 stars and 23,779 quasars.…

Cosmological measurements require the calculation of nontrivial quantities over large datasets. The next generation of survey telescopes (such as DES, PanSTARRS, and LSST) will yield measurements of billions of galaxies. The scale of these…

In this paper, we describe the SPHEREx image and spectrophotometry data processing pipeline, an infrastructure and software system designed to produce calibrated spectral images and photometric measurements for NASA's SPHEREx mission.…

In contemporary astronomy and astrophysics (A&A), the integration of high-performance computing (HPC), big data analytics, and artificial intelligence/machine learning (AI/ML) has become essential for advancing research across a wide range…

We present our image processing system for the reduction of optical imaging data from multi-chip cameras. In the framework of the Garching Bonn Deep Survey (GaBoDS; Schirmer et al. 2003) consisting of about 20 square degrees of high-quality…

For more that seventy years, the measurements of fluxes of galaxies at different wavelengths and derived colours have been used to estimate their corresponding cosmological distances. From the fields of galaxy and AGN evolution to precision…

The production of photometric light curves from astronomical images is a very time-consuming task. Larger data sets improve the resolution of the light curve, however, the time requirement scales with data volume. The data analysis is often…

Complex field measurements are increasingly becoming the standard for state-of-the-art astronomical instrumentation. Complex field measurements have been used to characterize a suite of ground, airborne, and space-based heterodyne receiver…

Work in time-domain astronomy necessitates robust, automated data processing pipelines that operate in real time. We present the BANZAI pipeline which processes the thousands of science images produced across the Las Cumbres Observatory…

ImageJ is a graphical user interface (GUI) driven, public domain, Java-based, software package for general image processing traditionally used mainly in life sciences fields. The image processing capabilities of ImageJ are useful and…

This article describes a data center hosting a web portal for accessing and sharing the output of large, cosmological, hydro-dynamical simulations with a broad scientific community. It also allows users to receive related scientific data…