Related papers: Building a scalable global data processing pipelin…
This paper describes the MegaPipe image processing pipeline at the Canadian Astronomical Data Centre (CADC). The pipeline takes multiple images from the MegaCam mosaic camera on CFHT and combines them into a single output image. MegaPipe…
We describe the software requirement and design specifications for all-sky panoramic astronomical pipelines. The described software aims to meet the specific needs of super-wide angle optics, and includes cosmic-ray hit rejection, image…
Understanding of clouds is instrumental in interpreting current and future spectroscopic observations of exoplanets. Modelling clouds consistently is complex, since it involves many facets of chemistry, nucleation theory, condensation…
This paper describes a new approach to the optimization of information extraction in multi-wavelength image cubes of cosmological fields. The objective is to create a framework for the automatic identification and tagging of sources…
Virtual Observatory (VO) is a data-intensively online astronomical research and education environment, which takes advantages of advanced information technologies to achieve seamless and global access to astronomical information. AstroCloud…
The recent explosion of recorded digital data and its processed derivatives threatens to overwhelm researchers when analysing their experimental data or when looking up data items in archives and file systems. While current hardware…
Hundreds of millions of network cameras have been installed throughout the world. Each is capable of providing a vast amount of real-time data. Analyzing the massive data generated by these cameras requires significant computational…
Digital Access to a Sky Century @ Harvard (DASCH) is a project to digitize the collection of approximately 525,000 astronomical plates held at the Harvard College Observatory. This paper presents an overview of the DASCH data processing…
Improvements in the precision of the astrophysical flux scale are needed to answer fundamental scientific questions ranging from cosmology to stellar physics. The unexpected discovery that the expansion of the universe is accelerating was…
Tianyu telescope, an one-meter robotic optical survey instrument to be constructed in Lenghu, Qinghai, China, is designed for detecting transiting exoplanets, variable stars and transients. It requires a highly automated, optimally…
As software systems increase in complexity, conventional monitoring methods struggle to provide a comprehensive overview or identify performance issues, often missing unexpected problems. Observability, however, offers a holistic approach,…
A scientific instrument comprised of a global network of millions of independent, connected, remote devices presents unique data acquisition challenges. We describe the software design of a mobile application which collects data from…
Real-time city-scale traffic analytics requires processing 100s-1000s of CCTV streams under strict latency, bandwidth, and compute limits. We present a scalable AI-driven Intelligent Transportation System (AIITS) designed to address…
In this paper we describe a numerical method designed for modelling different kinds of astrophysical flows in three dimensions. Our method is a standard explicit finite difference method employing the local shearing-box technique. To model…
To reduce and analyze astronomical images, astronomers can rely on a wide range of libraries providing low-level implementations of legacy algorithms. However, combining these routines into robust and functional pipelines requires a major…
The ACS Survey of Globular Clusters has used HST's Wide-Field Channel to obtain uniform imaging of 65 of the nearest globular clusters to provide an extensive homogeneous dataset for a broad range of scientific investigations. The survey…
As Large-Scale Cloud Systems (LCS) become increasingly complex, effective anomaly detection is critical for ensuring system reliability and performance. However, there is a shortage of large-scale, real-world datasets available for…
In order to take full advantage of the U.S. Department of Energy's billion-dollar investments into the next-generation research infrastructure (e.g., exascale, light sources, colliders), advances are required not only in detector technology…
We describe DPOSS, a new digital survey of the northern sky, based on the POSS-II photographic sky atlas. The survey covers the entire sky north of delta = -3 deg in 3 bands, calibrated to the Gunn $gri$ system, reaching to equivalent…
The third US Naval Observatory (USNO) CCD Astrograph Catalog, UCAC3 was released at the IAU General Assembly on 2009 August 10. It is a highly accurate, all-sky astrometric catalog of about 100 million stars in the R = 8 to 16 magnitude…