Related papers: Extreme Scale Survey Simulation with Python Workfl…
Astronomy has entered the multi-messenger data era and Machine Learning has found widespread use in a large variety of applications. The exploitation of synoptic (multi-band and multi-epoch) surveys, like LSST (Legacy Survey of Space and…
The current role of data-driven science is constantly increasing its importance within Astrophysics, due to the huge amount of multi-wavelength data collected every day, characterized by complex and high-volume information requiring…
It is currently feasible to start a continuous digital record of the entire sky sensitive to any visual magnitude brighter than 15 each night. Such a record could be created with a modest array of small telescopes, which collectively…
Remarkable observational advances have established a compelling cross-validated model of the Universe. Yet, two key pillars of this model -- dark matter and dark energy -- remain mysterious. Sky surveys that map billions of galaxies to…
Cosmic surveys provide crucial information about high energy physics including strong evidence for dark energy, dark matter, and inflation. Ongoing and upcoming surveys will start to identify the underlying physics of these new phenomena,…
We review some of the scientific opportunities and technical challenges posed by the exploration of the large digital sky surveys, in the context of a Virtual Observatory (VO). The VO paradigm will profoundly change the way observational…
The past few decades have seen the burgeoning of wide field, high cadence surveys, the most formidable of which will be the Legacy Survey of Space and Time (LSST) to be conducted by the Vera C. Rubin Observatory. So new is the field of…
A new golden age in astronomy is upon us, dominated by data. Large astronomical surveys are broadcasting unprecedented rates of information, demanding machine learning as a critical component in modern scientific pipelines to handle the…
Inferring spatial curvature of the Universe with high-fidelity is a longstanding interest in cosmology. However, the strong degeneracy between dark energy equation-of-state parameter $w$ and curvature density parameter $\Omega_{\rm K}$ has…
Astrophysical and cosmological observations currently provide the only robust, empirical measurements of dark matter. Future observations with Large Synoptic Survey Telescope (LSST) will provide necessary guidance for the experimental dark…
Much of the science case for the next generation of deep, wide-field optical/infrared surveys has been driven by the further study of dark energy. This is a laudable goal (and the subject of a companion white paper by Zhan et al.). However,…
Modern simulations and observations in Astronomy & Cosmology (A&C) produce massively large data volumes, posing significant challenges for storage, access and data analysis. A long-standing bottleneck in high-performance computing,…
Apache Spark is a Big Data framework for working on large distributed datasets. Although widely used in the industry, it remains rather limited in the academic community or often restricted to software engineers. The goal of this paper is…
In this contribution we review the large body of work carried out over the past two decades to probe the dark matter in the local universe using redshift survey and peculiar velocity data. While redshift surveys have evolved rapidly over…
Modeling large-scale sky survey observations is a key driver for the continuing development of high resolution, large-volume, cosmological simulations. We report the first results from the 'Q Continuum' cosmological N-body simulation run…
Forthcoming instruments designed for high-cadence large-area surveys, such as the Dark Energy Survey and Large Synoptic Survey Telescope, will generate several GB of data products every few minutes during survey operations. Since such…
Since the late 1970's, redshift surveys have been vital for progress in understanding large-scale structure in the Universe. The original CfA redshift survey collected spectra of 20-30 galaxies per clear night on a 1.5 meter telescope; over…
The previous decade saw the discovery of the first four known interstellar objects due to advances in astronomical viewing equipment. Future sky surveys with greater sensitivity will allow for more frequent detections of such objects,…
Developing algorithms to search through data efficiently is a challenging part of searching for signs of technology beyond our solar system. We have built a digital signal processing system and computer cluster on the backend of the Karl G.…
The analysis and an efficient scientific exploration of the Digital Palomar Observatory Sky Survey (DPOSS) represents a major technical challenge. The input data set consists of 3 Terabytes of pixel information, and contains a few billion…