English
Related papers

Related papers: The Data Lab: A Science Platform for the analysis …

200 papers

The field of astronomy has arrived at a turning point in terms of size and complexity of both datasets and scientific collaboration. Commensurately, algorithms and statistical models have begun to adapt --- e.g., via the onset of artificial…

Much of the science case for the next generation of deep, wide-field optical/infrared surveys has been driven by the further study of dark energy. This is a laudable goal (and the subject of a companion white paper by Zhan et al.). However,…

We review some of the scientific opportunities and technical challenges posed by the exploration of the large digital sky surveys, in the context of a Virtual Observatory (VO). The VO paradigm will profoundly change the way observational…

Science is becoming very data intensive1. Today's astronomy datasets with tens of millions of galaxies already present substantial challenges for data mining. In less than 10 years the catalogs are expected to grow to billions of objects,…

Databases · Computer Science 2009-11-07 Alexander S. Szalay , Jim Gray , Jan vandenBerg

The rapid accumulation of Earth observation data presents a formidable challenge for the processing capabilities of traditional remote sensing desktop software, particularly when it comes to analyzing expansive geographical areas and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-29 Hao Xu , Yuanbin Man , Mingyang Yang , Jichao Wu , Qi Zhang , Jing Wang

Earth observation (EO) is a prime instrument for monitoring land and ocean processes, studying the dynamics at work, and taking the pulse of our planet. This article gives a bird's eye view of the essential scientific tools and approaches…

In the last decade a new generation of telescopes and sensors has allowed the production of a very large amount of data and astronomy has become, a data-rich science; this transition is often labeled as: "data revolution" and "data…

Instrumentation and Methods for Astrophysics · Physics 2013-04-25 Stefano Cavuoti

Astronomy and astrophysics are witnessing dramatic increases in data volume as detectors, telescopes and computers become ever more powerful. During the last decade, sky surveys across the electromagnetic spectrum have collected hundreds of…

Instrumentation and Methods for Astrophysics · Physics 2014-11-20 Jacob T. VanderPlas , Andrew J. Connolly , Zeljko Ivezic , Alex Gray

The availability of tera-byte scale experiment data calls for AI driven approaches which automatically discover scientific models from data. Nonetheless, significant challenges present in AI-driven scientific discovery: (i) The annotation…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Md Nasim , Anter El-Azab , Xinghang Zhang , Yexiang Xue

This paper explores the evolving landscape of data spaces, focusing on key concepts, practical applications, and emerging future directions. It begins by introducing the foundational principles that underpin data space architectures,…

Databases · Computer Science 2025-09-10 Bojana Marojevikj , Riste Stojanov

Contemporary astronomy benefits of very large and rapidly growing amounts of data in all bands of the electromagnetic spectrum, from long-wavelength radio waves to high energy gamma-rays. Astronomers normally specialize in data taken in one…

Instrumentation and Methods for Astrophysics · Physics 2015-06-17 Paolo Giommi

Powerful new observational facilities will come online over the next decade, enabling a number of discovery opportunities in the "Cosmic Frontier", which targets understanding of the physics of the early universe, dark matter and dark…

The recent advances in machine learning and the availability of free and open big Earth data (e.g., Sentinel missions), which cover large areas with high spatial and temporal resolution, have enabled many agriculture monitoring…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 George Choumos , Alkiviadis Koukos , Vasileios Sitokonstantinou , Charalampos Kontoes

Deep learning models are increasingly data-hungry, requiring significant resources to collect and compile the datasets needed to train them, with Earth Observation (EO) models being no exception. However, the landscape of datasets in EO is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Alistair Francis , Mikolaj Czerkawski

Selected results obtained in major observational sky surveys (DSS, 2MASS, 2dF, SDSS) and deep field observations (HDF, GOODS, HUDF, etc.) are reviewed. Modern surveys provide information on the characteristics and space distribution of…

Astrophysics · Physics 2009-11-11 V. P. Reshetnikov

We review some of the recent developments and challenges posed by the data analysis in modern digital sky surveys, which are representative of the information-rich astronomy in the context of Virtual Observatory. Illustrative examples…

Astrophysics · Physics 2016-11-18 S. G. Djorgovski , C. Donalek , A. Mahabal , R. Williams , A. Drake , M. Graham , E. Glikman

The Large Synoptic Survey Telescope (LSST) is uniquely equipped to search for Solar System bodies due to its unprecedented combination of depth and wide field coverage. Over a ten-year period starting in 2022, LSST will generate the largest…

The Pulsar Virtual Observatory will provide a means for scientists in all fields to access and analyze the large data sets stored in pulsar surveys without specific knowledge about the data or the processing mechanisms. This is achieved by…

Astrophysics · Physics 2007-05-23 M. Keith , B. Harbulot , A. Lyne , J. Brooke

In the coming era of data-intensive science, it will be increasingly important to be able to seamlessly move between scientific results, the data analyzed in them, and the processes used to produce them. As observations, derived data…

Instrumentation and Methods for Astrophysics · Physics 2011-03-31 Alberto Accomazzi , Rahul Dave

Time-domain Astrophysics (TDA), a foundation of Astronomy, has become a major part of current and projected (2020s) astrophysics. While much has been derived from temporal measures of flux and color, the real physics comes from…