English
Related papers

Related papers: The Data Lab: A Science Platform for the analysis …

200 papers

In the era of big data astronomy, next generation telescopes and large sky surveys produce data sets at the TB or even PB level. Due to their large data volumes, these astronomical data sets are extremely difficult to transfer and analyze…

Modern scientific data mainly consist of huge datasets gathered by a very large number of techniques and stored in very diversified and often incompatible data repositories. More in general, in the e-science environment, it is considered as…

Instrumentation and Methods for Astrophysics · Physics 2010-10-20 M. Brescia , G. Longo , F. Pasian

The NOAO currently operates the two most capable platforms in the world for optical surveys, the 4-m KPNO (Mayall) and 4-m CTIO (Blanco) telescopes. It was only discovered recently (in 2009) that a field of view of 3 deg diameter is…

Instrumentation and Methods for Astrophysics · Physics 2012-03-06 David Schlegel , Michael Sholl

Since its inception in the early 2000, the Virtual Observatory (VO), developed as a collaboration of many national and international projects, has become a major factor in the discovery and dissemination of astronomical information…

The data volumes stored in telescope archives is constantly increasing due to the development and improvements in the instrumentation. Often the archives need to be stored over a distributed storage architecture, provided by independent…

Instrumentation and Methods for Astrophysics · Physics 2022-02-07 Y. G. Grange , V. N. Pandey , X. Espinal , R. Di Maria , A. P. Millar

In time-domain astronomy, STLF (Short-Timescale and Large Field-of-view) sky survey is the latest way of sky observation. Compared to traditional sky survey who can only find astronomical phenomena, STLF sky survey can even reveal how short…

Databases · Computer Science 2018-11-28 Chen Yang , Xiaofeng Meng , Zhihui Du , JiaMing Qiu , Kenan Liang , Yongjie Du , Zhiqiang Duan , Xiaobin Ma , Zhijian Fang

The astronomical community is grappling with the increasing volume and complexity of data produced by modern telescopes, due to difficulties in reducing, accessing, analyzing, and combining archives of data. To address this challenge, we…

The next-generation astronomy digital archives will cover most of the universe at fine resolution in many wave-lengths, from X-rays to ultraviolet, optical, and infrared. The archives will be stored at diverse geographical locations. One of…

Databases · Computer Science 2016-08-31 Alexander S. Szalay , Peter Kunszt , Ani Thakar , Jim Gray

Imagine an online work environment where researchers have direct and immediate access to myriad data sources and tools and data management resources, useful throughout the research lifecycle. This is our vision for the next generation of…

Computers and Society · Computer Science 2015-06-19 Latanya Sweeney , Merce Crosas

Astronomical spectra, which encode rich astrophysical and chemical information, are fundamental to understanding celestial objects and universal laws. The advent of large-scale spectroscopic surveys, generating tens of millions of spectra,…

Instrumentation and Methods for Astrophysics · Physics 2026-03-23 Yuan-Hao Pu , Guo-Hong Lei , Yang Xu , Xun-Zhou Chen , Hai-Jun Tian

Recent technological advances in astronomy, particularly the growing popularity of smart telescopes for the general public, make it possible to develop highly effective detection solutions that are accessible to a wide audience, rather than…

Instrumentation and Methods for Astrophysics · Physics 2026-05-01 Olivier Parisot

This is a thought piece on data-intensive science requirements for databases and science centers. It argues that peta-scale datasets will be housed by science centers that provide substantial storage and processing for scientists who access…

Databases · Computer Science 2007-05-23 Jim Gray , David T. Liu , Maria Nieto-Santisteban , Alexander S. Szalay , David DeWitt , Gerd Heber

The advent of deep, wide, accurate, digital photometric surveys exemplified by the Sloan Digital Sky Survey (SDSS) has had a profound impact on studies of the Milky Way. In the past decade, we have transitioned from a scarcity to an…

Astrophysics of Galaxies · Physics 2015-05-27 Mario Juric , Zeljko Ivezic

The Sloan Digital Sky Survey is an ambitious, multi-institutional project to create a huge digital imaging and spectroscopic data bank of 25% of the celestial sphere, approximately 10,000 deg^2 centred on the north galactic polar cap. The…

Astrophysics · Physics 2009-10-30 Bruce Margon

Astronomical data are gathered through a very large number of heterogeneous techniques and stored in very diversified and often incompatible data repositories. Moreover in the e-science environment, it is needed to integrate services across…

Astronomy is entering a new era of discovery, coincident with the establishment of new facilities for observation and simulation that will routinely generate petabytes of data. While an increasing reliance on automated data analysis is…

Instrumentation and Methods for Astrophysics · Physics 2015-05-27 Amr Hassan , Christopher J. Fluke

The analysis and an efficient scientific exploration of the Digital Palomar Observatory Sky Survey (DPOSS) represents a major technical challenge. The input data set consists of 3 Terabytes of pixel information, and contains a few billion…

Astrophysics · Physics 2015-06-24 S. G. Djorgovski , R. R. de Carvalho , S. C. Odewahn , R. R. Gal , J. Roden , P. Stolorz , A. Gray

The survey of the nearby space and continuous monitoring of the Near Earth Objects (NEOs) and especially Near Earth Asteroids (NEAs) are essential for the future of our planet and should represent a priority for our solar system research…

Objective: To (1) demonstrate the implementation of a data science platform built on open-source technology within a large, academic healthcare system and (2) describe two computational healthcare applications built on such a platform.…

We provide a brief, and inevitably incomplete overview of the use of Machine Learning (ML) and other AI methods in astronomy, astrophysics, and cosmology. Astronomy entered the big data era with the first digital sky surveys in the early…

Instrumentation and Methods for Astrophysics · Physics 2022-12-06 S. G. Djorgovski , A. A. Mahabal , M. J. Graham , K. Polsterer , A. Krone-Martins