English
Related papers

Related papers: Massive Datasets in Astronomy

200 papers

Recent all-sky and large-area astronomical surveys and their catalogued data over the whole range of electromagnetic spectrum are reviewed, from Gamma-ray to radio, such as Fermi-GLAST and INTEGRAL in Gamma-ray, ROSAT, XMM and Chandra in…

Instrumentation and Methods for Astrophysics · Physics 2015-11-24 A. M. Mickaelian

Despite almost all being acquired as photons, astronomical data from different instruments and at different stages in its life may exist in different formats to serve different purposes. Beyond the data itself, descriptive information is…

Instrumentation and Methods for Astrophysics · Physics 2015-07-15 Jessica D. Mink

The contemporary astronomical instruments have been producing the unprecedented amount of data. The largest part of this "data avalanche" is being produced by deep all-sky surveys yielding terabytes of raw data per night. Such a great data…

Instrumentation and Methods for Astrophysics · Physics 2011-12-20 Petr Škoda

Visualization techniques are well developed for many problem domains, but these systems break down for datasets which are very large or multidimensional. Techniques for data which is discrete rather than continuous are also less well…

Astrophysics · Physics 2007-05-23 Joel Welling , Mark Derthick

We review some of the recent developments and challenges posed by the data analysis in modern digital sky surveys, which are representative of the information-rich astronomy in the context of Virtual Observatory. Illustrative examples…

Astrophysics · Physics 2016-11-18 S. G. Djorgovski , C. Donalek , A. Mahabal , R. Williams , A. Drake , M. Graham , E. Glikman

Astronomy began as a visual science, first through careful observations of the sky using either an eyepiece or the naked eye, then on to the preservation of those images with photographic media and finally the digital encoding of that…

Astronomy produces extremely large data sets from ground-based telescopes, space missions, and simulation. The volume and complexity of these rich data sets require new approaches and advanced tools to understand the information contained…

Instrumentation and Methods for Astrophysics · Physics 2014-02-25 Demitri Muna , Eric Huff

Astronomical researchers often think of analysis and visualization as separate tasks. In the case of high-dimensional data sets, though, interactive exploratory data visualization can give far more insight than an approach where data…

Instrumentation and Methods for Astrophysics · Physics 2015-06-05 Alyssa A. Goodman

The history of astrometry, the branch of astronomy dealing with the positions of celestial objects, is a lengthy and complex chronicle, having its origins in the earliest records of astronomical observations more than two thousand years…

History and Philosophy of Physics · Physics 2015-06-11 Michael Perryman

The era of data-intensive astronomy is being ushered in with the increasing size and complexity of observational data across wavelength and time domains, the development of algorithms to extract information from this complexity, and the…

Instrumentation and Methods for Astrophysics · Physics 2020-05-20 Mubdi Rahman , Dustin Lang , Renée Hložek , Jo Bovy , Laurence Perreault-Levasseur

Scientific endeavors such as large astronomical surveys generate databases on the terabyte scale. These, usually multidimensional databases must be visualized and mined in order to find interesting objects or to extract meaningful and…

The site conditions that make astronomical observatories in space and on the ground so desirable -- cold and dark -- demand a physical remoteness that leads to limited data transmission capabilities. Such transmission limitations directly…

Artificial Intelligence · Computer Science 2025-06-11 Tuan Truong , Rithwik Sudharsan , Yibo Yang , Peter Xiangyuan Ma , Ruihan Yang , Stephan Mandt , Joshua S. Bloom

Over the past decades and even centuries, the astronomical community has accumulated a signif-icant heritage of recorded observations of a great many astronomical objects. Those records con-tain irreplaceable information about long-term…

The number of small satellites has grown dramatically in the past decade from tens of satellites per year in the mid-2010s to a projection of tens of thousands in orbit by the mid-2020s. This presents both problems and opportunities for…

Instrumentation and Methods for Astrophysics · Physics 2020-11-09 Stephen Serjeant , Martin Elvis , Giovanna Tinetti

We present a review of data types and statistical methods often encountered in astronomy. The aim is to provide an introduction to statistical applications in astronomy for statisticians and computer scientists. We highlight the complex,…

Physics Education · Physics 2017-10-23 James P. Long , Rafael S. de Souza

In this review, we explore the historical development and future prospects of artificial intelligence (AI) and deep learning in astronomy. We trace the evolution of connectionism in astronomy through its three waves, from the early use of…

Instrumentation and Methods for Astrophysics · Physics 2023-06-01 Michael J. Smith , James E. Geach

This paper summarizes a presentation for a panel discussion on "The Future of Astrostatistics" held at the Statistical Challenges in Modern Astronomy V conference at Pennsylvania State University in June 2011. I argue that the emerging…

Instrumentation and Methods for Astrophysics · Physics 2016-08-25 Thomas J. Loredo

Policy Brief on "Global Data in Astronomy: Challenges and Opportunities", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July…

Instrumentation and Methods for Astrophysics · Physics 2024-02-21 Renee Hložek , Chenzhou Cui , Mark Allen , Patricia Whitelock , Jess McIver , Giuseppe Longo , Christopher Fluke , Ajit Kembhavi , Pranav Sharma , Ashish Mahabal

The tens of millions of radio sources to be detected with next-generation surveys pose new challenges, quite apart from the obvious ones of processing speed and data volumes. For example, existing algorithms are inadequate for source…

Instrumentation and Methods for Astrophysics · Physics 2017-06-14 Ray P. Norris

Selected results obtained in major observational sky surveys (DSS, 2MASS, 2dF, SDSS) and deep field observations (HDF, GOODS, HUDF, etc.) are reviewed. Modern surveys provide information on the characteristics and space distribution of…

Astrophysics · Physics 2009-11-11 V. P. Reshetnikov