Related papers: Petabyte Scale Data Mining: Dream or Reality?

The advent of deep, wide, accurate, digital photometric surveys exemplified by the Sloan Digital Sky Survey (SDSS) has had a profound impact on studies of the Milky Way. In the past decade, we have transitioned from a scarcity to an…

We present a high-performance, graphics processing unit (GPU)-based framework for the efficient analysis and visualization of (nearly) terabyte (TB)-sized 3-dimensional images. Using a cluster of 96 GPUs, we demonstrate for a 0.5 TB image:…

The production of complex astronomical data is accelerating, especially with newer telescopes producing ever more large-scale surveys. The increased quantity, complexity, and variety of astronomical data demand a parallel increase in skill…

We live in an age where an enormous amount of astrometric, photometric, asteroseismic, and spectroscopic data of Milky Way stars are being acquired, many orders of magnitude larger than about a decade ago. Thanks to the Gaia astrometric…

Data Stream Mining is one of the area gaining lot of practical significance and is progressing at a brisk pace with new methods, methodologies and findings in various applications related to medicine, computer science, bioinformatics and…

Currently, experts from IT industry are closely monitoring the soaring total volume of digital data. Moreover the problem is not purely technical, it directly affects human civilization as a whole. The growth rate of the all increasing and…

The knowledge discovery potential of the new large astronomical databases is vast. When these are used in conjunction with the rich legacy data archives, the opportunities for scientific discovery multiply rapidly. A Virtual Observatory…

The Atacama Large Millimeter/submillimeter Array with the planned electronic upgrades will deliver an unprecedented amount of deep and high resolution observations. Wider fields of view are possible with the consequential cost of image…

The body of photometric and astrometric data on stars in the Galaxy has been growing very fast in recent years (Hipparcos/Tycho, OGLE-3, 2-Mass, DENIS, UCAC2, SDSS, RAVE, Pan Starrs, Hermes, ...) and in two years ESA will launch the Gaia…

The Pan-STARRS Data Processing System is responsible for the steps needed to downloaded, archive, and process all images obtained by the Pan-STARRS telescopes, including real-time detection of transient sources such as supernovae and moving…

In this thesis the data analysis designed by author for the "Pi of the Sky" experiment is presented. The data analysis consists of data reduction and specific algorithms for identification of short time scale astrophysical processes. The…

Modern radio telescopes will daily generate data sets on the scale of exabytes for systems like the Square Kilometre Array (SKA). Massive data sets are a source of unknown and rare astrophysical phenomena that lead to discoveries.…

This paper describes the most significant data-related challenges involved in building internet-scale 3D search engines. The discussion centers on the most pressing data management issues in this domain, including model acquisition, support…

The scientific community is presently witnessing an unprecedented growth in the quality and quantity of data sets coming from simulations and real-world experiments. To access effectively and extract the scientific content of such…

Cosmological data in the next decade will be characterized by high-precision, multi-wavelength measurements of thousands of square degrees of the same patches of sky. By performing multi-survey analyses that harness the correlated nature of…

The Harvard College Observatory was the preeminent astronomical data center of the early 20th century: it gathered and archived an enormous collection of glass photographic plates that became, and remains, the largest in the world. For…

The Sloan Digital Sky Survey (SDSS) will carry out a digital photometric and spectroscopic survey over pi steradians in the northern Galactic cap. An array of CCD detectors used in drift-scan mode will image the sky in five passbands to a…

The Sloan Digital Sky Survey (SDSS) is collecting photometry and intermediate resolution spectra for ~ 10**5 stars in the thick-disk and stellar halo of the Milky Way. This massive dataset can be used to infer the properties of the stars…

Over the next decade we will witness the development of a new infrastructure in support of data-intensive scientific research, which includes Astronomy. This new networked environment will offer both challenges and opportunities to our…

As astronomy enters the petascale data era, astronomers are faced with new challenges relating to storage, access and management of data. A shift from the traditional approach of combining data and analysis at the desktop to the use of…