LSST promises to be the largest optical imaging survey of the sky. If we were fortunate enough to have the equivalent of LSST today, it would represent a "fire hose" of data that would be difficult to store, transfer, and analyze with available compute resources. LSST parallels the SDSS compute task which was ambitious yet tractable. By almost any measure relative to computers that will be available (thanks to the steady progression of Moore's Law), LSST will be a small data set. LSST will never fill more than 22 hard drives. Individual investigators will be able to maintain their own data copies to analyze as they choose.
Cite
@article{arxiv.1203.0591,
title = {LSST is Not "Big Data"},
author = {David Schlegel},
journal= {arXiv preprint arXiv:1203.0591},
year = {2012}
}
Comments
Letter submitted to the NSF Astronomy Portfolio Review