English
Related papers

Related papers: Challenges for LSST scale data sets

200 papers

We summarise the properties of the Sloan Digital Sky Survey (SDSS) project, discuss our software infrastructure, and outline the architecture of the SDSS image processing pipelines. We then discuss two of the algorithms used in the SDSS…

Astronomical observations already produce vast amounts of data through a new generation of telescopes that cannot be analyzed manually. Next-generation telescopes such as the Large Synoptic Survey Telescope and the Square Kilometer Array…

Instrumentation and Methods for Astrophysics · Physics 2019-10-09 Giuseppe Longo , Erzsébet Merényi , Peter Tino

The Large Synoptic Survey Telescope (LSST), the next-generation optical imaging survey sited at Cerro Pachon in Chile, will provide an unprecedented database of astronomical measurements. The LSST design, with an 8.4m (6.7m effective)…

Instrumentation and Methods for Astrophysics · Physics 2017-06-14 Željko Ivezić , Andrew J. Connolly , Mario Jurić

Large Language Model (LLM) agents, acting on their users' behalf to manipulate and analyze data, are likely to become the dominant workload for data systems in the future. When working with data, agents employ a high-throughput process of…

Astronomy and astrophysics are witnessing dramatic increases in data volume as detectors, telescopes and computers become ever more powerful. During the last decade, sky surveys across the electromagnetic spectrum have collected hundreds of…

Instrumentation and Methods for Astrophysics · Physics 2014-11-20 Jacob T. VanderPlas , Andrew J. Connolly , Zeljko Ivezic , Alex Gray

One of the new frontiers of astronomical research is the exploration of time variability on the sky at different wavelengths and flux levels. We have carried out a pilot project using DPOSS data to study strong variables and transients, and…

Planetesimal formation is a common by-product of the star formation process. Taking the dynamical history of the Solar system as a guideline -- in which the planetesimal belts were heavily depleted due to graviational perburbation with the…

Earth and Planetary Astrophysics · Physics 2015-05-14 Amaya Moro-Martin , Edwin L. Turner , Abraham Loeb

Motivated by the recognition that variation in the optical transmission of the atmosphere is probably the main limitation to the precision of ground-based CCD measurements of celestial fluxes, we review the physical processes that attenuate…

Escalating urban heat, driven by the convergence of global warming and rapid urbanization, is a profound threat to billions of city dwellers. The science directing urban heat adaptation is strongly influenced by studies that use…

The Large Synoptic Survey Telescope (LSST) project will conduct a ten year multi-band survey starting in 2022. Observing strategies for this survey are being actively investigated, and the science capabilities can be best forecasted on the…

Instrumentation and Methods for Astrophysics · Physics 2020-04-08 Rahul Biswas , Scott F. Daniel , R. Hložek , A. G. Kim , Peter Yoachim

The remarkable scientific return and legacy of LSST, in the era that it will define, will not only be realized in the breakthrough science that will be achieved with catalog data. This Big Data survey will shape the way the entire…

Synoptic sky surveys are becoming the largest data generators in astronomy, and they are opening a new research frontier, that touches essentially every field of astronomy. Opening of the time domain to a systematic exploration will…

Instrumentation and Methods for Astrophysics · Physics 2015-06-03 S. G. Djorgovski , A. A. Mahabal , A. J. Drake , M. J. Graham , C. Donalek , R. Williams

We are pleased to present a Special Section on Statistics and Astronomy in this issue of the The Annals of Applied Statistics. Astronomy is an observational rather than experimental science; as a result, astronomical data sets both small…

Applications · Statistics 2009-05-15 Thomas J. Loredo , John Rice , Michael L. Stein

There has been an unprecedented and continuing growth in the volume, quality, and complexity of astronomical data sets over the past few years, mainly through large digital sky surveys. Virtual Observatory (VO) concept represents a…

Astrophysics · Physics 2007-05-23 S. G. Djorgovski , R. Brunner , A. Mahabal , R. Williams , R. Granat , P. Stolorz

The Large Synoptic Survey Telescope (LSST) is a proposed 8.4-meter telescope that will be located in the Andes mountains in Chile. Every 17 seconds, a 6.4 GB image is transferred to Illinois for immediate processing. That transfer needs to…

Networking and Internet Architecture · Computer Science 2013-06-25 D. Michael Freemon

The upcoming Legacy Survey of Space and Time (LSST) at the Vera C. Rubin Observatory is expected to revolutionize solar system astronomy. Unprecedented in scale, this ten-year wide-field survey will collect billions of observations and…

Astronomy is entering a new era as multiple, large area, digital sky surveys are in production. The resulting datasets are truly remarkable in their own right; however, a revolutionary step arises in the aggregation of complimentary…

Astrophysics · Physics 2007-05-23 A. S. Szalay , R. J. Brunner

In this white paper, we present the scientific cases for adding narrowband optical filters to the Large Synoptic Survey Telescope (LSST). LSST is currently planning to observe the southern sky in 6 broadband optical filters. Three of the…

Instrumentation and Methods for Astrophysics · Physics 2019-09-09 Peter Yoachim , Melissa Graham , Steven Bet , Milica Vučetić , Željko Ivezić , Martha Boyer , Bojan Arbutina , Olivia Jones

We describe the simulated sky survey underlying the second data challenge (DC2) carried out in preparation for analysis of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) by the LSST Dark Energy Science Collaboration…

Instrumentation and Methods for Astrophysics · Physics 2022-07-22 LSST Dark Energy Science Collaboration , Bela Abolfathi , David Alonso , Robert Armstrong , Éric Aubourg , Humna Awan , Yadu N. Babuji , Franz Erik Bauer , Rachel Bean , George Beckett , Rahul Biswas , Joanne R. Bogart , Dominique Boutigny , Kyle Chard , James Chiang , Chuck F. Claver , Johann Cohen-Tanugi , Céline Combet , Andrew J. Connolly , Scott F. Daniel , Seth W. Digel , Alex Drlica-Wagner , Richard Dubois , Emmanuel Gangler , Eric Gawiser , Thomas Glanzman , Phillipe Gris , Salman Habib , Andrew P. Hearin , Katrin Heitmann , Fabio Hernandez , Renée Hložek , Joseph Hollowed , Mustapha Ishak , Željko Ivezić , Mike Jarvis , Saurabh W. Jha , Steven M. Kahn , J. Bryce Kalmbach , Heather M. Kelly , Eve Kovacs , Danila Korytov , K. Simon Krughoff , Craig S. Lage , François Lanusse , Patricia Larsen , Laurent Le Guillou , Nan Li , Emily Phillips Longley , Robert H. Lupton , Rachel Mandelbaum , Yao-Yuan Mao , Phil Marshall , Joshua E. Meyers , Marc Moniez , Christopher B. Morrison , Andrei Nomerotski , Paul O'Connor , HyeYun Park , Ji Won Park , Julien Peloton , Daniel Perrefort , James Perry , Stéphane Plaszczynski , Adrian Pope , Andrew Rasmussen , Kevin Reil , Aaron J. Roodman , Eli S. Rykoff , F. Javier Sánchez , Samuel J. Schmidt , Daniel Scolnic , Christopher W. Stubbs , J. Anthony Tyson , Thomas D. Uram , Antonia Villarreal , Christopher W. Walter , Matthew P. Wiesner , W. Michael Wood-Vasey , Joe Zuntz

The predicted increase in demand for data-intensive solution development is driving the need for software, data, and domain experts to effectively collaborate in multi-disciplinary data-intensive software teams (MDSTs). We conducted a…

Software Engineering · Computer Science 2023-03-28 Ulrike M. Graetsch , Hourieh Khalajzadeh , Mojtaba Shahin , Rashina Hoda , John Grundy