Related papers: Challenges for LSST scale data sets
Machine learning has become essential for automated classification of astronomical transients, but current approaches face significant limitations: classifiers trained on simulations struggle with real data, models developed for one survey…
The 3.2 giga-pixel LSST camera will produce approximately half a petabyte of archive images every month. These data need to be reduced in under a minute to produce real-time transient alerts, and then added to the cumulative catalog for…
An array of large observational programs using ground-based and space-borne telescopes is planned in the next decade. The forthcoming wide-field sky surveys are expected to deliver a sheer volume of data exceeding an exabyte. Processing the…
An automated, rapid classification of transient events detected in the modern synoptic sky surveys is essential for their scientific utility and effective follow-up using scarce resources. This presents some unusual challenges: the data are…
Network utilisation efficiency can, at least in principle, often be improved by dynamically re-configuring routing policies to better distribute on-going large data transfers. Unfortunately, the information necessary to decide on an…
The Large Synoptic Survey Telescope (LSST) will be the largest time-domain photometric survey ever. In order to maximize the LSST science yield for a broad array of transient stellar phenomena, it is necessary to optimize the survey…
Astrophysics and cosmology are rich with data. The advent of wide-area digital cameras on large aperture telescopes has led to ever more ambitious surveys of the sky. Data volumes of entire surveys a decade ago can now be acquired in a…
The Sloan Digital Sky Survey (SDSS) is a project to definitively map $\pi$ steradians of the local Universe. An array of CCD detectors used in drift-scan mode will digitally image the sky in five passbands to a limiting magnitude of $r'…
Research in Simultaneous Localization and Mapping (SLAM) has made outstanding progress over the past years. SLAM systems are nowadays transitioning from academic to real world applications. However, this transition has posed new demanding…
We find ourselves on the brink of an exciting era in observational astrophysics, driven by groundbreaking facilities like JWST, Euclid, Rubin, Roman, SKA, or ELT. Simultaneously, computational astrophysics has shown significant strides,…
A major challenge in modern radio astronomy is dealing with the massive data volumes generated by wide-bandwidth receivers. Such massive data rates are often too great for a single device to cope, and so processing must be split across…
I review some results of estimation of the power spectrum of density fluctuations from galaxy redshift surveys and discuss advances that may be possible with the Sloan Digital Sky Survey. I then examine the realities of power spectrum…
We present a unique method that allows the LSST to scan the sky for stellar variability on short timescales. The operational component of the strategy requires LSST to take star trail images. The image processing component uses deep…
The astronomical community is grappling with the increasing volume and complexity of data produced by modern telescopes, due to difficulties in reducing, accessing, analyzing, and combining archives of data. To address this challenge, we…
Nowadays, science has been coming into a new paradigm, called data-intensive science. While current studies of the new phenomenon focused on building up infrastructure for this new paradigm, yet a few studies concern users of scientific…
We describe a camera beam simulator for the LSST which is capable of illuminating a 60mm field at f/1.2 with realistic astronomical scenes, enabling studies of CCD astrometric and photometric performance. The goal is to fully simulate LSST…
Large Language Models (LLMs) have emerged as transformative tools in artificial intelligence (AI), exhibiting remarkable capabilities across diverse tasks such as text generation, reasoning, and decision-making. While their success has…
We provide an overview of the science benefits of combining information from the Square Kilometre Array (SKA) and the Large Synoptic Survey Telescope (LSST). We first summarise the capabilities and timeline of the LSST and overview its…
We describe briefly the Palomar-Quest (PQ) digital synoptic sky survey, including its parameters, data processing, status, and plans. Exploration of the time domain is now the central scientific and technological focus of the survey. To…
We have developed an end-to-end photometric data processing pipeline to compare current photometric algorithms commonly used on ground-based imaging data. This testbed is exceedingly adaptable, and enables us to perform many research and…