相关论文: Partitioning SKA Dataflows for Optimal Graph Execu…

Graph partitioning, or community detection, is the cornerstone of many fields, such as logistics, transportation and smart power grids. Efficient computation and efficacious evaluation of communities are both essential, especially in…

Efficient data streaming is essential for real-time data analytics, visualization, and machine learning model training, particularly when dealing with high-volume datasets. Various streaming technologies and serialization protocols have…

The Square Kilometer Array (SKA) has the potential to produce galaxy redshift surveys which will be competitive with other state of the art cosmological experiments in the next decade. In this chapter we summarise what capabilities the…

We give an overview of complementarity and synergy in cosmology between the Square Kilometre Array and future survey projects in other wavelengths. In the SKA era, precision cosmology will be limited by systematic errors and cosmic…

Next generation radio telescopes will require orders of magnitude more computing power to provide a view of the universe with greater sensitivity. In the initial stages of the signal processing flow of a radio telescope, signal correlation…

AI agents execute tens to hundreds of chained LLM calls per task, yet GPU schedulers treat each call as independent, discarding gigabytes of intermediate state between steps and inflating end-to-end latency by 3-8x. We argue that this…

Spectroscopic surveys are undergoing a rapid expansion in their data collecting capabilities, reaching the level of hundreds of spectra per pointing. An efficient use of such huge amounts of information requires a high degree of…

Future Square Kilometre Array (SKA) surveys are expected to generate huge datasets of 21cm maps on cosmological scales from the Epoch of Reionization (EoR). We assess the viability of exploiting machine learning techniques, namely,…

Recently we create so much data (2.5 quintillion bytes every day) that 90% of the data in the world today has been created in the last two years alone [1]. This data comes from sensors used to gather traffic or climate information, posts to…

Array operations are one of the most concise ways of expressing common filtering and simple aggregation operations that is the hallmark of the first step of a particle physics analysis: selection, filtering, basic vector operations, and…

The Large Synoptic Survey Telescope (LSST) is an ambitious astronomical survey with a similarly ambitious Data Management component. Data Management for LSST includes processing on both nightly and yearly cadences to generate transient…

The Square Kilometre Array (SKA) will be operating at the time when several new large optical, X-ray and Gamma-ray facilities are expected to be working. To make SKA both competitive and complementary to these large facilities, thorough…

The Square Kilometre Array (SKA) will offer an unprecedented view onto the early Universe, using interferometric observations of the redshifted 21cm line. The 21cm line probes the thermal and ionization state of the cosmic gas, which is…

Diamond Light Source (DLS), the UK synchrotron facility, attracts scientists from across the world to perform ground-breaking x-ray experiments. With over 3000 scientific users per year, vast amounts of data are collected across the…

The digital revolution is transforming astronomy from a data-starved to a data-submerged science. Instruments such as the Atacama Large Millimeter Array (ALMA), the Large Synoptic Survey Telescope (LSST), and the Square Kilometer Array…

Large data and computing centers consume a significant share of the world's energy consumption. A prominent subset of the workloads in such centers are workflows with interdependent tasks, usually represented as directed acyclic graphs…

Within the next few years, the Square Kilometer Array (SKA) or one of its pathfinders will hopefully provide a detection of the 21-cm signal fluctuations from the Epoch of Reionization (EoR). Then, the main goal will be to accurately…

The next generation of radio astronomy telescopes are challenging existing data analysis paradigms, as they have an order of magnitude more antennas and larger bandwidth. Foremost amongst these are deep spectral line surveys, because these…

Pulsar acceleration searches are methods for recovering signals from radio telescopes, that may otherwise be lost due to the effect of orbital acceleration in binary systems. The vast amount of data that will be produced by next generation…

The distributed telescope array offers promise for conducting large-sky-area, high-frequency time domain surveys. Multiple telescopes can be deployed at each observation site, so intra-site observation task scheduling is crucial for…