Related papers: Real-time stream processing in radio astronomy
The Virtual Observatory (VO) is realizing global electronic integration of astronomy data. One of the long-term goals of the U.S. VO project, the Virtual Astronomical Observatory (VAO), is development of services and protocols that respond…
The field of satellite communications is enjoying a renewed interest in the global telecom market, and very high throughput satellites (V/HTS), with their multiple spot-beams, are key for delivering the future rate demands. In this article,…
We present how to implement fiber-distributed signal processing in the context of fiber-wireless communications by using different multicore fibers, providing both radio access distribution and microwave photonics signal processing in the…
The nature of scientific and technological data collection is evolving rapidly: data volumes and rates grow exponentially, with increasing complexity and information content, and there has been a transition from static data sets to data…
Calibrating telescope data is one of the most important issues an observer faces. In this chapter we describe a number of the methods which are commonly used to calibrate radio telescope data in the centimeter wavelength regime. This…
Astronomy depends on ever increasing computing power. Processor clock-rates have plateaued, and increased performance is now appearing in the form of additional processor cores on a single chip. This poses significant challenges to the…
This article emphasizes the great potential of big data processing for advanced user- and situation-oriented, so context-aware resource utilization in future wireless networks. In particular, we consider the application of dedicated,…
Current and future continuum surveys being undertaken by the new generation of radio telescopes are now poised to address many important science questions, ranging from the earliest galaxies, to the physics of nearby AGN, as well as…
We present a procedure for efficiently compressing astronomical radio data for high performance applications. Integrated, post-correlation data are first passed through a nearly lossless rounding step which compares the precision of the…
Studying the rapid variability of many astronomical objects is key to understanding the underlying processes at play. However, a combination of limited telescope availability, viewing constraints, and the unpredictable nature of many…
Astronomical observations already produce vast amounts of data through a new generation of telescopes that cannot be analyzed manually. Next-generation telescopes such as the Large Synoptic Survey Telescope and the Square Kilometer Array…
Radio telescopes observe extremely faint emission from astronomical objects, ranging from compact sources to large scale structures that can be seen across the whole sky. Satellites actively transmit at radio frequencies (particularly at…
Stream processing has become a critical component in the architecture of modern applications. With the exponential growth of data generation from sources such as the Internet of Things, business intelligence, and telecommunications,…
Stream processing is a computing paradigm that supports real-time data processing for a wide variety of applications. At Meta, it's used across the company for various tasks such as deriving product insights, providing and improving user…
We live in momentous times. The science community is empowered with an arsenal of cosmic messengers to study the Universe in unprecedented detail. Gravitational waves, electromagnetic waves, neutrinos and cosmic rays cover a wide range of…
Today's astronomical projects need computational systems capable to store and analyze large amounts of scientific data, to effectively share data with other research Institutes and to easily implement information services to present data…
Observatories are complex scientific and technical institutions serving diverse users and purposes. Their telescopes, instruments, software, and human resources engage in interwoven workflows over a broad range of timescales. These…
Stream Processing (SP) has evolved as the leading paradigm to process and gain value from the high volume of streaming data produced e.g. in the domain of the Internet of Things. An SP system is a middleware that deploys a network of…
A system of synchronized radio telescopes is utilized to search for hypothetical wide bandwidth interstellar communication signals. Transmitted signals are hypothesized to have characteristics that enable high channel capacity and minimally…
Large-scale science instruments, such as the distributed radio telescope LOFAR, show that we are in an era of data-intensive scientific discovery. Such instruments rely critically on significant computing resources, both hardware and…