Related papers: Real-time stream processing in radio astronomy
Radio astronomy has entered its golden era, with many revolutionary facilities such as SKA, ngVLA, and LOFAR2.0 coming online in the next decade. These facilities are certain to redefine radio astronomy. However, on smaller scales-such as…
Rate Splitting Multiple Access (RSMA) has emerged as an effective interference management scheme for applications that require high data rates. Although RSMA has shown advantages in rate enhancement and spectral efficiency, it has yet not…
Modern radio telescopes generate large amounts of data, with the next generation Very Large Array (ngVLA) and the Square Kilometre Array (SKA) expected to feed up to 292 GB of visibilities per second to the science data processor (SDP).…
This paper investigates the operator mapping problem for in-network stream-processing applications. In-network stream-processing amounts to applying one or more trees of operators in steady-state, to multiple data objects that are…
The growing popularity of big data and Internet of Things (IoT) applications bring new challenges to the wireless communication community. Wireless transmission systems should more efficiently support the large amount of data traffics from…
Operation of the US Virtual Astronomical Observatory shares some issues with modern physical observatories, e.g., intimidating data volumes and rapid technological change, and must also address unique concerns like the lack of direct…
Signal processing is a fundamental component of almost any sensor-enabled system, with a wide range of applications across different scientific disciplines. Time series data, images, and video sequences comprise representative forms of…
Laser writing of materials is normally performed by the sequential scanning of a single focused beam across a sample. This process is time-consuming and it can severely limit the throughput of laser systems in key applications such as…
This project outlines the complete development of a variable star classification algorithm methodology. With the advent of Big-Data in astronomy, professional astronomers are left with the problem of how to manage large amounts of data, and…
Astronomy, as many other scientific disciplines, is facing a true data deluge which is bound to change both the praxis and the methodology of every day research work. The emerging field of astroinformatics, while on the one end appears…
Phase, frequency, and time synchronization are crucial requirements for many applications, such as multi-static remote sensing and communication systems. Moreover, the synchronization solution becomes even more challenging when the nodes…
The detection of fast radio bursts (FRBs) in radio astronomy is a complex task due to the challenges posed by radio frequency interference (RFI) and signal dispersion in the interstellar medium. Traditional search algorithms are often…
With the explosive growth of big data, workloads tend to get more complex and computationally demanding. Such applications are processed on distributed interconnected resources that are becoming larger in scale and computational capacity.…
We study network response to queries that require computation of remotely located data and seek to characterize the performance limits in terms of maximum sustainable query rate that can be satisfied. The available resources include (i) a…
LoraWAN has turned out to be one of the most successful frameworks in IoT devices. Real world scenarios demand the use of such networks along with a robust stream processing application layer. To maintain the exactly once processing…
Modern optical communication systems transmit multiple frequency channels, each operating very close to its theoretical limit. The total bandwidth can reach 10THz limited by the optical amplifiers. Maximizing spectral efficiency, the…
Data streaming relies on continuous queries to process unbounded streams of data in a real-time fashion. It is commonly demanding in computation capacity, given that the relevant applications involve very large volumes of data. Data…
Fast variability of optical objects is an interesting though poorly explored subject in modern astronomy. Real-time data processing and identification of transient celestial events in the images is very important for such study as it allows…
The nature of scientific and technological data collection is evolving rapidly: data volumes and rates grow exponentially, with increasing complexity and information content, and there has been a transition from static data sets to data…
Data management is a critical component of modern experimental workflows. As data generation rates increase, transferring data from acquisition servers to processing servers via conventional file-based methods is becoming increasingly…