Related papers: Real-time Data Ingestion at the Keck Observatory A…

Recent advancements in detector technology have significantly increased the size and complexity of experimental data, and high-performance computing (HPC) provides a path towards more efficient and timely data processing. However, movement…

We present three Virtual Observatory tools developed at the ATNF for the storage, processing and visualisation of ATCA data. These are the Australia Telescope Online Archive, a prototype data reduction pipeline, and the Remote Visualisation…

With the advent of the Internet-of-Things (IoT), handling large volumes of time-series data has become a growing concern. Data, generated from millions of Internet-connected sensors, will drive new IoT applications and services. A key…

In recent years, artificial intelligence (AI) based on deep learning (DL) has sparked tremendous global interest. DL is widely used today and has expanded into various interesting areas. It is becoming more popular in cross-subject…

Data Lake (DL) is a Big Data analysis solution which ingests raw data in their native format and allows users to process these data upon usage. Data ingestion is not a simple copy and paste of data, it is a complicated and important phase…

Real-time understanding of continuous video streams is essential for intelligent agents operating in high-stakes environments, including autonomous vehicles, surveillance drones, and disaster response robots. Yet, most existing video…

Researchers have presented systems for efficiently analysing video data at scale using sampling algorithms. While these systems effectively leverage the temporal redundancy present in videos, they suffer from three limitations. First, they…

Next-generation telescopes will bring groundbreaking discoveries but they will also present new technological challenges. The Square Kilometre Array Observatory (SKAO) will be one of the most demanding scientific infrastructures, with a…

Measuring Quality of Experience (QoE) and integrating these measurements into video streaming algorithms is a multi-faceted problem that fundamentally requires the design of comprehensive subjective QoE databases and metrics. To achieve…

A method of near real-time detection and tracking of resident space objects (RSOs) using a convolutional neural network (CNN) and linear quadratic estimator (LQE) is proposed. Advances in machine learning architecture allow the use of…

The Legacy Survey of Space and Time, operated by the Vera C. Rubin Observatory, is a 10-year astronomical survey due to start operations in 2022 that will image half the sky every three nights. LSST will produce ~20TB of raw data per night…

We developed and built a new system of readout and trigger electronics, based on the waveform digitization and pipeline readout, for the KOTO experiment at J-PARC, Japan. KOTO aims at observing the rare kaon decay…

Spectro Capture is a Python-based software system developed to automate small- observatory fibre-fed spectroscopy. The system integrates target selection, telescope slewing, guide star acquisition, fibre position restoration, calibration…

As current- and next-generation astronomical instruments come online, they will generate an unprecedented deluge of data. Analyzing these data in real time presents unique conceptual and computational challenges, and their long-term storage…

Real-time text processing systems are required in many domains to quickly identify patterns, trends, sentiments, and insights. Nowadays, social networks, e-commerce stores, blogs, scientific experiments, and server logs are main sources…

COCOA (COmpact COmpton cAmera) is a next-generation gamma-ray telescope designed for astrophysical observations in the MeV energy range. The detector comprises a scatterer volume employing the LiquidO detection technology and an array of…

We report the design, operation, and performance of a next generation high-speed data acquisition system for multi-channel infrared and optical photometry based on the modern technologies of Field Programmable Gate Arrays, the Peripheral…

In an era of rapid climate change and its adverse effects on food production, technological intervention to monitor pollinator conservation is of paramount importance for environmental monitoring and conservation for global food security.…

Wide-field surveys have markedly enhanced the discovery and study of solar system objects (SSOs). The 2.5-meter Wide Field Survey Telescope (WFST) represents the foremost facility dedicated to optical time-domain surveys in the northern…

Real-time control (RTC) is pivotal for any Adaptive Optics (AO) system, including high-contrast imaging of exoplanets and circumstellar environments. It is the brain of the AO system, and what wavefront sensing and control (WFS\&C)…