English
Related papers

Related papers: Africanus I. Scalable, distributed and efficient r…

200 papers

This paper presents a modern and scalable framework for analyzing Detector Control System (DCS) data from the ATLAS experiment at CERN. The DCS data, stored in an Oracle database via the WinCC OA system, is optimized for transactional…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-24 Luca Canali , Andrea Formica , Michelle Ann Solis

This document is one of the deliverable reports created for the ESCAPE project. ESCAPE stands for Energy-efficient Scalable Algorithms for Weather Prediction at Exascale. The project develops world-class, extreme-scale computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-20 Willem Deconinck

Modern astronomical data processing requires complex software pipelines to process ever growing datasets. For radio astronomy, these pipelines have become so large that they need to be distributed across a computational cluster. This makes…

Instrumentation and Methods for Astrophysics · Physics 2018-07-17 Alexandar P. Mechev , Aske Plaat , J. B. Raymond Oonk , Huib T. Intema , Huub J. A. Röttgering

Astroinformatics is a new impact area in the world of astronomy, occasionally called the final frontier, where several astrophysicists, statisticians and computer scientists work together to tackle various data intensive astronomical…

Computational Engineering, Finance, and Science · Computer Science 2015-04-30 Snehanshu Saha , Surbhi Agrawal , Manikandan. R , Kakoli Bora , Swati Routh , Anand Narasimhamurthy

The exponential growth of astronomical data collected by both ground based and space borne instruments has fostered the growth of Astroinformatics: a new discipline laying at the intersection between astronomy, applied computer science, and…

Instrumentation and Methods for Astrophysics · Physics 2015-05-30 Massimo Brescia , Stefano Cavuoti , S. G. Djorgovski , Ciro Donalek , Giuseppe Longo , Maurizio Paolillo

Telescope arrays are receiving increasing attention due to their promise of higher resource utilization, greater sky survey area, and higher frequency of full space-time monitoring than single telescopes. Compared with the ordinary…

Instrumentation and Methods for Astrophysics · Physics 2023-02-07 Yajie Zhang , Ce Yu , Chao Sun , Zhaohui Shang , Yi Hu , Huiyu Zhi , Jinmao Yang , Shanjiang Tang

New and upgraded radio interferometers produce data at massive rates and will require significant improvements in analysis techniques to reach their promised levels of performance in a routine manner. Until these techniques are fully…

Instrumentation and Methods for Astrophysics · Physics 2012-06-29 Peter K. G. Williams , Casey J. Law , Geoffrey C. Bower

We describe preliminary investigations of using Docker for the deployment and testing of astronomy software. Docker is a relatively new containerisation technology that is developing rapidly and being adopted across a range of domains. It…

Software Engineering · Computer Science 2017-07-13 D. Morris , S. Voutsinas , N. C. Hambly , R. G. Mann

The tens of millions of radio sources to be detected with next-generation surveys pose new challenges, quite apart from the obvious ones of processing speed and data volumes. For example, existing algorithms are inadequate for source…

Instrumentation and Methods for Astrophysics · Physics 2017-06-14 Ray P. Norris

More and more distributed software systems are being developed and deployed today. Like other software, distributed software systems also need very strong quality assurance support. Distributed software is often very large/complex, has…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-08 Xiaoqin Fu

We discuss the ground-breaking science that will be possible with a wide area survey, using the MeerKAT telescope, known as MeerKLASS (MeerKAT Large Area Synoptic Survey). The current specifications of MeerKAT make it a great fit for…

Exponential increases in scientific experimental data are outstripping the rate of progress in silicon technology. As a result, heterogeneous combinations of architectures and process or device technologies are increasingly important to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-02 Wilkie Olin-Ammentorp , Xingfu Wu , Andrew A. Chien

There is a wealth of data on air pollution within several users' reach, including modelled concentrations and depositions as well as observations from air quality stations. However, data integration to perceive spatial and temporal trends…

The Square Kilometre Array (SKA) will operate one of the world's largest continuous scientific data systems, sustaining petascale imaging under strict power envelopes. Current radio-interferometric pipelines typically achieve only 4-14% of…

This paper introduces a high-performance artificial intelligence operating system tailored for low-altitude aviation, designed to address key challenges such as real-time task execution, computational efficiency, and seamless modular…

Machine Learning · Computer Science 2025-01-07 Minzhe Tan , Xinlin Fan , Jian He , Yi Hou , Zhan Liu , Yaopeng Jiang , Y. M. Jiang

Astronomy is undergoing through a methodological revolution triggered by an unprecedented wealth of complex and accurate data. The new panchromatic, synoptic sky surveys require advanced tools for discovering patterns and trends hidden…

The Atacama Large mm and sub-mm Array (ALMA) radio observatory is one of the world's largest astronomical projects. After the very successful conclusion of the first observation cycles Early Science Cycles 0 and 1, the ALMA project can…

Instrumentation and Methods for Astrophysics · Physics 2020-12-17 Dirk Petry , Baltasar Vila-Vilaro , Eric Villard , Shinya Komugi , Scott Schnee

As a new generation radio telescope, the Allen Telescope Array (ATA) is a prototype for the square kilometer array (SKA). Here we describe recently developed design constraints for the ATA digital signal processing chain as a case study for…

Instrumentation and Methods for Astrophysics · Physics 2012-11-29 G. R. Harp

Context: The current stellar atmosphere programs still cannot match some fundamental observations of the brightest stars, and with new techniques, such as optical interferometry, providing new data for these stars, additional development of…

Astrophysics · Physics 2009-11-13 John B. Lester , Hilding R. Neilson

The work of astronomers is getting more complex and advanced as the progress of computer development occurs. With improved computing capabilities and increased data flow, more sophisticated software is required in order to interpret, and…

Instrumentation and Methods for Astrophysics · Physics 2015-05-19 Kim K. Nilsson , Ole Moeller-Nilsson