English
Related papers

Related papers: Pipeline Collector: gathering performance data for…

200 papers

Upcoming and future astronomy research facilities will systematically generate terabyte-sized data sets moving astronomy into the Petascale data era. While such facilities will provide astronomers with unprecedented levels of accuracy and…

Instrumentation and Methods for Astrophysics · Physics 2011-11-30 A. H. Hassan , C. J. Fluke , D. G. Barnes

LOFAR, the Low-Frequency Array, is a next-generation software-driven radio telescope operating between 30 and 240MHz, currently under construction by ASTRON in the Netherlands. This low frequency radio band is one of the few largely…

Astrophysics · Physics 2008-02-11 P. N. Best , the LOFAR-UK Consortium

Radio astronomy is entering the era of large surveys. This paper describes the plans for wide surveys with the LOw Frequency ARray (LOFAR) and their synergy with large surveys at higher frequencies (in particular in the 1-2 GHz band) that…

Cosmology and Nongalactic Astrophysics · Physics 2010-01-15 R. Morganti , H. Rottgering , I. Snellen , G. Miley , P. Barthel , P. Best , M. Bruggen , G. Brunetti , K. Chyzy , J. Conway , M. Jarvis , M. Lehnert

We are reporting the updates in version 0.2.0 of the Automated SpectroPhotometric REDuction (ASPIRED) pipeline, designed for common use on different instruments. The default settings support many typical long-slit spectrometer…

Instrumentation and Methods for Astrophysics · Physics 2020-12-08 Marco C Lam , Robert J Smith , Josh Veitch-Michaelis , Iain A Steele , Paul R McWhirter

Very High Resolution satellite and aerial imagery are used to monitor and conduct large scale surveys of ecological systems. Convolutional Neural Networks have successfully been employed to analyze such imagery to detect large animals and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-29 Aymen Al-Saadi , Ioannis Paraskevakos , Bento Collares Gonçalves , Heather J. Lynch , Shantenu Jha , Matteo Turilli

We present the data processing pipeline to generate calibrated data products from the Spectral and Photometric Imaging Receiver (SPIRE) imaging Fourier Transform Spectrometer on the Herschel Space Observatory. The pipeline processes…

As applications grow in capability, they also grow in complexity. This complexity in turn gets pushed into modules and libraries. In addition, hardware configurations become increasingly elaborate, too. These two trends make understanding,…

Software Engineering · Computer Science 2018-03-21 Ronny Brendel , Bert Wesarg , Ronny Tschüter , Matthias Weber , Thomas Ilsche , Sebastian Oeste

A huge amount of data has been acquired with the GREGOR Fabry-P\'erot Interferometer (GFPI), large-format facility cameras, and since 2016 with the High-resolution Fast Imager (HiFI). These data are processed in standardized procedures with…

Instrumentation and Methods for Astrophysics · Physics 2017-09-20 C. Kuckein , C. Denker , M. Verma , H. Balthasar , S. J. González Manrique , R. E. Louis , A. Diercke

The work of astronomers is getting more complex and advanced as the progress of computer development occurs. With improved computing capabilities and increased data flow, more sophisticated software is required in order to interpret, and…

Instrumentation and Methods for Astrophysics · Physics 2015-05-19 Kim K. Nilsson , Ole Moeller-Nilsson

Current and upcoming radio-interferometers are expected to produce volumes of data of increasing size that need to be processed in order to generate the corresponding sky brightness distributions through imaging. This represents an…

Instrumentation and Methods for Astrophysics · Physics 2023-01-18 Claudio Gheller , Giuliano Taffoni , David Goz

Exponential increases in scientific experimental data are outstripping the rate of progress in silicon technology. As a result, heterogeneous combinations of architectures and process or device technologies are increasingly important to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-02 Wilkie Olin-Ammentorp , Xingfu Wu , Andrew A. Chien

This decade, the Square Kilometre Array (SKA) will perform its first observations. Preparations for building dishes, antennas, correlators and infrastructure are well underway. Concurrently, software for the processing of SKA observations…

Instrumentation and Methods for Astrophysics · Physics 2020-11-02 H. Spreeuw , S. Yatawatta , B. Van Werkhoven , F. Diblen

The Low Frequency Array (LOFAR) is a new generation of electronic radio telescope based on aperture array technology. The telescope is being developed by ASTRON, and currently being rolled out across the Netherlands and other countries in…

Cosmology and Nongalactic Astrophysics · Physics 2009-03-07 M. A. Garrett , H. Rampadarath , E. Lenc , Olaf Wucknitz

We present the pulsar_spectra software repository, an open-source pulsar flux density catalogue and automated spectral fitting software that finds the best spectral model and produces publication-quality plots. The Python-based software…

High Energy Astrophysical Phenomena · Physics 2022-11-09 N. A. Swainston , C. P. Lee , S. J. McSweeney , N. D. R. Bhat

The proliferation of low-precision units in modern high-performance architectures increasingly burdens domain scientists. Historically, the choice in HPC was easy: can we get away with 32 bit floating-point operations and lower bandwidth…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-23 Faveo Hoerold , Ivan R. Ivanov , Akash Dhruv , William S. Moses , Anshu Dubey , Mohamed Wahib , Jens Domke

In radio astronomy, the science output of a telescope is often limited by computational resources. This is especially true for transient and technosignature surveys that need to search high-resolution data across a large parameter space.…

Instrumentation and Methods for Astrophysics · Physics 2024-04-11 Danny C. Price

KMOS is a multi-object near-infrared integral field spectrometer with 24 deployable cryogenic pick-off arms. Inevitably, data processing is a complex task that requires careful calibration and quality control. In this paper we describe all…

Energy consumption and hardware cost of signal digitization together with the management of the resulting data volume form serious issues for high-rate measurement systems with multiple sensors. Switching to binary sensing front-ends…

Instrumentation and Methods for Astrophysics · Physics 2019-07-16 Manuel S. Stein

In time-domain astronomy, STLF (Short-Timescale and Large Field-of-view) sky survey is the latest way of sky observation. Compared to traditional sky survey who can only find astronomical phenomena, STLF sky survey can even reveal how short…

Databases · Computer Science 2018-11-28 Chen Yang , Xiaofeng Meng , Zhihui Du , JiaMing Qiu , Kenan Liang , Yongjie Du , Zhiqiang Duan , Xiaobin Ma , Zhijian Fang