English
Related papers

Related papers: Container-Based Pre-Pipeline Data Processing on HP…

200 papers

We implemented a real-time data processor (rta-dp) framework that can be used to develop real-time analysis pipelines and data handling systems to manage high-throughput data streams with distributed applications in the context of ground…

Instrumentation and Methods for Astrophysics · Physics 2025-11-07 A. Bulgarelli , N. Parmiggiani , L. Castaldini , R. Falco , A. Di Piano , V. Fioretti , G. Panebianco , A. Rizzo

We present a mixed-precision benchmark called HPL-MxP that uses both a lower-precision LU factorization with a non-stationary iterative refinement based on GMRES. We evaluate the numerical stability of one of the methods of generating the…

Numerical Analysis · Mathematics 2025-09-25 Jack Dongarra , Piotr Luszczek

We report our design, development, installation and troubleshooting of an open source Gnome X Scanning Microscopy (GXSM) software package for controlling and processing of modern Scanning Probe Microscopy (SPM) system as a development tool…

Instrumentation and Detectors · Physics 2014-10-13 S. K. Suresh Babu , J. S. Devrenjith Singh , D. Jackuline Moni , D. Devaprakasam

We describe the Outer Rim cosmological simulation, one of the largest high-resolution N-body simulations performed to date, aimed at promoting science to be carried out with large-scale structure surveys. The simulation covers a volume of…

This paper presents the simulation of the GLAST high energy gamma-ray telescope. The simulation package, written in C++, is based on the Geant4 toolkit, and it is integrated into a general framework used to process events. A detailed…

The XRISM (X-Ray Imaging and Spectroscopy Mission) satellite was successfully launched and put into a low-Earth orbit on September 6, 2023 (UT). The Resolve instrument onboard XRISM hosts an x-ray microcalorimeter detector, which was…

The Data Handling Pipeline ("Pipeline") has been developed for the Fermi Gamma-Ray Space Telescope (Fermi) Large Area Telescope (LAT) which launched in June 2008. Since then it has been in use to completely automate the production of data…

Instrumentation and Methods for Astrophysics · Physics 2012-12-18 Stephan Zimmer , Luisa Arrabito , Tom Glanzman , Tony Johnson , Claudia Lavalley , Andrei Tsaregorodtsev

We developed a high-speed image reduction pipeline using Graphics Processing Units (GPUs) as hardware accelerators. Astronomers desire detecting EM counterpart of gravitational-wave sources as soon as possible for sharing positional…

Instrumentation and Methods for Astrophysics · Physics 2020-10-14 Masafumi Niwano , Katsuhiro L. Murata , Ryo Adachi , Sili Wang , Yutaro Tachibana , Youichi Yatsu , Nobuyuki Kawai , Takashi Shimokawabe , Ryousuke Itoh

This paper introduces H-STREAM, a big stream/data processing pipelines evaluation engine that proposes stream processing operators as micro-services to support the analysis and visualisation of Big Data streams stemming from IoT (Internet…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-10 Genoveva Vargas-Solar , Javier A. Espinosa-Oviedo

Solar X-ray Monitor (XSM) instrument of India's Chandrayaan-2 lunar mission carries out broadband spectroscopy of the Sun in soft X-rays. XSM, with its unique features such as low background, high time cadence, and high spectral resolution,…

High Performance Computing (HPC) on hybrid clusters represents a significant opportunity for Computational Fluid Dynamics (CFD), especially when modern accelerators are utilized effectively. However, despite the widespread adoption of GPUs,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-30 Simone Bnà , Giuseppe Giaquinto , Ettore Fadiga , Tommaso Zanelli , Francesco Bottau

The spectroscopic performance of an X-ray microcalorimeter is compromised at high count rates. In this study, we utilize the Resolve X-ray microcalorimeter onboard the XRISM satellite to examine the effects observed during high count rate…

TSUBAME is a micro-satellite that the students of Tokyo Institute of Technology took the lead to develop for measuring hard X-ray polarization of Gamma-Ray Bursts(GRBs) in order to reveal the nature of the central engine of GRBs. TSUBAME…

The High Inclination Solar Mission (HISM) is a concept for an out-of-the-ecliptic mission for observing the Sun and the heliosphere. The mission profile is largely based on the Solar Polar Imager concept: initially spiraling in to a 0.48 AU…

Instrumentation and Methods for Astrophysics · Physics 2020-06-08 K. Kobayashi , L. Johnson , H. Thomas , S. McIntosh , D. McKenzie , J. Newmark , A. Heaton , J. Carr , M. Baysinger , Q. Bean , L. Fabisinski , P. Capizzo , K. Clements , S. Sutherlin , J. Garcia , K. Medina , D. Turse

The production of science-ready data from major solar telescopes requires expertise beyond that of the typical observer. This is a consequence of the increasing complexity of instruments and observing sequences, which require calibrations…

Solar and Stellar Astrophysics · Physics 2014-12-17 J. de la Cruz Rodríguez , M. Löfdahl , P. Sütterlin , T. Hillberg , L. Rouppe van der Voort

Optimizing communication performance is imperative for large-scale computing because communication overheads limit the strong scalability of parallel applications. Today's network cards contain rather powerful processors optimized for data…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-20 Torsten Hoefler , Salvatore Di Girolamo , Konstantin Taranov , Ryan E. Grant , Ron Brightwell

Physical Reservoir Computing (PRC) is an unconventional computing paradigm, which exploits nonlinear dynamics of reservoir blocks to perform recognition and classification tasks. Here we show with simulations that patterned thin films…

Mesoscale and Nanoscale Physics · Physics 2023-05-18 Md Mahadi Rajib , Walid Al Misba , Md. Fahim F. Chowdhury , Muhammad Sabbir Alam , Jayasimha Atulasimha

Exascale computing will get mankind closer to solving important social, scientific and engineering problems. Due to high prototyping costs, High Performance Computing (HPC) system architects make use of simulation models for design space…

Performance · Computer Science 2018-03-28 Alexandra Ferreron , Radhika Jagtap , Sascha Bischoff , Roxana Rusitoru

With the growing complexity of computational and experimental facilities, many scientific researchers are turning to machine learning (ML) techniques to analyze large scale ensemble data. With complexities such as multi-component workflows,…

We present the pyKLIP-CHARIS post-processing pipeline, a Python library that reduces high contrast imaging data for the CHARIS integral field spectrograph used with the SCExAO project on the Subaru Telescope. The pipeline is a part of the…

Instrumentation and Methods for Astrophysics · Physics 2023-09-11 Minghan Chen , Jason J. Wang , Timothy D. Brandt , Thayne Currie , Julien Lozi , Jeffrey Chilcote , Maria Vincent