English
Related papers

Related papers: Container-Based Pre-Pipeline Data Processing on HP…

200 papers

SAKURAONE is a managed high performance computing (HPC) cluster developed and operated by the SAKURA Internet Research Center. It reinforces the ``KOKARYOKU PHY'' configuration of bare-metal GPU servers and is designed as a cluster…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-04 Fumikazu Konishi

The Open Knowledgebase of Interatomic Models (OpenKIM) is an NSF Science Gateway that archives fully functional computer implementations of interatomic models (potentials and force fields) and simulation codes that use them to compute…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-31 Daniel S. Karls , Steven M. Clark , Brendon A. Waters , Ryan S. Elliott , Ellad B. Tadmor

The simulation of quantum circuits using the tensor network method is very computationally demanding and requires significant High Performance Computing (HPC) resources to find an efficient contraction order and to perform the contraction…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-25 David Brayford , John Brennan , Momme Allalen , Kenneth Hanley , Luigi Iapichino , Lee ORiordan , Niall Moran

Since the birth of X-ray astronomy, spectral, spatial and timing observation improved dramatically, procuring a wealth of information on the majority of the classes of the celestial sources. Polarimetry, instead, remained basically…

Containers are an emerging technology that hold promise for improving productivity and code portability in scientific computing. We examine Linux container technology for the distribution of a non-trivial scientific computing software stack…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-19 Jack S. Hale , Lizao Li , Chris N. Richardson , Garth N. Wells

We present data preprocessing based on an artificial neural network to estimate the parameters of the X-ray emission spectra of a single-temperature thermal plasma. The method finds appropriate parameters close to the global optimum. The…

Instrumentation and Methods for Astrophysics · Physics 2018-05-15 Y. Ichinohe , S. Yamada , N. Miyazaki , S. Saito

We present the results of our investigations into options for the computing platform for the imaging pipeline in the CHILES project, an ultra-deep HI pathfinder for the era of the Square Kilometre Array. CHILES pushes the current computing…

Instrumentation and Methods for Astrophysics · Physics 2015-11-03 Richard Dodson , Kevin Vinsen , Chen Wu , Attila Popping , Martin Meyer , Andreas Wicenec , Peter Quinn , Jacqueline van Gorkom , Emmanuel Momjian

We present a fully modular and scalable software pipeline for processing electron microscope (EM) images of brain slices into 3D visualization of individual neurons and demonstrate an end-to-end segmentation of a large EM volume using a…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-20 Rafael Vescovi , Hanyu Li , Jeffery Kinnison , Murat Keceli , Misha Salim , Narayanan Kasthuri , Thomas D. Uram , Nicola Ferrier

High-throughput imaging workflows, such as Parallel Rapid Imaging with Spectroscopic Mapping (PRISM), generate data at rates that exceed conventional real-time processing capabilities. We present a scalable FPGA-based preprocessing pipeline…

Hardware Architecture · Computer Science 2025-11-26 Weichien Liao

High-Performance Computing (HPC) platforms enable scientific software to achieve breakthroughs in many research fields such as physics, biology, and chemistry, by employing Research Software Engineering (RSE) techniques. These include 1)…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-16 Matan Rusanovsky , Re'em Harel , Lee-or Alon , Idan Mosseri , Harel Levin , Gal Oren

The CHIME Pathfinder is a new interferometric radio telescope that uses a hybrid FPGA/GPU FX correlator. The GPU-based X-engine of this correlator processes over 819 Gb/s of 4+4-bit complex astronomical data from N=256 inputs across a 400…

Instrumentation and Methods for Astrophysics · Physics 2015-06-16 Andre Recnik , Kevin Bandura , Nolan Denman , Adam D. Hincks , Gary Hinshaw , Peter Klages , Ue-Li Pen , Keith Vanderlinde

Remote Memory Access (RMA) enables direct access to remote memory to achieve high performance for HPC applications. However, most modern parallel programming models lack schemes for the remote process to detect the completion of RMA…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-15 Guangnan Feng , Jiabin Xie , Dezun Dong , Yutong Lu

Very High Resolution satellite and aerial imagery are used to monitor and conduct large scale surveys of ecological systems. Convolutional Neural Networks have successfully been employed to analyze such imagery to detect large animals and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-29 Aymen Al-Saadi , Ioannis Paraskevakos , Bento Collares Gonçalves , Heather J. Lynch , Shantenu Jha , Matteo Turilli

Physical Reservoir Computing (PRC) is a recently developed variant of Neuromorphic Computing, where a pertinent physical system effectively projects information encoded in the input signal into a higher-dimensional space. While various…

NASA JPL scientists working on the micro x-ray fluorescence (microXRF) spectroscopy data collected from Mars surface perform data analysis to look for signs of past microbial life on Mars. Their data analysis workflow mainly involves…

Human-Computer Interaction · Computer Science 2021-03-31 Connie Ye , Lukas Hermann , Nur Yildirim , Shravya Bhat , Dominik Moritz , Scott Davidoff

We developed a pulsar search pipeline based on PRESTO (PulsaR Exploration and Search Toolkit). This pipeline simply runs dedispersion, FFT (Fast Fourier Transformation), and acceleration search in process-level parallel to shorten the…

Instrumentation and Methods for Astrophysics · Physics 2020-07-08 Qiuyu Yu , Zhichen Pan , Lei Qian , Shen Wang , Youling Yue , Menglin Huang , Qiaoli Hao , Shanping You , Bo Peng , Yan Zhu , Lei Zhang , Zhijie Liu

Recent developments in the commercial open source community have catalysed the use of Linux containers for scalable deployment of web-based applications to the cloud. Scientific software can be containerized with dependencies, configuration…

Software Engineering · Computer Science 2015-09-30 Robert Nagler , David Bruhwiler , Paul Moeller , Stephen Webb

In this article we present PARSIR (PARallel SImulation Runner), a package that enables the effective exploitation of shared-memory multi-processor machines for running discrete event simulation models. PARSIR is a compile/run-time…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-02 Francesco Quaglia