English
Related papers

Related papers: HPC Containers for EBRAINS: Towards Portable Cross…

200 papers

High performance computing (HPC) and cloud have traditionally been separate, and presented in an adversarial light. The conflict arises from disparate beginnings that led to two drastically different cultures, incentive structures, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-24 Vanessa Sochat , David Fox , Daniel Milroy

The movement of large-scale (tens of Terabytes and larger) data sets between high performance computing (HPC) facilities is an important and increasingly critical capability. A growing number of scientific collaborations rely on HPC…

The scale of scientific High Performance Computing (HPC) and High Throughput Computing (HTC) has increased significantly in recent years, and is becoming sensitive to total energy use and cost. Energy-efficiency has thus become an important…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-10-14 David Abdurachmanov , Peter Elmer , Giulio Eulisse , Robert Knight , Tapio Niemi , Jukka K. Nurminen , Filip Nyback , Goncalo Pestana , Zhonghong Ou , Kashif Khan

Container technologies, like Docker, are becoming increasingly popular. Containers provide exceptional developer experience because containers offer lightweight isolation and ease of software distribution. Containers are also widely used in…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-01 Pablo Chico de Guzman , Felipe Gorostiaga , Cesar Sanchez

The growing complexity and scale of scientific workflows in high performance computing (HPC) environments have led to significant challenges in managing energy consumption without compromising computational performance. Traditional…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-25 Ali Zahir , Ashiq Anjum , Mark Wilkinson , Jeyan Thiyagalingam

The last few years have seen an increase in adoption of the cloud for running HPC applications. The pay-as-you-go cost model of these cloud resources has necessitated the development of specialized programming models and schedulers for HPC…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-20 Aditya Bhosale , Kavitha Chandrasekar , Laxmikant Kale , Sara Kokkila-Schumacher

Advanced scientific applications require coupling distributed sensor networks with centralized high-performance computing facilities. Citrus Under Protective Screening (CUPS) exemplifies this need in digital agriculture, where citrus…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-25 Liubov Kurafeeva , Alan Subedi , Ryan Hartung , Michael Fay , Avhishek Biswas , Shantenu Jha , Ozgur O. Kilic , Chandra Krintz , Andre Merzky , Douglas Thain , Mehmet C. Vuran , Rich Wolski

Microservices architecture has started a new trend for application development for a number of reasons: (1) to reduce complexity by using tiny services; (2) to scale, remove and deploy parts of the system easily; (3) to improve flexibility…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-15 Marcelo Amaral , Jordà Polo , David Carrera , Iqbal Mohomed , Merve Unuvar , Malgorzata Steinder

In Edge Computing (EC), containers have been increasingly used to deploy applications to provide mobile users services. Each container must run based on a container image file that exists locally. However, it has been conspicuously…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-03 Fangyi Mou , Zhiqing Tang , Jiong Lou , Jianxiong Guo , Wenhua Wang , Tian Wang

We present an open-source topology-aware hierarchical unstructured mesh partitioning and load-balancing tool TreePart. The framework provides powerful abstractions to automatically detect and build hierarchical MPI topology resembling the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-04 Pavanakumar Mohanamuraly , Gabriel Staffelbach

This study investigates the potential of WebAssembly as a more secure and efficient alternative to Linux containers for executing untrusted code in cloud computing with Kubernetes. Specifically, it evaluates the security and performance…

Cryptography and Security · Computer Science 2024-11-07 Jasper Alexander Wiegratz

In recent years, the research community has raised serious questions about the reproducibility of scientific work. In particular, since many studies include some kind of computing work, reproducibility is also a technological challenge, not…

Software Engineering · Computer Science 2023-08-03 Lázaro Costa , Susana Barbosa , Jácome Cunha

We present hipBone, an open source performance-portable proxy application for the Nek5000 (and NekRS) CFD applications. HipBone is a fully GPU-accelerated C++ implementation of the original NekBone CPU proxy application with several novel…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-28 Noel Chalmers , Abhishek Mishra , Damon McDougall , Tim Warburton

Swarms of autonomous devices are increasing in ubiquity and size, making the need for rethinking their hardware-software system stack critical. We present HiveMind, the first swarm coordination platform that enables programmable execution…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-03 Liam Patterson , David Pigorovsky , Brian Dempsey , Nikita Lazarev , Aditya Shah , Clara Steinhoff , Ariana Bruno , Justin Hu , Christina Delimitrou

HPC systems employ a growing variety of compute accelerators with different architectures and from different vendors. Large scientific applications are required to run efficiently across these systems but need to retain a single code-base…

Developing complex biomolecular workflows is not always straightforward. It requires tedious developments to enable the interoperability between the different biomolecular simulation and analysis tools. Moreover, the need to execute the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-20 Jorge Ejarque , Pau Andrio , Adam Hospital , Javier Conejero , Daniele Lezzi , Josep LL. Gelpi , Rosa M. Badia

Exascale computing will get mankind closer to solving important social, scientific and engineering problems. Due to high prototyping costs, High Performance Computing (HPC) system architects make use of simulation models for design space…

Performance · Computer Science 2018-03-28 Alexandra Ferreron , Radhika Jagtap , Sascha Bischoff , Roxana Rusitoru

The scientific and research community has benefited greatly from containerized distributed High Throughput Computing (dHTC), both by enabling elastic scaling of user compute workloads to thousands of compute nodes, and by allowing for…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-25 Igor Sfiligoi , Yunjin Zhu , Jaime Frey

Optimizing communication performance is imperative for large-scale computing because communication overheads limit the strong scalability of parallel applications. Today's network cards contain rather powerful processors optimized for data…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-20 Torsten Hoefler , Salvatore Di Girolamo , Konstantin Taranov , Ryan E. Grant , Ron Brightwell

We present and evaluate the ExaNeSt Prototype, a liquid-cooled rack prototype consisting of 256 Xilinx ZU9EG MPSoCs, 4 TBytes of DRAM, 16 TBytes of SSD, and configurable interconnection 10-Gbps hardware. We developed this testbed in…