English
Related papers

Related papers: Container Orchestration on HPC Systems

200 papers

The conventional model of resource allocation in HPC systems is static. Thus, a job cannot leverage newly available resources in the system or release underutilized resources during the execution. In this paper, we present Kub, a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-15 Daniel Medeiros , Jacob Wahlgren , Gabin Schieffer , Ivy Peng

Linux container technologies such as Docker and Singularity offer encapsulated environments for easy execution of software. In high performance computing, this is especially important for evolving and complex software stacks with…

Operating Systems · Computer Science 2022-12-15 Vanessa Sochat , Matthieu Muffato , Audrey Stott , Marco De La Pierre , Georgia Stuart

Microservices have become the de-facto software architecture for cloud-native applications. A contentious architectural decision in microservices is to compose them using choreography or orchestration. In choreography, every service works…

Software Engineering · Computer Science 2022-10-21 Anas Nadeem , Muhammad Zubair Malik

Deep learning has been postulated as a solution for numerous problems in different branches of science. Given the resource-intensive nature of these models, they often need to be executed on specialized hardware such graphical processing…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-15 Jose González-Abad , Álvaro López García , Valentin Y. Kozlov

Operating System-level virtualization technology, or containers as they are commonly known, represents the next generation of light-weight virtualization, and is primarily represented by Docker. However, Docker's current design does not…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-29 Mudit Verma , Mohan Dhawan

High-performance computing (HPC) systems and cloud data centers are converging, and containers are becoming the default method of portable software deployment. Yet, while containers simplify software management, they face significant…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-23 Marcin Copik , Eiman Alnuaimi , Alok Kamatar , Valerie Hayot-Sasson , Alberto Madonna , Todd Gamblin , Kyle Chard , Ian Foster , Torsten Hoefler

The adoption of cloud computing technologies in the industry is paving the way to new manufacturing paradigms. In this paper we propose a model to optimize the orchestration of workloads with differentiated criticality levels on a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-29 Marco Barletta , Marcello Cinque , Davide De Vita

Different departments of a large organization often run dedicated cluster systems for different computing loads, like HPC (high performance computing) jobs or Web service applications. In this paper, we have designed and implemented a cloud…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-07-20 Jianfeng Zhan , Lei Wang , Bibo Tu , Yong Li , Peng Wang , Wei Zhou , Dan Meng

The problem of managing multi-service applications on top of Cloud-Edge networks in a QoS-aware manner has been thoroughly studied in recent years from a decision-making perspective. However, only a few studies addressed the problem of…

Software Engineering · Computer Science 2024-04-12 Giuseppe Bisicchia , Stefano Forti , Ernesto Pimentel , Antonio Brogi

In recent years, serverless computing, especially Function as a Service (FaaS), is rapidly growing in popularity as a cloud programming model. The serverless computing model provides an intuitive interface for developing cloud-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-10 Aristotelis Peri , Michail Tsenos , Vana Kalogeraki

This project investigates the benefits of containerization technology in modern software development and deployment. The study emphasizes the advantages of using Kubernetes and Docker in the development process, including the easy packaging…

Software Engineering · Computer Science 2023-05-02 Vamsi Krishna Yepuri , Venkata Kalyan Polamarasetty , Shivani Donthi , Ajay Kumar Reddy Gondi

HPC-based applications often have complex workflows with many software dependencies that hinder their portability on contemporary HPC architectures. In addition, these applications often require extraordinary efforts to deploy and execute…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-14 Sameh Abdulah , Jorge Ejarque , Omar Marzouk , Hatem Ltaief , Ying Sun , Marc G. Genton , Rosa M. Badia , David E. Keyes

Cloud computing has become the ubiquitous computing and storage paradigm. It is also attractive for scientists, because they do not have to care any more for their own IT infrastructure, but can outsource it to a Cloud Service Provider of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-11 Harald Richter

Orchestration systems are becoming a key component to automatically manage distributed computing resources in many fields with criticality requirements like Industry 4.0 (I4.0). However, they are mainly linked to OS-level virtualization,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-07 Marco Barletta , Marcello Cinque , Luigi De Simone , Raffaele Della Corte , Giorgio Farina , Daniele Ottaviano

The HPC community is actively researching and evaluating tools to support execution of scientific applications in cloud-based environments. Among the various technologies, containers have recently gained importance as they have…

Performance · Computer Science 2019-05-23 Pankaj Saha , Angel Beltre , Piotr Uminski , Madhusudhan Govindaraju

Virtual machine images and instances (VMs) in cloud computing centres are typically designed as isolation containers for applications, databases and networking functions. In order to build complex distributed applications, multiple virtual…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-09-24 Josef Spillner , Andrii Chaichenko , Andrey Brito , Francisco Brasileiro , Alexander Schill

Kubernetes has emerged as a leading open-source platform for container orchestration, allowing organizations to efficiently manage and deploy containerized applications at scale. This paper investigates the performance of four Kubernetes…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-05 Hossein Aqasizade , Ehsan Ataie , Mostafa Bastam

Container technique is gaining increasing attention in recent years and has become an alternative to traditional virtual machines. Some of the primary motivations for the enterprise to adopt the container technology include its convenience…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-06 Qi Zhang , Ling Liu , Calton Pu , Qiwei Dou , Liren Wu , Wei Zhou

Cloud computing has emerged as a corner stone of today's computing landscape. More and more customers who outsource their infrastructure benefit from the manageability, scalability and cost saving that come with cloud computing. Those…

Cryptography and Security · Computer Science 2022-05-13 Ferdinand Brasser , Patrick Jauernig , Frederik Pustelnik , Ahmad-Reza Sadeghi , Emmanuel Stapf

The advent of High Performance Computing (HPC) has provided the computational capacity required for power system operators (SO) to obtain solutions in the least time to highly-complex applications, i.e., Unit Commitment (UC). The UC…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-14 Mushfiqur R. Sarker , Jianhui Wang