English
Related papers

Related papers: Container Orchestration on HPC Systems

200 papers

Recent development in lightweight OS-level virtualization, containers, provides a potential solution for running HPC applications on the cloud platform. In this work, we focus on the impact of different layers in a containerized environment…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-18 Daniel Medeiros , Gabin Schieffer , Jacob Wahlgren , Ivy Peng

Software container solutions have revolutionized application development approaches by enabling lightweight platform abstractions within the so-called "containers." Several solutions are being actively developed in attempts to bring the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-03 Maxim Belkin , Roland Haas , Galen Wesley Arnold , Hon Wai Leong , Eliu A. Huerta , David Lesny , Mark Neubauer

Orchestrating service-oriented workflows is typically based on a design model that routes both data and control through a single point - the centralised workflow engine. This causes scalability problems that include the unnecessary…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-15 Ward Jaradat , Alan Dearle , Adam Barker

Container technologies have been evolving rapidly in the cloud-native era. Kubernetes, as a production-grade container orchestration platform, has been proven to be successful at managing containerized applications in on-premises…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-25 Chao Zheng , Qinghui Zhuang , Fei Guo

Many scientific workflows require dedicated compute resources, including HPC clusters with optimized software, quantum resources, and dedicated hardware cluster systems like Ray, for example. At the same time, many scientific workflows…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-07 Boris Lublinsky , Elise Jennings , Viktória Spišaková

Resource management is the principal factor to fully utilize the potential of Edge/Fog computing to execute real-time and critical IoT applications. Although some resource management frameworks exist, the majority are not designed based on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-11 Zhiyu Wang , Mohammad Goudarzi , Jagannath Aryal , Rajkumar Buyya

High performance computing (HPC) and cloud have traditionally been separate, and presented in an adversarial light. The conflict arises from disparate beginnings that led to two drastically different cultures, incentive structures, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-24 Vanessa Sochat , David Fox , Daniel Milroy

Currently, due to the advantages of light weight, simple deployment, multi-environment support, short startup time, scalability, and easy migration, container technology has been widely used in both cloud and edge/fog computing, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-14 Zhiyu Wang , Rajkumar Buyya

Solving the software dependency issue under the HPC environment has always been a difficult task for both computing system administrators and application scientists. This work would like to tackle the issue by introducing the modern…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-09-29 Hsi-En Yu , Weicheng Huang

This paper presents CODECO, a federated orchestration framework for Kubernetes that addresses the limitations of cloud-centric deployment. CODECO adopts a data-compute-network co-orchestration approach to support heterogeneous…

Cloud computing is an established technology allowing users to share resources on a large scale, never before seen in IT history. A cloud system connects multiple individual servers in order to process related tasks in several environments…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-30 Leszek Sliwko

As Kubernetes becomes the infrastructure of the cloud-native era, the integration of workflow systems with Kubernetes is gaining more and more popularity. To our knowledge, workflow systems employ scheduling algorithms that optimize task…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-07 Chenggang Shan , Guan Wang , Yuanqing Xia , Yufeng Zhan , Jinhui Zhang

Modern cyber-physical systems (CPS) such as Cooperative Intelligent Transport Systems (C-ITS) are increasingly defined by the software which operates these systems. In practice, microservice architectures can be employed, which may consist…

Robotics · Computer Science 2023-08-15 Bastian Lampe , Lennart Reiher , Lukas Zanger , Timo Woopen , Raphael van Kempen , Lutz Eckstein

Quantum computing resources are increasingly being incorporated into high-performance computing (HPC) environments as co-processors for hybrid workloads. To support this paradigm, quantum devices must be treated as schedulable first-class…

A key challenge for supporting elastic behaviour in cloud systems is to achieve a good performance in automated (de-)provisioning and scheduling of computing resources. One of the key aspects that can be significant is the overheads…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-31 Víctor Medel , Rafael Tolosana-Calasanz , José Ángel Bañares , Unai Arronategui , Omer F. Rana

Containerized services deployed within various computing systems, such as edge and cloud, desire live migration support to enable user mobility, elasticity, and load balancing. To enable such a ubiquitous and efficient service migration, a…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-07 Thanawat Chanikaphon , Mohsen Amini Salehi

Containerized microservices are widely adopted for latency-sensitive and compute-intensive applications, with Kubernetes (K8s) as the dominant orchestration platform. However, automating the deployment and management of multi-service…

Private cloud infrastructures are now widely deployed and adopted across technology industries and research institutions. Although cloud computing has emerged as a reality, it is now known that a single cloud provider cannot fully satisfy…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-10 Miguel Caballer , Sahdev Zala , Álvaro López García , Germán Moltó , Pablo Orviz Fernández , Mathieu Velten

Linux containers have gained high popularity in recent times. This popularity is significantly due to various advantages of containers over Virtual Machines (VM). The containers are lightweight, occupy lesser storage, have fast boot-up…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-21 Akshay Dhumal , Dharanipragada Janakiram

Quantum applications are most often hybrid, i.e. they are not only made of implementations of pure quantum algorithms but also of classical programs as well as workflows and topologies as key artifacts, and data they process. Since…

Quantum Physics · Physics 2021-03-09 Frank Leymann , Johanna Barzen