English
Related papers

Related papers: Improving Scientific Workflow with Cloud Offloadin…

200 papers

Cloud computing recently developed into a viable alternative to on-premises systems for executing high-performance computing (HPC) applications. With the emergence of new vendors and hardware options, there is now a growing need to…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-14 Mohammad Mohammadi , Timur Bazhirov

In the recent years, scientific workflows gained more and more popularity. In scientific workflows, tasks are typically treated as black boxes. Dealing with their complex interrelations to identify optimization potentials and bottlenecks is…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-13 Ansgar Lößer , Joel Witzke , Florian Schintke , Björn Scheuermann

Increasing popularity of the serverless computing approach has led to the emergence of new cloud infrastructures working in Container-as-a-Service (CaaS) model like AWS Fargate, Google Cloud Run, or Azure Container Instances. They introduce…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-23 Krzysztof Burkat , Maciej Pawlik , Bartosz Balis , Maciej Malawski , Karan Vahi , Mats Rynge , Rafael Ferreira da Silva , Ewa Deelman

Scientific workflow management systems support large-scale data analysis on cluster infrastructures. For this, they interact with resource managers which schedule workflow tasks onto cluster nodes. In addition to workflow task descriptions,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-30 Jonathan Bader , Kathleen West , Soeren Becker , Svetlana Kulagina , Fabian Lehmann , Lauritz Thamsen , Henning Meyerhenke , Odej Kao

As users migrate their analytical workloads to cloud databases, it is becoming just as important to reduce monetary costs as it is to optimize query runtime. In the cloud, a query is billed based on either its compute time or the amount of…

Databases · Computer Science 2024-08-02 Tapan Srivastava , Raul Castro Fernandez

The convergence of IoT, Edge, Cloud, and HPC technologies creates a compute continuum that merges cloud scalability and flexibility with HPC's computational power and specialized optimizations. However, integrating cloud and HPC resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-20 Aasish Kumar Sharma , Christian Boehme , Patrick Gelß , Ramin Yahyapour , Julian Kunkel

The basic idea behind Cloud computing is that resource providers offer elastic resources to end users. In this paper, we intend to answer one key question to the success of Cloud computing: in Cloud, can small or medium-scale scientific…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-04-09 Lei Wang , Jianfeng Zhan , Weisong Shi , Yi Liang

Scientific computing often requires the availability of a massive number of computers for performing large scale experiments. Traditionally, these needs have been addressed by using high-performance computing solutions and installed…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-15 Christian Vecchiola , Suraj Pandey , Rajkumar Buyya

A vast and growing number of IoT applications connect physical devices, such as scientific instruments, technical equipment, machines, and cameras, across heterogenous infrastructure from the edge to the cloud to provide responsive,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-09 Andre Luckow , Kartik Rattan , Shantenu Jha

The heterogeneous edge-cloud computing paradigm can provide an optimal solution to deploy scientific workflows compared to cloud computing or other traditional distributed computing environments. Owing to the different sizes of scientific…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-17 Xin Du

Critical goals of scientific computing are to increase scientific rigor, reproducibility, and transparency while keeping up with ever-increasing computational demands. This work presents an integrated framework well-suited for data…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-13 Paul Nuyujukian

Scientific applications in HPC environment are more com-plex and more data-intensive nowadays. Scientists usually rely on workflow system to manage the complexity: simply define multiple processing steps into a single script and let the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-17 Dong Dai , Robert Ross , Dounia Khaldi , Yonghong Yan , Matthieu Dorier , Neda Tavakoli , Yong Chen

Computational offloading is a promising approach for overcoming resource constraints on client devices by moving some or all of an application's computations to remote servers. With the advent of specialized hardware accelerators, client…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-09 Nathan Ng , David Irwin , Ananthram Swami , Don Towsley , Prashant Shenoy

With the mass deployment of computing-intensive applications and delay-sensitive applications on end devices, only adequate computing resources can meet differentiated services' delay requirements. By offloading tasks to cloud servers or…

Networking and Internet Architecture · Computer Science 2021-03-12 Zhuo Li , Xu Zhou , Taixin Li , Yang Liu

With the advantages that cloud computing offers in terms of platform as a service, software as a service, and infrastructure as a service, data engineers and data scientists are able to leverage cloud computing for their ETL/ELT (extract,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-01 Mohammad Rehman , Hairong Wang

Deep-learning-based intelligent services have become prevalent in cyber-physical applications including smart cities and health-care. Deploying deep-learning-based intelligence near the end-user enhances privacy protection, responsiveness,…

Machine Learning · Computer Science 2022-02-23 Sina Shahhosseini , Dongjoo Seo , Anil Kanduri , Tianyi Hu , Sung-soo Lim , Bryan Donyanavard , Amir M. Rahmani , Nikil Dutt

Scientific workflows consist of thousands of highly parallelized tasks executed in a distributed environment involving many components. Automatic tracing and investigation of the components' and tasks' performance metrics, traces, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-19 Jonathan Bader , Joel Witzke , Soeren Becker , Ansgar Lößer , Fabian Lehmann , Leon Doehler , Anh Duc Vu , Odej Kao

With the fast development of mobile edge computing (MEC), there is an increasing demand for running complex applications on the edge. These complex applications can be represented as workflows where task dependencies are explicitly…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-25 Xuejun Li , Tianxiang Chen , Dong Yuan , Jia Xu , Xiao Liu

With the advances in e-Sciences and the growing complexity of scientific analyses, more and more scientists and researchers are relying on workflow systems for process coordination, derivation automation, provenance tracking, and…

Software Engineering · Computer Science 2008-08-27 Yong Zhao , Ioan Raicu , Ian Foster

Infrastructure as a service clouds hide the complexity of maintaining the physical infrastructure with a slight disadvantage: they also hide their internal working details. Should users need knowledge about these details e.g., to increase…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-20 Gabor Kecskemeti , Zsolt Nemeth , Attila Kertesz , Rajiv Ranjan