English
Related papers

Related papers: Workflows Community Summit: Tightening the Integra…

200 papers

The computing continuum, a novel paradigm that extends beyond the current silos of cloud and edge computing, can enable the seamless and dynamic deployment of applications across diverse infrastructures. By utilizing the cloud-native…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-19 Jacopo Marino , Fulvio Risso

Rapid advancements in cloud based platforms providing access to quantum computing capabilities have opened up several challenges for efficient usage of these highly delicate and costly devices. Although most of the current systems use a…

Quantum Physics · Physics 2026-05-19 Abhishek Sawaika , Udaya Parampalli , Rajkumar Buyya

Emerging data-driven scientific workflows are seeking to leverage distributed data sources to understand end-to-end phenomena, drive experimentation, and facilitate important decision-making. Despite the exponential growth of available…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-10 Manish Parashar

The convergence of IoT, Edge, Cloud, and HPC technologies creates a compute continuum that merges cloud scalability and flexibility with HPC's computational power and specialized optimizations. However, integrating cloud and HPC resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-20 Aasish Kumar Sharma , Christian Boehme , Patrick Gelß , Ramin Yahyapour , Julian Kunkel

In this position paper we argue for standardizing how we share and process data in scientific workflows at the network-level to maximize step re-use and workflow portability across platforms and networks in pursuit of a foundational…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-19 Taylor Paul , William Regli

Over the last two decades, scientific workflow management systems (SWfMS) have emerged as a means to facilitate the design, execution, and monitoring of reusable scientific data processing pipelines. At the same time, the amounts of data…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-03-29 Marc Bux , Ulf Leser

Cloud computing has permeated into the information technology industry in the last few years, and it is emerging nowadays in scientific environments. Science user communities are demanding a broad range of computing power to satisfy the…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-26 Álvaro López García , Enol Fernández-del-Castillo , Pablo Orviz Fernández , Isabel Campos Plasencia , Jesús Marco de Lucas

This paper describes a vision and work in progress to elevate network resources and data transfer management to the same level as compute and storage in the context of services access, scheduling, life cycle management, and orchestration.…

Networking and Internet Architecture · Computer Science 2022-03-22 Tom Lehman , Xi Yang , Chin Guok , Frank Wuerthwein , Igor Sfiligoi , John Graham , Aashay Arora , Dima Mishin , Diego Davila , Jonathan Guiang , Tom Hutton , Harvey Newman , Justas Balcas

Distributed digital infrastructures for computation and analytics are now evolving towards an interconnected ecosystem allowing complex applications to be executed from IoT Edge devices to the HPC Cloud (aka the Computing Continuum, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-06 Daniel Rosendo , Alexandru Costan , Gabriel Antoniu , Patrick Valduriez

Scientific workflow management systems support large-scale data analysis on cluster infrastructures. For this, they interact with resource managers which schedule workflow tasks onto cluster nodes. In addition to workflow task descriptions,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-30 Jonathan Bader , Kathleen West , Soeren Becker , Svetlana Kulagina , Fabian Lehmann , Lauritz Thamsen , Henning Meyerhenke , Odej Kao

With recent increasing computational and data requirements of scientific applications, the use of large clustered systems as well as distributed resources is inevitable. Although executing large applications in these environments brings…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-06-30 Alexandru Costan , Florin Pop , Corina Stratan , Ciprian Dobre , Catalin Leordeanu , Valentin Cristea

Workflow technology is rapidly evolving and, rather than being limited to modeling the control flow in business processes, is becoming a key mechanism to perform advanced data management, such as big data analytics. This survey focuses on…

Databases · Computer Science 2017-01-27 Georgia Kougka , Anastasios Gounaris , Alkis Simitsis

Increasingly, scientific discovery requires sophisticated and scalable workflows. Workflows have become the ``new applications,'' wherein multi-scale computing campaigns comprise multiple and heterogeneous executable tasks. In particular,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-26 Shantenu Jha , Vincent R. Pascuzzi , Matteo Turilli

Workflows specify collections of tasks that must be executed under the responsibility or supervision of human users. Workflow management systems and workflow-driven applications need to enforce security policies in the form of access…

Cryptography and Security · Computer Science 2017-06-23 Daniel Ricardo dos Santos , Silvio Ranise

The advances in data, computing and networking over the last two decades led to a shift in many application domains that includes machine learning on big data as a part of the scientific process, requiring new capabilities for integrated…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-19 Ilkay Altintas , Kyle Marcus , Isaac Nealey , Scott L. Sellars , John Graham , Dima Mishin , Joel Polizzi , Daniel Crawl , Thomas DeFanti , Larry Smarr

Cloud Computing is the latest blooming technology in the era of Computer Science and Information Technology domain. There is an enormous pool of data centres, which are termed as Clouds where the services and associated data are being…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-09-30 Nallakumar R. , Sruthi Priya K. S

In situ approaches can accelerate the pace of scientific discoveries by allowing scientists to perform data analysis at simulation time. Current in situ workflow systems, however, face challenges in handling the growing complexity and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-05 Orcun Yildiz , Dmitriy Morozov , Arnur Nigmetov , Bogdan Nicolae , Tom Peterka

Workflow management systems (WMS) support the composition and deployment of workflow-oriented applications in distributed computing environments. They hide the complexity of managing large-scale applications, which includes the controlling…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-04 Muhammad H. Hilman , Maria A. Rodriguez , Rajkumar Buyya

Current cloud-based smart systems suffer from weaknesses such as high response latency, limited network bandwidth and the restricted computing power of smart end devices which seriously affect the system's QoS (Quality of Service).…

Software Engineering · Computer Science 2021-02-02 Xuejun Li , Ran Ding , Xiao Liu , Jia Xu , Yun Yang , John Grundy