English
Related papers

Related papers: The Common Workflow Scheduler Interface: Status Qu…

200 papers

Scientific workflow has become essential in software engineering because it provides a structured approach to designing, executing, and analyzing scientific experiments. Software developers and researchers have developed hundreds of…

Software Engineering · Computer Science 2023-09-15 Khairul Alam , Banani Roy , Alexander Serebrenik

Motivation: Complex computational pipelines are becoming a staple of modern scientific research. Often these pipelines are resource intensive and require days of computing time. In such cases, it makes sense to run them over distributed…

Software Engineering · Computer Science 2015-01-28 David K. Brown , Thommas M. Musyoka , David L. Penkler , Özlem Tastan Bishop

Scientific Workflow Systems (SWSs) are advanced software frameworks that drive modern research by orchestrating complex computational tasks and managing extensive data pipelines. These systems offer a range of essential features, including…

Software Engineering · Computer Science 2025-06-26 Khairul Alam , Banani Roy , Chanchal K. Roy , Kartik Mittal

In situ approaches can accelerate the pace of scientific discoveries by allowing scientists to perform data analysis at simulation time. Current in situ workflow systems, however, face challenges in handling the growing complexity and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-05 Orcun Yildiz , Dmitriy Morozov , Arnur Nigmetov , Bogdan Nicolae , Tom Peterka

Workflows are prevalent in today's computing infrastructures. The workflow model support various different domains, from machine learning to finance and from astronomy to chemistry. Different Quality-of-Service (QoS) requirements and other…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-22 Laurens Versluis , Alexandru Iosup

Scientific workflows have become essential for orchestrating complex computational processes across distributed resources, managing large datasets, and ensuring reproducibility in modern research. The Workflows Community Summit 2025, held…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-06 Irene Bonati , Silvina Caino-Lores , Tainã Coleman , Sagar Dolas , Sandro Fiore , Venkatesh Kannan , Marco Verdicchio , Sean R. Wilkinson , Rafael Ferreira da Silva

With the increasing importance of distributed scientific workflows, there is a critical need to ensure Quality of Service (QoS) constraints, such as minimizing time or limiting execution to resource subsets. However, the unpredictable…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-02 Md Hasanur Rashid , Jesun Firoz , Nathan R. Tallent , Luanzheng Guo , Meng Tang , Dong Dai

In this paper, we propose an architecture for a security-aware workflow management system (WfMS) we call SecFlow in answer to the recent developments of combining workflow management systems with Cloud environments and the still lacking…

Cryptography and Security · Computer Science 2023-07-12 Nafiseh Soveizi , Fatih Turkmen

Scientific workflows are widely used to automate scientific data analysis and often involve processing large quantities of data on compute clusters. As such, their execution tends to be long-running and resource intensive, leading to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-20 Kathleen West , Fabian Lehmann , Vasilis Bountris , Ulf Leser , Yehia Elkhatib , Lauritz Thamsen

Computational models have become one of the prevalent methods to model complex phenomena. To accurately model complex interactions, such as detailed biomolecular interactions, scientists often rely on multiscale models comprised of several…

Scientific workflows are powerful tools for management of scalable experiments, often composed of complex tasks running on distributed resources. Existing cyberinfrastructure provides components that can be utilized within repeatable…

Computers and Society · Computer Science 2019-03-05 Ilkay Altintas , Shweta Purawat , Daniel Crawl , Alok Singh , Kyle Marcus

Scientific applications in HPC environment are more com-plex and more data-intensive nowadays. Scientists usually rely on workflow system to manage the complexity: simply define multiple processing steps into a single script and let the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-17 Dong Dai , Robert Ross , Dounia Khaldi , Yonghong Yan , Matthieu Dorier , Neda Tavakoli , Yong Chen

The landscape of workflow systems for scientific applications is notoriously convoluted with hundreds of seemingly equivalent workflow systems, many isolated research claims, and a steep learning curve. To address some of these challenges…

The prevalence of scientific workflows with high computational demands calls for their execution on various distributed computing platforms, including large-scale leadership-class high-performance computing (HPC) clusters. To handle the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-10 Tainã Coleman , Henri Casanova , Ketan Maheshwari , Loïc Pottier , Sean R. Wilkinson , Justin Wozniak , Frédéric Suter , Mallikarjun Shankar , Rafael Ferreira da Silva

Scientific innovation relies on detailed workflows, which include critical steps such as analyzing literature, generating ideas, validating these ideas, interpreting results, and inspiring follow-up research. However, scientific…

Computation and Language · Computer Science 2024-06-11 Xingjian Zhang , Yutong Xie , Jin Huang , Jinge Ma , Zhaoying Pan , Qijia Liu , Ziyang Xiong , Tolga Ergen , Dongsub Shim , Honglak Lee , Qiaozhu Mei

The transition from CPS-based Industry 4.0 to CPSS-based Industry 5.0 brings new requirements and opportunities to current sensing approaches, especially in light of recent progress in Chatbots and Large Language Models (LLMs). Therefore,…

Artificial Intelligence · Computer Science 2024-02-13 Zhengqiu Zhu , Yong Zhao , Bin Chen , Sihang Qiu , Kai Xu , Quanjun Yin , Jincai Huang , Zhong Liu , Fei-Yue Wang

The importance of workflows is highlighted by the fact that they have underpinned some of the most significant discoveries of the past decades. Many of these workflows have significant computational, storage, and communication demands, and…

Scientific workflows are a cornerstone of modern scientific computing. They are used to describe complex computational applications that require efficient and robust management of large volumes of data, which are typically stored/processed…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-03 Rafael Ferreira da Silva , Loïc Pottier , Tainã Coleman , Ewa Deelman , Henri Casanova

In this paper, we summarize our effort to create and utilize a simple framework to coordinate computational analytics tasks with the help of a workflow system. Our design is based on a minimalistic approach while at the same time allowing…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-01 Gregor von Laszewski , J. P. Fleischer , Geoffrey C. Fox

Scientific workflows are critical to scientific data analysis and often involve computationally intensive processing of large datasets on compute clusters. As such, their execution tends to be long-running and resource-intensive, resulting…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-09 Kathleen West , Youssef Moawad , Fabian Lehmann , Vasilis Bountris , Ulf Leser , Yehia Elkhatib , Lauritz Thamsen