English
Related papers

Related papers: Workflows Community Summit 2022: A Roadmap Revolut…

200 papers

Scientific workflow management systems offer features for composing complex computational pipelines from modular building blocks, for executing the resulting automated workflows, and for recording the provenance of data products resulting…

The transformations, analyses and interpretations of data in scientific workflows are vital for the repeatability and reliability of scientific workflows. This provenance of scientific workflows has been effectively carried out in Grid…

Databases · Computer Science 2016-11-18 Khawar Hasham , Kamran Munir , Jetendr Shamdasani , Richard McClatchey

Across almost all scientific disciplines, the instruments that record our experimental data and the methods required for storage and data analysis are rapidly increasing in complexity. This gives rise to the need for scientific communities…

Physics Education · Physics 2018-09-26 Daniela Huppenkothen , Anthony Arendt , David W. Hogg , Karthik Ram , Jake VanderPlas , Ariel Rokem

Artificial intelligence is transforming molecular and materials science, but its growing computational and data demands raise critical sustainability challenges. In this Perspective, we examine resource considerations across the AI-driven…

Scientific Workflow Systems (SWSs) are advanced software frameworks that drive modern research by orchestrating complex computational tasks and managing extensive data pipelines. These systems offer a range of essential features, including…

Software Engineering · Computer Science 2025-06-26 Khairul Alam , Banani Roy , Chanchal K. Roy , Kartik Mittal

Increasing popularity of the serverless computing approach has led to the emergence of new cloud infrastructures working in Container-as-a-Service (CaaS) model like AWS Fargate, Google Cloud Run, or Azure Container Instances. They introduce…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-23 Krzysztof Burkat , Maciej Pawlik , Bartosz Balis , Maciej Malawski , Karan Vahi , Mats Rynge , Rafael Ferreira da Silva , Ewa Deelman

With the growing complexity of computational and experimental facilities, many scientific researchers are turning to machine learning (ML) techniques to analyze large scale ensemble data. With complexities such as multi-component workflows,…

Cloud platforms allow users to execute tasks directly from their web browser and are a key enabling technology not only for commerce but also for computational science. Research software is often developed by scientists with limited…

Experimental science is increasingly driven by instruments that produce vast volumes of data and thus a need to manage, compute, describe, and index this data. High performance and distributed computing provide the means of addressing the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-12 Jim Pruyne , Valerie Hayot-Sasson , Weijian Zheng , Ryan Chard , Justin M. Wozniak , Tekin Bicer , Kyle Chard , Ian T. Foster

Exascale computers will offer transformative capabilities to combine data-driven and learning-based approaches with traditional simulation applications to accelerate scientific discovery and insight. These software combinations and…

Scientific workflow management systems support large-scale data analysis on cluster infrastructures. For this, they interact with resource managers which schedule workflow tasks onto cluster nodes. In addition to workflow task descriptions,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-30 Jonathan Bader , Kathleen West , Soeren Becker , Svetlana Kulagina , Fabian Lehmann , Lauritz Thamsen , Henning Meyerhenke , Odej Kao

Artificial intelligence (AI) is reshaping how research is conceived, conducted, and communicated across fields from chemistry to biomedicine. This commentary examines how AI is transforming the research workflow. AI systems now help…

Artificial Intelligence · Computer Science 2025-11-14 Maksim E. Eren , Dorianis M. Perez

With ever-increasing computational capabilities, robust and automated research workflows have become essential for orchestrating large numbers of interdependent simulations. However, significant technical expertise is still required to…

As spatial and temporal resolutions of scientific instruments improve, the explosion in the volume of data produced is becoming a key challenge. It can be a critical bottleneck for integration between scientific instruments at the edge and…

Instrumentation and Detectors · Physics 2021-11-03 Kazutomo Yoshii , Rajesh Sankaran , Sebastian Strempfer , Maksim Levental , Mike Hammer , Antonino Miceli

Runtime scheduling and workflow systems are an increasingly popular algorithmic component in HPC because they allow full system utilization with relaxed synchronization requirements. There are so many special-purpose tools for task…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-03 David M. Rogers

The rapid proliferation of scientific knowledge presents a grand challenge: transforming this vast repository of information into an active engine for discovery, especially in high-stakes domains like healthcare. Current AI agents, however,…

Artificial Intelligence · Computer Science 2025-10-14 Yinghao Zhu , Yifan Qi , Zixiang Wang , Lei Gu , Dehao Sui , Haoran Hu , Xichen Zhang , Ziyi He , Junjun He , Liantao Ma , Lequan Yu

Just like the scientific data they generate, simulation workflows for research should be findable, accessible, interoperable, and reusable (FAIR). However, while significant progress has been made towards FAIR data, the majority of science…

Digital Libraries · Computer Science 2022-05-04 Martin Hunt , Steven Clark , Daniel Mejia , Saaketh Desai , Alejandro Strachan

Modern large-scale physics experiments create datasets with sizes and streaming rates that can exceed those from industry leaders such as Google Cloud and Netflix. Fully processing these datasets requires both sufficient compute power and…