Workflows Community Summit 2022: A Roadmap Revolution
Abstract
Scientific workflows have become integral tools in broad scientific computing use cases. Science discovery is increasingly dependent on workflows to orchestrate large and complex scientific experiments that range from execution of a cloud-based data preprocessing pipeline to multi-facility instrument-to-edge-to-HPC computational workflows. Given the changing landscape of scientific computing and the evolving needs of emerging scientific applications, it is paramount that the development of novel scientific workflows and system functionalities seek to increase the efficiency, resilience, and pervasiveness of existing systems and applications. Specifically, the proliferation of machine learning/artificial intelligence (ML/AI) workflows, need for processing large scale datasets produced by instruments at the edge, intensification of near real-time data processing, support for long-term experiment campaigns, and emergence of quantum computing as an adjunct to HPC, have significantly changed the functional and operational requirements of workflow systems. Workflow systems now need to, for example, support data streams from the edge-to-cloud-to-HPC enable the management of many small-sized files, allow data reduction while ensuring high accuracy, orchestrate distributed services (workflows, instruments, data movement, provenance, publication, etc.) across computing and user facilities, among others. Further, to accelerate science, it is also necessary that these systems implement specifications/standards and APIs for seamless (horizontal and vertical) integration between systems and applications, as well as enabling the publication of workflows and their associated products according to the FAIR principles. This document reports on discussions and findings from the 2022 international edition of the Workflows Community Summit that took place on November 29 and 30, 2022.
Cite
@article{arxiv.2304.00019,
title = {Workflows Community Summit 2022: A Roadmap Revolution},
author = {Rafael Ferreira da Silva and Rosa M. Badia and Venkat Bala and Debbie Bard and Peer-Timo Bremer and Ian Buckley and Silvina Caino-Lores and Kyle Chard and Carole Goble and Shantenu Jha and Daniel S. Katz and Daniel Laney and Manish Parashar and Frederic Suter and Nick Tyler and Thomas Uram and Ilkay Altintas and Stefan Andersson and William Arndt and Juan Aznar and Jonathan Bader and Bartosz Balis and Chris Blanton and Kelly Rosa Braghetto and Aharon Brodutch and Paul Brunk and Henri Casanova and Alba Cervera Lierta and Justin Chigu and Taina Coleman and Nick Collier and Iacopo Colonnelli and Frederik Coppens and Michael Crusoe and Will Cunningham and Bruno de Paula Kinoshita and Paolo Di Tommaso and Charles Doutriaux and Matthew Downton and Wael Elwasif and Bjoern Enders and Chris Erdmann and Thomas Fahringer and Ludmilla Figueiredo and Rosa Filgueira and Martin Foltin and Anne Fouilloux and Luiz Gadelha and Andy Gallo and Artur Garcia Saez and Daniel Garijo and Roman Gerlach and Ryan Grant and Samuel Grayson and Patricia Grubel and Johan Gustafsson and Valerie Hayot-Sasson and Oscar Hernandez and Marcus Hilbrich and AnnMary Justine and Ian Laflotte and Fabian Lehmann and Andre Luckow and Jakob Luettgau and Ketan Maheshwari and Motohiko Matsuda and Doriana Medic and Pete Mendygral and Marek Michalewicz and Jorji Nonaka and Maciej Pawlik and Loic Pottier and Line Pouchard and Mathias Putz and Santosh Kumar Radha and Lavanya Ramakrishnan and Sashko Ristov and Paul Romano and Daniel Rosendo and Martin Ruefenacht and Katarzyna Rycerz and Nishant Saurabh and Volodymyr Savchenko and Martin Schulz and Christine Simpson and Raul Sirvent and Tyler Skluzacek and Stian Soiland-Reyes and Renan Souza and Sreenivas Rangan Sukumar and Ziheng Sun and Alan Sussman and Douglas Thain and Mikhail Titov and Benjamin Tovar and Aalap Tripathy and Matteo Turilli and Bartosz Tuznik and Hubertus van Dam and Aurelio Vivas and Logan Ward and Patrick Widener and Sean Wilkinson and Justyna Zawalska and Mahnoor Zulfiqar},
journal= {arXiv preprint arXiv:2304.00019},
year = {2023}
}