English
Related papers

Related papers: Towards Advanced Monitoring for Scientific Workflo…

200 papers

The collaborative efforts of large communities in science experiments, often comprising thousands of global members, reflect a monumental commitment to exploration and discovery. Recently, advanced and complex data processing has gained…

Nowadays, many scientific workflows from different domains, such as Remote Sensing, Astronomy, and Bioinformatics, are executed on large computing infrastructures managed by resource managers. Scientific workflow management systems (SWMS)…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-28 Fabian Lehmann , Jonathan Bader , Lauritz Thamsen , Ulf Leser

As software systems increase in complexity, conventional monitoring methods struggle to provide a comprehensive overview or identify performance issues, often missing unexpected problems. Observability, however, offers a holistic approach,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-29 Bartosz Balis , Konrad Czerepak , Albert Kuzma , Jan Meizner , Lukasz Wronski

This paper tries to reduce the effort of learning, deploying, and integrating several frameworks for the development of e-Science applications that combine simulations with High-Performance Data Analytics (HPDA). We propose a way to extend…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-10 Cristian Ramon-Cortes , Francesc Lordan , Jorge Ejarque , Rosa M. Badia

Modern scientific discovery increasingly requires coordinating distributed facilities and heterogeneous resources, forcing researchers to act as manual workflow coordinators rather than scientists. Advances in AI leading to AI agents show…

Artificial Intelligence · Computer Science 2025-09-15 Woong Shin , Renan Souza , Daniel Rosendo , Frédéric Suter , Feiyi Wang , Prasanna Balaprakash , Rafael Ferreira da Silva

Task graphs provide a simple way to describe scientific workflows (sets of tasks with dependencies) that can be executed on both HPC clusters and in the cloud. An important aspect of executing such graphs is the used scheduling algorithm.…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-18 Jakub Beránek , Stanislav Böhm , Vojtěch Cima

The role of scalable high-performance workflows and flexible workflow management systems that can support multiple simulations will continue to increase in importance. For example, with the end of Dennard scaling, there is a need to…

Software Engineering · Computer Science 2017-10-19 Jay Jay Billings , Shantenu Jha

With recent increasing computational and data requirements of scientific applications, the use of large clustered systems as well as distributed resources is inevitable. Although executing large applications in these environments brings…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-06-30 Alexandru Costan , Florin Pop , Corina Stratan , Ciprian Dobre , Catalin Leordeanu , Valentin Cristea

After a machine learning (ML)-based system is deployed, monitoring its performance is important to ensure the safety and effectiveness of the algorithm over time. When an ML algorithm interacts with its environment, the algorithm can affect…

Cloud computing has emerged as a promising platform for running scientific workflows across various domains. Scientists can take advantage of different cloud service models, such as serverful or serverless, to execute workflows based on…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-29 Saeid Abrishami , Faridreza Momtaz Zandi , Alireza Nourbakhsh

The Workflows Community Summit gathered 111 participants from 18 countries to discuss emerging trends and challenges in scientific workflows, focusing on six key areas: time-sensitive workflows, AI-HPC convergence, multi-facility workflows,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-22 Rafael Ferreira da Silva , Deborah Bard , Kyle Chard , Shaun de Witt , Ian T. Foster , Tom Gibbs , Carole Goble , William Godoy , Johan Gustafsson , Utz-Uwe Haus , Stephen Hudson , Shantenu Jha , Laila Los , Drew Paine , Frédéric Suter , Logan Ward , Sean Wilkinson , Marcos Amaris , Yadu Babuji , Jonathan Bader , Riccardo Balin , Daniel Balouek , Sarah Beecroft , Khalid Belhajjame , Rajat Bhattarai , Wes Brewer , Paul Brunk , Silvina Caino-Lores , Henri Casanova , Daniela Cassol , Jared Coleman , Taina Coleman , Iacopo Colonnelli , Anderson Andrei Da Silva , Daniel de Oliveira , Pascal Elahi , Nour Elfaramawy , Wael Elwasif , Brian Etz , Thomas Fahringer , Wesley Ferreira , Rosa Filgueira , Jacob Fosso Tande , Luiz Gadelha , Andy Gallo , Daniel Garijo , Yiannis Georgiou , Philipp Gritsch , Patricia Grubel , Amal Gueroudji , Quentin Guilloteau , Carlo Hamalainen , Rolando Hong Enriquez , Lauren Huet , Kevin Hunter Kesling , Paula Iborra , Shiva Jahangiri , Jan Janssen , Joe Jordan , Sehrish Kanwal , Liliane Kunstmann , Fabian Lehmann , Ulf Leser , Chen Li , Peini Liu , Jakob Luettgau , Richard Lupat , Jose M. Fernandez , Ketan Maheshwari , Tanu Malik , Jack Marquez , Motohiko Matsuda , Doriana Medic , Somayeh Mohammadi , Alberto Mulone , John-Luke Navarro , Kin Wai Ng , Klaus Noelp , Bruno P. Kinoshita , Ryan Prout , Michael R. Crusoe , Sashko Ristov , Stefan Robila , Daniel Rosendo , Billy Rowell , Jedrzej Rybicki , Hector Sanchez , Nishant Saurabh , Sumit Kumar Saurav , Tom Scogland , Dinindu Senanayake , Woong Shin , Raul Sirvent , Tyler Skluzacek , Barry Sly-Delgado , Stian Soiland-Reyes , Abel Souza , Renan Souza , Domenico Talia , Nathan Tallent , Lauritz Thamsen , Mikhail Titov , Benjamin Tovar , Karan Vahi , Eric Vardar-Irrgang , Edite Vartina , Yuandou Wang , Merridee Wouters , Qi Yu , Ziad Al Bkhetan , Mahnoor Zulfiqar

Artificial intelligence systems for scientific discovery have demonstrated remarkable potential, yet existing approaches remain largely proprietary and operate in batch-processing modes requiring hours per research cycle, precluding…

Artificial Intelligence · Computer Science 2026-01-28 Lukas Weidener , Marko Brkić , Mihailo Jovanović , Ritvik Singh , Chiara Baccin , Emre Ulgac , Alex Dobrin , Aakaash Meduri

Experimental science is enabled by the combination of synthesis, imaging, and functional characterization. Synthesis of a new material is typically followed by a set of characterization methods aiming to provide feedback for optimization or…

Artificial intelligence systems are increasingly deployed in biomedical research. However, current evaluation frameworks may inadequately assess their effectiveness as research collaborators. This rapid review examines benchmarking…

Monitoring the execution of business processes and activities composing them is an essential capability of Business Process Management (BPM) Suites. Human tasks are a particular type of business activities, and the understanding of their…

Software Engineering · Computer Science 2016-10-20 Kunal Suri , Adrian Mos

Cloud monitoring activity involves dynamically tracking the Quality of Service (QoS) parameters related to virtualized resources (e.g., VM, storage, network, appliances, etc.), the physical resources they share, the applications running on…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-12-24 Khalid Alhamazani , Rajiv Ranjan , Karan Mitra , Fethi Rabhi , Samee Ullah Khan , Adnene Guabtni , Vasudha Bhatnagar

Periodic human activities with implicit workflows are common in manufacturing, sports, and daily life. While short-term periodic activities -- characterized by simple structures and high-contrast patterns -- have been widely studied,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Fan Yang , Quanting Xie , Atsunori Moteki , Shoichi Masui , Shan Jiang , Kanji Uchino , Yonatan Bisk , Graham Neubig

As scientific research becomes increasingly complex, innovative tools are needed to manage vast data, facilitate interdisciplinary collaboration, and accelerate discovery. Large language models (LLMs) are now evolving into LLM-based…

Artificial Intelligence · Computer Science 2026-02-03 Shuo Ren , Can Xie , Pu Jian , Zhenjiang Ren , Chunlin Leng , Jiajun Zhang

As unmanned aircraft systems (UASs) continue to integrate into the U.S. National Airspace System (NAS), there is a need to quantify the risk of airborne collisions between unmanned and manned aircraft to support regulation and standards…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-26 Andrew Weinert , Marc Brittain , Ngaire Underhill , Christine Serres

Science reproducibility is a cornerstone feature in scientific workflows. In most cases, this has been implemented as a way to exactly reproduce the computational steps taken to reach the final results. While these steps are often…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-21 Karan Vahi , Mats Rynge , George Papadimitriou , Duncan A. Brown , Rajiv Mayani , Rafael Ferreira da Silva , Ewa Deelman , Anirban Mandal , Eric Lyons , Michael Zink