English
Related papers

Related papers: Towards A Methodology and Framework for Workflow-D…

200 papers

This paper describes a building blocks approach to the design of scientific workflow systems. We discuss RADICAL-Cybertools as one implementation of the building blocks concept, showing how they are designed and developed in accordance with…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-28 Matteo Turilli , Vivek Balasubramanian , Andre Merzky , Ioannis Paraskevakos , Shantenu Jha

Leadership computing facilities around the world support cutting-edge scientific research across a broad spectrum of disciplines including understanding climate change, combating opioid addiction, or simulating the decay of a neutron. While…

High Energy Physics - Lattice · Physics 2020-04-16 Chia Cheng Chang , Christopher Körber , André Walker-Loud

Science reproducibility is a cornerstone feature in scientific workflows. In most cases, this has been implemented as a way to exactly reproduce the computational steps taken to reach the final results. While these steps are often…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-21 Karan Vahi , Mats Rynge , George Papadimitriou , Duncan A. Brown , Rajiv Mayani , Rafael Ferreira da Silva , Ewa Deelman , Anirban Mandal , Eric Lyons , Michael Zink

Advances in technology and computing hardware are enabling scientists from all areas of science to produce massive amounts of data using large-scale simulations or observational facilities. In this era of data deluge, effective coordination…

Databases · Computer Science 2015-03-31 Spyros Blanas , Surendra Byna

The automation of scientific discovery represents a critical milestone in Artificial Intelligence (AI) research. However, existing agentic systems for science suffer from two fundamental limitations: rigid, pre-programmed workflows that…

Artificial Intelligence · Computer Science 2025-10-20 Ed Li , Junyu Ren , Xintian Pan , Cat Yan , Chuanhao Li , Dirk Bergemann , Zhuoran Yang

Scientific research increasingly depends on robust and scalable IT infrastructures to support complex computational workflows. With the proliferation of services provided by research infrastructures, NRENs, and commercial cloud providers,…

The rising popularity of computational workflows is driven by the need for repetitive and scalable data processing, sharing of processing know-how, and transparent methods. As both combined records of analysis and descriptions of processing…

Data science has employed great research efforts in developing advanced analytics, improving data models and cultivating new algorithms. However, not many authors have come across the organizational and socio-technical challenges that arise…

Machine Learning · Computer Science 2022-01-17 Iñigo Martinez , Elisabeth Viles , Igor G. Olaizola

Experimental science is increasingly driven by instruments that produce vast volumes of data and thus a need to manage, compute, describe, and index this data. High performance and distributed computing provide the means of addressing the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-12 Jim Pruyne , Valerie Hayot-Sasson , Weijian Zheng , Ryan Chard , Justin M. Wozniak , Tekin Bicer , Kyle Chard , Ian T. Foster

Large systems biology projects can encompass several workgroups often located in different countries. An overview about existing data standards in systems biology and the management, storage, exchange and integration of the generated data…

Databases · Computer Science 2009-12-15 Gerhard Mayer

This is a position paper, submitted to the Future Online Analysis Platform Workshop (https://press3.mcs.anl.gov/futureplatform/), which argues that simple data analysis applications are common today, but future online supercomputing…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-27 Justin M Wozniak , Jonathan Ozik , Daniel S. Katz , Michael Wilde

The paper examines the current trends in designing of systems for convenient and secure remote job submission to various computer resources, including supercomputers, computer clusters, cloud resources, data storages and databases, and grid…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-01 Stanislav P. Polyakov , Andrey P. Demichev , Alexander P. Kryukov

Scientific workflows are widely used to automate scientific data analysis and often involve processing large quantities of data on compute clusters. As such, their execution tends to be long-running and resource intensive, leading to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-20 Kathleen West , Fabian Lehmann , Vasilis Bountris , Ulf Leser , Yehia Elkhatib , Lauritz Thamsen

Hybrid workflows combining traditional HPC and novel ML methodologies are transforming scientific computing. This paper presents the architecture and implementation of a scalable runtime system that extends RADICAL-Pilot with service-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-18 Andre Merzky , Mikhail Titov , Matteo Turilli , Ozgur Kilic , Tianle Wang , Shantenu Jha

This paper presents a methodology for designing a containerized and distributed open science infrastructure to simplify its reusability, replicability, and portability in different environments. The methodology is depicted in a step-by-step…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-19 Giuseppe Grieco , Ivan Heibi , Arcangelo Massari , Arianna Moretti , Silvio Peroni

The reproduction and replication of research results has become a major issue for a number of scientific disciplines. In computer science and related computational disciplines such as systems biology, the challenges closely revolve around…

Software Engineering · Computer Science 2017-07-31 Tom Crick , Benjamin A. Hall , Samin Ishtiaq

We propose a hierarchical framework for collaborative intelligent systems. This framework organizes research challenges based on the nature of the collaborative activity and the information that must be shared, with each level building on…

In recent years, the paradigms of data-driven science have become essential components of physical sciences, particularly in geophysical disciplines such as climatology. The field of hydrology is one of these disciplines where machine…

Atmospheric and Oceanic Physics · Physics 2020-06-24 Martin Gauch , Jimmy Lin

Cloud platforms allow users to execute tasks directly from their web browser and are a key enabling technology not only for commerce but also for computational science. Research software is often developed by scientists with limited…

‹ Prev 1 3 4 5 6 7 10 Next ›