English
Related papers

Related papers: Complex Workflow Management and Integration of Dis…

200 papers

The advent of experimental science facilities-instruments and observatories, such as the Large Hadron Collider, the Laser Interferometer Gravitational Wave Observatory, and the upcoming Large Synoptic Survey Telescope-has brought about…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-12 E. A. Huerta , Roland Haas , Shantenu Jha , Mark Neubauer , Daniel S. Katz

Scientific workflow management systems support large-scale data analysis on cluster infrastructures. For this, they interact with resource managers which schedule workflow tasks onto cluster nodes. In addition to workflow task descriptions,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-30 Jonathan Bader , Kathleen West , Soeren Becker , Svetlana Kulagina , Fabian Lehmann , Lauritz Thamsen , Henning Meyerhenke , Odej Kao

The explosive demand for artificial intelligence (AI) workloads has led to a significant increase in silicon area dedicated to lower-precision computations on recent high-performance computing hardware designs. However, mixed-precision…

Computational Engineering, Finance, and Science · Computer Science 2025-09-09 Aditya Kashi , Hao Lu , Wesley Brewer , David Rogers , Michael Matheson , Mallikarjun Shankar , Feiyi Wang

We present an effective system for simulating dust continuum observations by radiative transfer simulations. By using workflow management system RENKEI-WFT, we utilized distributed computing resources and automated a sequence of…

Instrumentation and Methods for Astrophysics · Physics 2014-06-11 Kazutaka Motoyama , Yoshikazu Tanaka , Kento Aida , Eisaku Sakane , Kenichi Miura

Science gateways are user-centric, end-to-end cyberinfrastructure for managing scientific data and executions of computational software on distributed resources. In order to simplify the creation and management of science gateways, we have…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-09 Dimuthu Wannipurage , Isuru Ranawaka , Eroma Abeysinghe , Marcus Christie , Suresh Marru , Marlon Pierce

We present status and results of AstroGrid-D, a joint effort of astrophysicists and computer scientists to employ grid technology for scientific applications. AstroGrid-D provides access to a network of distributed machines with a set of…

In a new effort to make our research transparent and reproducible by others, we developed a workflow to run and share computational studies on the public cloud Microsoft Azure. It uses Docker containers to create an image of the application…

Computational Engineering, Finance, and Science · Computer Science 2020-07-24 Olivier Mesnard , Lorena A. Barba

Molecular dynamics (MD) simulation is essential for various scientific domains but computationally expensive. Learning-based force fields have made significant progress in accelerating ab-initio MD simulation but are not fast enough for…

Machine Learning · Computer Science 2023-08-29 Xiang Fu , Tian Xie , Nathan J. Rebello , Bradley D. Olsen , Tommi Jaakkola

Information technology and data science development stimulate transformation in many fields of scientific knowledge. In recent years, a large number of specialized systems for information and knowledge management have been created in…

Materials Science · Physics 2025-10-09 Victor Dudarev , Lars Banko , Alfred Ludwig

Research process automation -- the reliable, efficient, and reproducible execution of linked sets of actions on scientific instruments, computers, data stores, and other resources -- has emerged as an essential element of modern science. We…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-08 Ryan Chard , Jim Pruyne , Kurt McKee , Josh Bryan , Brigitte Raumann , Rachana Ananthakrishnan , Kyle Chard , Ian Foster

Predicting the performance of various infrastructure design options in complex federated infrastructures with computing sites distributed over a wide area network that support a plethora of users and workflows, such as the Worldwide LHC…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-14 Maximilian Horzela , Henri Casanova , Manuel Giffels , Artur Gottmann , Robin Hofsaess , Günter Quast , Simone Rossi Tisbeni , Achim Streit , Frédéric Suter

Advancements in scientific instrument sensors and connected devices provide unprecedented insight into ongoing experiments and present new opportunities for control, optimization, and steering. However, the diversity of sensors and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-04 Jakob R. Elias , Ryan Chard , Maksim Levental , Zhengchun Liu , Ian Foster , Santanu Chaudhuri

Contemporary Distributed Computing Systems (DCS) such as Cloud Data Centres are large scale, complex, heterogeneous, and distributed across multiple networks and geographical boundaries. On the other hand, the Internet of Things…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-10 Shashikant Ilager , Rajeev Muralidhar , Rajkumar Buyya

Emerging data-driven scientific workflows are seeking to leverage distributed data sources to understand end-to-end phenomena, drive experimentation, and facilitate important decision-making. Despite the exponential growth of available…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-10 Manish Parashar

Deep learning has been postulated as a solution for numerous problems in different branches of science. Given the resource-intensive nature of these models, they often need to be executed on specialized hardware such graphical processing…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-15 Jose González-Abad , Álvaro López García , Valentin Y. Kozlov

Classical molecular dynamics (MD) simulations are important tools in life and material sciences since they allow studying chemical and biological processes in detail. However, the inherent scalability problem of particle-particle…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-14 Michael Schaffner , Luca Benini

Harnessing modern parallel computing resources to achieve complex multi-physics simulations is a daunting task. The Multiphysics Object Oriented Simulation Environment (MOOSE) aims to enable such development by providing simplified…

The importance of workflows is highlighted by the fact that they have underpinned some of the most significant discoveries of the past decades. Many of these workflows have significant computational, storage, and communication demands, and…

Cloud Computing is becoming the leading paradigm for executing scientific and engineering workflows. The large-scale nature of the experiments they model and their variable workloads make clouds the ideal execution environment due to prompt…

Neural and Evolutionary Computing · Computer Science 2018-11-05 David A. Monge , Elina Pacini , Cristian Mateos , Enrique Alba , Carlos García Garino

Scientific discovery increasingly requires executing heterogeneous scientific workflows on high-performance computing (HPC) platforms. Heterogeneous workflows contain different types of tasks (e.g., simulation, analysis, and learning) that…