English
Related papers

Related papers: Scientific Workflow Repeatability through Cloud-Aw…

200 papers

Workflow is a common term used to describe a systematic breakdown of tasks that need to be performed to solve a problem. This concept has found best use in scientific and business applications for streamlining and improving the performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-08 Samiya Khan , Kashish Ara Shakil , Mansaf Alam

Scientific applications in HPC environment are more com-plex and more data-intensive nowadays. Scientists usually rely on workflow system to manage the complexity: simply define multiple processing steps into a single script and let the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-17 Dong Dai , Robert Ross , Dounia Khaldi , Yonghong Yan , Matthieu Dorier , Neda Tavakoli , Yong Chen

Reproducibility has been consistently identified as an important component of scientific research. Although there is a general consensus on the importance of reproducibility along with the other commonly used 'R' terminology (i.e.,…

Information Theory · Computer Science 2020-12-29 Anirudh Prabhu , Peter Fox

Scientific workflow management systems support large-scale data analysis on cluster infrastructures. For this, they interact with resource managers which schedule workflow tasks onto cluster nodes. In addition to workflow task descriptions,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-30 Jonathan Bader , Kathleen West , Soeren Becker , Svetlana Kulagina , Fabian Lehmann , Lauritz Thamsen , Henning Meyerhenke , Odej Kao

Science reproducibility is a cornerstone feature in scientific workflows. In most cases, this has been implemented as a way to exactly reproduce the computational steps taken to reach the final results. While these steps are often…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-21 Karan Vahi , Mats Rynge , George Papadimitriou , Duncan A. Brown , Rajiv Mayani , Rafael Ferreira da Silva , Ewa Deelman , Anirban Mandal , Eric Lyons , Michael Zink

Moving legacy software systems to cloud platforms is an ever popular option. But, such an endeavour may not be hazard-free and demands a proper understanding of requirements and risks involved prior to taking any actions. The time is indeed…

Software Engineering · Computer Science 2020-04-24 Mahdi Fahmideh , Ghassan Beydoun

Providing an appropriate level of accessibility to and tracking of data or process elements in large volumes of medical data, is an essential requirement in the Big Data era. Researchers require systems that provide traceability of…

Databases · Computer Science 2015-12-01 Richard McClatchey , Jetendr Shamdasani , Andrew Branson , Kamran Munir , Zsolt Kovacs

Capturing the history of operations and activities during a computational workflow is significantly important for Earth Observation (EO). The data provenance helps to collect the metadata that records the lineage of data products, providing…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-11 H. Omidi , L. Sacco , V. Hutter , G. Irsiegler , M. Claus , M. Schobben , A. Jacob , M. Schramm , S. Fiore

The proliferation of commercial cloud computing providers has generated significant interest in the scientific computing community. Much recent research has attempted to determine the benefits and drawbacks of cloud computing for scientific…

Instrumentation and Methods for Astrophysics · Physics 2016-11-15 Gideon Juve , Ewa Deelman , Karan Vahi , Gaurang Mehta , Bruce Berriman , Benjamin P. Berman , Phil Maechling

Scientific workflows have been predominantly used for complex and large scale data analysis and scientific computation/automation and the need for robust workflow scheduling techniques has grown considerably. But, most of the existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-04 S. Jaya Nirmala , Amrith Rajagopal Setlur , Har Simrat Singh , Sudhanshu Khoriya

Complex scientific workflows can process large amounts of data using thousands of tasks. The turnaround times of these workflows are often affected by various latencies such as the resource discovery, scheduling and data access latencies…

Since the mid 1990s, grid computing systems have emerged as an analogy for making computing power as pervasive an easily accessible as an electric power grid. Since then, grid computing systems have been shown to be able to provide very…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-01-29 Marco Guazzone

The ever-growing availability of computing power and the sustained development of advanced computational methods have contributed much to recent scientific progress. These developments present new challenges driven by the sheer amount of…

The state-of-the-art for auditing and reproducing scientific applications on high-performance computing (HPC) systems is through a data provenance subsystem. While recent advances in data provenance lie in reducing the performance overhead…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-04 Abdullah Al-Mamun , Dongfang Zhao

With the advent of Grid and application technologies, scientists and engineers are building more and more complex applications to manage and process large data sets, and execute scientific experiments on distributed resources. Such…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Jia Yu , Rajkumar Buyya

Scientific research increasingly depends on robust and scalable IT infrastructures to support complex computational workflows. With the proliferation of services provided by research infrastructures, NRENs, and commercial cloud providers,…

With recent increasing computational and data requirements of scientific applications, the use of large clustered systems as well as distributed resources is inevitable. Although executing large applications in these environments brings…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-06-30 Alexandru Costan , Florin Pop , Corina Stratan , Ciprian Dobre , Catalin Leordeanu , Valentin Cristea

As data-driven methods are becoming pervasive in a wide variety of disciplines, there is an urgent need to develop scalable and sustainable tools to simplify the process of data science, to make it easier to keep track of the analyses being…

Databases · Computer Science 2016-10-18 Hui Miao , Amit Chavan , Amol Deshpande

The cloud computing paradigm is being adopted by many organizations in different application domains as it is cost effective and offers a virtually unlimited pool of resources. Engineering critical systems can benefit from clouds in…

Software Engineering · Computer Science 2014-05-01 Sami Alajrami

Scientific workflows have become essential for orchestrating complex computational processes across distributed resources, managing large datasets, and ensuring reproducibility in modern research. The Workflows Community Summit 2025, held…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-06 Irene Bonati , Silvina Caino-Lores , Tainã Coleman , Sagar Dolas , Sandro Fiore , Venkatesh Kannan , Marco Verdicchio , Sean R. Wilkinson , Rafael Ferreira da Silva