English
Related papers

Related papers: ProvDeploy: Provenance-oriented Containerization o…

200 papers

Recording the provenance of scientific computation results is key to the support of traceability, reproducibility and quality assessment of data products. Several data models have been explored to address this need, providing…

Science is conducted collaboratively, often requiring the sharing of knowledge about computational experiments. When experiments include only datasets, they can be shared using Uniform Resource Identifiers (URIs) or Digital Object…

Databases · Computer Science 2018-06-19 Zhihao Yuan , Dai Hai Ton That , Siddhant Kothari , Gabriel Fils , Tanu Malik

Scientific workflows have become integral tools in broad scientific computing use cases. Science discovery is increasingly dependent on workflows to orchestrate large and complex scientific experiments that range from execution of a…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-04 Rafael Ferreira da Silva , Rosa M. Badia , Venkat Bala , Debbie Bard , Peer-Timo Bremer , Ian Buckley , Silvina Caino-Lores , Kyle Chard , Carole Goble , Shantenu Jha , Daniel S. Katz , Daniel Laney , Manish Parashar , Frederic Suter , Nick Tyler , Thomas Uram , Ilkay Altintas , Stefan Andersson , William Arndt , Juan Aznar , Jonathan Bader , Bartosz Balis , Chris Blanton , Kelly Rosa Braghetto , Aharon Brodutch , Paul Brunk , Henri Casanova , Alba Cervera Lierta , Justin Chigu , Taina Coleman , Nick Collier , Iacopo Colonnelli , Frederik Coppens , Michael Crusoe , Will Cunningham , Bruno de Paula Kinoshita , Paolo Di Tommaso , Charles Doutriaux , Matthew Downton , Wael Elwasif , Bjoern Enders , Chris Erdmann , Thomas Fahringer , Ludmilla Figueiredo , Rosa Filgueira , Martin Foltin , Anne Fouilloux , Luiz Gadelha , Andy Gallo , Artur Garcia Saez , Daniel Garijo , Roman Gerlach , Ryan Grant , Samuel Grayson , Patricia Grubel , Johan Gustafsson , Valerie Hayot-Sasson , Oscar Hernandez , Marcus Hilbrich , AnnMary Justine , Ian Laflotte , Fabian Lehmann , Andre Luckow , Jakob Luettgau , Ketan Maheshwari , Motohiko Matsuda , Doriana Medic , Pete Mendygral , Marek Michalewicz , Jorji Nonaka , Maciej Pawlik , Loic Pottier , Line Pouchard , Mathias Putz , Santosh Kumar Radha , Lavanya Ramakrishnan , Sashko Ristov , Paul Romano , Daniel Rosendo , Martin Ruefenacht , Katarzyna Rycerz , Nishant Saurabh , Volodymyr Savchenko , Martin Schulz , Christine Simpson , Raul Sirvent , Tyler Skluzacek , Stian Soiland-Reyes , Renan Souza , Sreenivas Rangan Sukumar , Ziheng Sun , Alan Sussman , Douglas Thain , Mikhail Titov , Benjamin Tovar , Aalap Tripathy , Matteo Turilli , Bartosz Tuznik , Hubertus van Dam , Aurelio Vivas , Logan Ward , Patrick Widener , Sean Wilkinson , Justyna Zawalska , Mahnoor Zulfiqar

Containerization technology offers lightweight OS-level virtualization, and enables portability, reproducibility, and flexibility by packing applications with low performance overhead and low effort to maintain and scale them. Moreover,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-22 Peini Liu , Jordi Guitart

The advent of experimental science facilities-instruments and observatories, such as the Large Hadron Collider, the Laser Interferometer Gravitational Wave Observatory, and the upcoming Large Synoptic Survey Telescope-has brought about…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-12 E. A. Huerta , Roland Haas , Shantenu Jha , Mark Neubauer , Daniel S. Katz

High Performance Computing (HPC) clouds are becoming an alternative to on-premise clusters for executing scientific applications and business analytics services. Most research efforts in HPC cloud aim to understand the cost-benefit of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-05 Marco A. S. Netto , Rodrigo N. Calheiros , Eduardo R. Rodrigues , Renato L. F. Cunha , Rajkumar Buyya

Sharing provenance across workflow management systems automatically is not currently possible, but the value of such a capability is high since it could greatly reduce the amount of duplicated workflows, accelerate the discovery of new…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-17 Jay Jay Billings

Demand is growing for more accountability regarding the technological systems that increasingly occupy our world. However, the complexity of many of these systems - often systems-of-systems - poses accountability challenges. A key reason…

Computers and Society · Computer Science 2019-11-18 Jatinder Singh , Jennifer Cobbe , Chris Norval

To reproduce eScience, several challenges need to be solved: scientific workflows need to be automated; the involved software versions need to be provided in an unambiguous way; input data needs to be easily accessible; High-Performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-30 Kessy Abarenkov , Anne Fouilloux , Helmut Neukirchen , Abdulrahman Azab

The rapid development of computation power and machine learning algorithms has paved the way for automating scientific discovery with a scanning probe microscope (SPM). The key elements towards operationalization of automated SPM are the…

While detailed resource usage monitoring is possible on the low-level using proper tools, associating such usage with higher-level abstractions in the application layer that actually cause the resource usage in the first place presents a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-02 Joel Witzke , Ansgar Lößer , Vasilis Bountris , Florian Schintke , Björn Scheuermann

Workflows are critical for scientific discovery. However, the sophistication, heterogeneity, and scale of workflows make building, testing, and optimizing them increasingly challenging. Furthermore, their complexity and heterogeneity make…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-28 Ozgur Ozan Kilic , Tianle Wang , Matteo Turilli , Mikhail Titov , Andre Merzky , Line Pouchard , Shantenu Jha

The proliferation of commercial cloud computing providers has generated significant interest in the scientific computing community. Much recent research has attempted to determine the benefits and drawbacks of cloud computing for scientific…

Instrumentation and Methods for Astrophysics · Physics 2016-11-15 Gideon Juve , Ewa Deelman , Karan Vahi , Gaurang Mehta , Bruce Berriman , Benjamin P. Berman , Phil Maechling

Cloud computing recently developed into a viable alternative to on-premises systems for executing high-performance computing (HPC) applications. With the emergence of new vendors and hardware options, there is now a growing need to…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-14 Mohammad Mohammadi , Timur Bazhirov

Scientific knowledge increasingly depends on complex computational processes where both hardware and software layers can influence research outcomes. As computational complexity grows, classical-quantum integration provides a lens for…

Emerging Technologies · Computer Science 2026-03-06 Anna Vrtiak , Duuk Baten , Ariana Torres-Knoop

Containers, enabling lightweight environment and performance isolation, fast and flexible deployment, and fine-grained resource sharing, have gained popularity in better application management and deployment in addition to hardware…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-06 Maria A. Rodriguez , Rajkumar Buyya

Scientific workflows are powerful tools for management of scalable experiments, often composed of complex tasks running on distributed resources. Existing cyberinfrastructure provides components that can be utilized within repeatable…

Computers and Society · Computer Science 2019-03-05 Ilkay Altintas , Shweta Purawat , Daniel Crawl , Alok Singh , Kyle Marcus

The adoption of heterogeneous computing systems based on diverse architectures to achieve exascale computing power has worsened the performance portability problem of scientific applications that were designed to run on these platforms. To…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-17 Ami Marowka

To benefit from the abundance of data and the insights it brings data processing pipelines are being used in many areas of research and development in both industry and academia. One approach to automating data processing pipelines is the…

Cryptography and Security · Computer Science 2023-10-18 Ludwig Stage , Dimka Karastoyanova

The growing complexity and scale of scientific workflows in high performance computing (HPC) environments have led to significant challenges in managing energy consumption without compromising computational performance. Traditional…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-25 Ali Zahir , Ashiq Anjum , Mark Wilkinson , Jeyan Thiyagalingam