English

Adapting LIGO workflows to run in the Open Science Grid

Distributed, Parallel, and Cluster Computing 2020-12-01 v1 Computational Physics
Authors: Edgar Fajardo , Frank Wuerthwein , Brian Bockelman , Miron Livny , Greg Thain , James Alexander Clark , Peter Couvares , Josh Willis
View on arXiv ↗ PDF ↗

Abstract

During the first observation run the LIGO collaboration needed to offload some of its most, intense CPU workflows from its dedicated computing sites to opportunistic resources. Open Science Grid enabled LIGO to run PyCbC, RIFT and Bayeswave workflows to seamlessly run in a combination of owned and opportunistic resources. One of the challenges is enabling the workflows to use several heterogeneous resources in a coordinated and effective way.

Cite

@article{arxiv.2011.14995,
  title  = {Adapting LIGO workflows to run in the Open Science Grid},
  author = {Edgar Fajardo and Frank Wuerthwein and Brian Bockelman and Miron Livny and Greg Thain and James Alexander Clark and Peter Couvares and Josh Willis},
  journal= {arXiv preprint arXiv:2011.14995},
  year   = {2020}
}

Related papers

View all related →
Distributed, Parallel, and Cluster Computing · Computer Science
BOSS-LDG: A Novel Computational Framework that Brings Together Blue Waters, Open Science Grid, Shifter and the LIGO Data Grid to Accelerate Gravitational Wave Discovery
E. A. Huerta, Roland Haas, Edgar Fajardo, Daniel S. Katz +8
2017-11-30
Distributed, Parallel, and Cluster Computing · Computer Science
Data Access for LIGO on the OSG
Derek Weitzel, Brian Bockelman, Duncan A. Brown, Peter Couvares +2
2017-05-18
Distributed, Parallel, and Cluster Computing · Computer Science
Enabling Adaptive Grid Scheduling and Resource Management
Aleksandar Lazarevic, Lionel Sacks, Ognjen Prnjat
2007-11-05
Distributed, Parallel, and Cluster Computing · Computer Science
Workflow environments for advanced cyberinfrastructure platforms
Rosa M Badia, Jorge Ejarque, Francesc Lordan, Daniele Lezzi +4
2020-06-15
Computational Physics · Physics
New Science on the Open Science Grid
The Open Science Grid Executive Board, :, Ruth Pordes, Mine Altunay +16
2012-08-27
General Relativity and Quantum Cosmology · Physics
The LIGO Open Science Center
Michele Vallisneri, Jonah Kanner, Roy Williams, Alan Weinstein +1
2015-06-11
Systems and Control · Electrical Eng. & Systems
A 5G Enabled Adaptive Computing Workflow for Greener Power Grid
Yousu Chen, Liwei Wang, Xiaoyuan Fan, Dexin Wang +1
2022-11-02
Computers and Society · Computer Science
Towards A Methodology and Framework for Workflow-Driven Team Science
Ilkay Altintas, Shweta Purawat, Daniel Crawl, Alok Singh +1
2019-03-05
Distributed, Parallel, and Cluster Computing · Computer Science
An Architectural Model for a Grid based Workflow Management Platform in Scientific Applications
Alexandru Costan, Florin Pop, Corina Stratan, Ciprian Dobre +2
2011-06-30
Distributed, Parallel, and Cluster Computing · Computer Science
Discovering Job Preemptions in the Open Science Grid
Zhe Zhang, Brian Bockelman, Derek Weitzel, David Swanson
2018-07-19
Software Engineering · Computer Science
Reusability Challenges of Scientific Workflows: A Case Study for Galaxy
Khairul Alam, Banani Roy, Alexander Serebrenik
2023-09-15
Distributed, Parallel, and Cluster Computing · Computer Science
The Gridbus Toolkit for Service Oriented Grid and Utility Computing: An Overview and Status Report
Rajkumar Buyya, Srikumar Venugopal
2007-05-23
Distributed, Parallel, and Cluster Computing · Computer Science
Steering a Fleet: Adaptation for Large-Scale, Workflow-Based Experiments
Jim Pruyne, Valerie Hayot-Sasson, Weijian Zheng, Ryan Chard +4
2024-03-12
Distributed, Parallel, and Cluster Computing · Computer Science
Computing Without Borders: The Way Towards Liquid Computing
Marco Iorio, Fulvio Risso, Alex Palesandro, Leonardo Camiciotti +1
2022-12-26
Computational Engineering, Finance, and Science · Computer Science
Complex Workflow Management and Integration of Distributed Computing Resources by Science Gateway Portal for Molecular Dynamics Simulations in Materials Science
Yuri Gordienko, Lev Bekenov, Olexandr Gatsenko, Elena Zasimchuk +1
2014-04-23
Distributed, Parallel, and Cluster Computing · Computer Science
Low-level I/O Monitoring for Scientific Workflows
Joel Witzke, Ansgar Lößer, Vasilis Bountris, Florian Schintke +1
2024-08-02
Databases · Computer Science
Scientific Workflow Repeatability through Cloud-Aware Provenance
Khawar Hasham, Kamran Munir, Jetendr Shamdasani, Richard McClatchey
2016-11-18
Distributed, Parallel, and Cluster Computing · Computer Science
Towards a Grid Platform for Scientific Workflows Management
Alexandru Costan, Corina Stratan, Eliana-Dina Tirsa, Mugurel Ionut Andreica +1
2009-10-06
Distributed, Parallel, and Cluster Computing · Computer Science
OPPLOAD: Offloading Computational Workflows in Opportunistic Networks
Artur Sterz, Lars Baumgärtner, Jonas höchst, Patrick Lampe +1
2019-07-26
Distributed, Parallel, and Cluster Computing · Computer Science
Dflow, a Python framework for constructing cloud-native AI-for-Science workflows
Xinzijian Liu, Yanbo Han, Zhuoyuan Li, Jiahao Fan +14
2024-04-30
Instrumentation and Methods for Astrophysics · Physics
Fast and Reproducible LOFAR Workflows with AGLOW
A. P. Mechev, J. B. R Oonk, T. Shimwell, A. Plaat +2
2018-09-03
Software Engineering · Computer Science
The Eclipse Integrated Computational Environment
Jay Jay Billings, Andrew R. Bennett, Jordan Deyton, Kasper Gammeltoft +9
2017-06-13
Distributed, Parallel, and Cluster Computing · Computer Science
Workflows Community Summit: Tightening the Integration between Computing Facilities and Scientific Workflows
Rafael Ferreira da Silva, Kyle Chard, Henri Casanova, Dan Laney +10
2022-01-20
Distributed, Parallel, and Cluster Computing · Computer Science
Strategies for Development of a Distributed Framework for Computational Sciences
Vladimir Berezovsky, Alexander Popov
2011-06-21
Distributed, Parallel, and Cluster Computing · Computer Science
Realizing Fast, Scalable and Reliable Scientific Computations in Grid Environments
Yong Zhao, Ioan Raicu, Ian Foster, Mihael Hategan +2
2008-08-27
R2 v1 2026-06-23T20:36:32.034Z