English
Related papers

Related papers: Scaling a Variant Calling Genomics Pipeline with F…

200 papers

Virtual clusters are widely used computing platforms than can be deployed in multiple cloud platforms. The ability to dynamically grow and shrink the number of nodes has paved the way for customised elastic computing both for High…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-18 Miguel Caballer , Marica Antonacci , Zdeněk Šustr , Michele Perniola , Germán Moltó

This paper presents a novel application of Genetic Algorithms(GAs) to quantify the performance of Platform as a Service (PaaS), a cloud service model that plays a critical role in both industry and academia. While Cloud benchmarks are not…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-08-28 Jeff Kinnison , Sekou L. Remy

Context: The combination of distributed stream processing with microservice architectures is an emerging pattern for building data-intensive software systems. In such systems, stream processing frameworks such as Apache Flink, Apache Kafka…

Software Engineering · Computer Science 2023-11-02 Sören Henning , Wilhelm Hasselbring

Existing serverless data analytics systems rely on external storage services like S3 for data shuffling and communication between cloud functions. While this approach provides the elasticity benefits of serverless computing, it incurs…

Databases · Computer Science 2024-04-23 Gang Liao , Amol Deshpande , Daniel J. Abadi

This paper reviews strategies for solving problems encountered when analyzing large genomic data sets and describes the implementation of those strategies in R by packages from the Bioconductor project. We treat the scalable processing,…

Genomics · Quantitative Biology 2014-09-11 Michael Lawrence , Martin Morgan

High-performance computing (HPC) systems and cloud data centers are converging, and containers are becoming the default method of portable software deployment. Yet, while containers simplify software management, they face significant…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-23 Marcin Copik , Eiman Alnuaimi , Alok Kamatar , Valerie Hayot-Sasson , Alberto Madonna , Todd Gamblin , Kyle Chard , Ian Foster , Torsten Hoefler

WebRTC enables browsers to exchange data directly but the number of possible concurrent connections to a single source is limited. We overcome the limitation by organizing participants in a fat-tree overlay: when the maximum number of…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-15 Erick Lavoie , Laurie Hendren , Fréderic Desprez , Miguel Correia

Rapid adoption of the serverless (or Function-as-a-Service, FaaS) paradigm, pioneered by Amazon with AWS Lambda and followed by numerous commercial offerings and open source projects, introduces new challenges in designing the cloud…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-01 Ping-Min Lin , Alex Glikson

In research labs, there is often a need to customise software at every step in a given bioinformatics workflow, but traditionally it has been difficult to obtain both a high degree of customisability and good performance.…

Software Engineering · Computer Science 2012-08-23 Gabriel Keeble-Gagnère , Johan Nyström-Persson , Matthew Bellgard , Kenji Mizuguchi

Serverless computing has emerged as an attractive paradigm due to the efficiency of development and the ease of deployment without managing any underlying infrastructure. Nevertheless, serverless computing approaches face numerous…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-18 Emilian Simion , Yuandou Wang , Hsiang-ling Tai , Uraz Odyurt , Zhiming Zhao

Profiling techniques are used extensively at different parts of the computing stack to achieve many goals. One major goal is to make a piece of software execute more efficiently on a specific hardware platform, where efficiency spans…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-07 Chris Quackenbush , Mohamed Zahran

Data is found everywhere, from health and human infrastructure to the surge of sensors and the proliferation of internet-connected devices. To meet this challenge, the data engineering field has expanded significantly in recent years in…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-06 Mills Staylor , Arup Kumar Sarker , Gregor von Laszewski , Geoffrey Fox , Yue Cheng , Judy Fox

The advancement of scalable quantum information processing relies on the accurate and parallel manipulation of a vast number of qubits, potentially reaching into the millions. Superconducting qubits, traditionally controlled through…

Quantum Physics · Physics 2023-12-13 Pan Shi , Jiahao Yuan , Fei Yan , Haifeng Yu

One important feature of complex systems are problem domains that have many local minima and substructure. Biological systems manage these local minima by switching between different subsystems depending on their environmental or…

Neural and Evolutionary Computing · Computer Science 2022-08-25 Ankit Grover , Vaishali Yadav , Bradly Alicea

High Performance Computing (HPC) clouds are becoming an alternative to on-premise clusters for executing scientific applications and business analytics services. Most research efforts in HPC cloud aim to understand the cost-benefit of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-05 Marco A. S. Netto , Rodrigo N. Calheiros , Eduardo R. Rodrigues , Renato L. F. Cunha , Rajkumar Buyya

Autoscaling system can reconfigure cloud-based services and applications, through various configurations of cloud software and provisions of hardware resources, to adapt to the changing environment at runtime. Such a behavior offers the…

Software Engineering · Computer Science 2018-04-26 Tao Chen , Rami Bahsoon , Xin Yao

Industry 4.0 is changing fundamentally data collection, its storage and analysis in industrial processes, enabling novel application such as flexible manufacturing of highly customized products. Real-time control of these processes,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-06 Florian Hofer , Martin Sehr , Alberto Sangiovanni-Vincentelli , Barbara Russo

Service-Oriented Computing (SOC) enables the composition of loosely coupled service agents provided with varying Quality of Service (QoS) levels, effectively forming a multiagent system (MAS). Selecting a (near-)optimal set of services for…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-01-22 Adrian Klein , Fuyuki Ishikawa , Shinichi Honiden

HPC-based applications often have complex workflows with many software dependencies that hinder their portability on contemporary HPC architectures. In addition, these applications often require extraordinary efforts to deploy and execute…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-14 Sameh Abdulah , Jorge Ejarque , Omar Marzouk , Hatem Ltaief , Ying Sun , Marc G. Genton , Rosa M. Badia , David E. Keyes